[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:44:55 dist-test-slave-42z9 krb5kdc[31589](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:44:55 dist-test-slave-42z9 krb5kdc[31589](info): set up 2 sockets
Aug 08 14:44:55 dist-test-slave-42z9 krb5kdc[31589](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260808 14:44:57.051294 31578 mini_kdc.cc:121] Time spent starting KDC: real 1.142s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Aug 08 14:44:57 dist-test-slave-42z9 krb5kdc[31589](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200297, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:44:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:44:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.214.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab.
Entry for principal kudu/127.30.214.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab.
I20260808 14:44:57.179293 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:39009
--webserver_interface=127.30.214.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab
--principal=kudu/127.30.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:41411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.214.190:39009
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:44:57.284786 31608 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:44:57.285037 31608 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:44:57.285063 31608 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:44:57.286410 31608 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:44:57.286475 31608 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:44:57.286489 31608 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:44:57.286501 31608 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:44:57.286511 31608 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:44:57.288383 31608 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:41411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.214.190:39009
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab
--principal=kudu/127.30.214.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:39009
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31608
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:44:57.288816 31608 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:44:57.289062 31608 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:44:57.296268 31622 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:57.296435 31619 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:57.296742 31618 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:44:57.297367 31608 server_base.cc:1034] running on GCE node
I20260808 14:44:57.297770 31608 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:44:57.298200 31608 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:44:57.299383 31608 hybrid_clock.cc:648] HybridClock initialized: now 1786200297299368 us; error 30 us; skew 500 ppm
Aug 08 14:44:57 dist-test-slave-42z9 krb5kdc[31589](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200297, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:44:57.302160 31608 init.cc:377] Logged in from keytab as kudu/127.30.214.190@KRBTEST.COM (short username kudu)
I20260808 14:44:57.302819 31608 webserver.cc:460] Webserver started at http://127.30.214.190:34737/ using document root <none> and password file <none>
I20260808 14:44:57.303110 31608 fs_manager.cc:359] Metadata directory not provided
I20260808 14:44:57.303167 31608 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:44:57.303314 31608 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:44:57.304566 31608 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/minicluster-data/master-0/data/instance:
uuid: "a49f7e312b864b079a36b22c88b19b07"
format_stamp: "Formatted at 2026-08-08 14:44:57 on dist-test-slave-42z9"
server_key: "354176422ded7d51e6bee001be7b1f1b"
server_key_iv: "c85cfe4ba1a710f20890e84dd5c6fd8d"
server_key_version: "encryptionkey@0"
I20260808 14:44:57.304890 31608 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/minicluster-data/master-0/wal/instance:
uuid: "a49f7e312b864b079a36b22c88b19b07"
format_stamp: "Formatted at 2026-08-08 14:44:57 on dist-test-slave-42z9"
server_key: "354176422ded7d51e6bee001be7b1f1b"
server_key_iv: "c85cfe4ba1a710f20890e84dd5c6fd8d"
server_key_version: "encryptionkey@0"
I20260808 14:44:57.306850 31608 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260808 14:44:57.307875 31635 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:57.308238 31608 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:44:57.308336 31608 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/minicluster-data/master-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/minicluster-data/master-0/wal
uuid: "a49f7e312b864b079a36b22c88b19b07"
format_stamp: "Formatted at 2026-08-08 14:44:57 on dist-test-slave-42z9"
server_key: "354176422ded7d51e6bee001be7b1f1b"
server_key_iv: "c85cfe4ba1a710f20890e84dd5c6fd8d"
server_key_version: "encryptionkey@0"
I20260808 14:44:57.308409 31608 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:44:57.319926 31608 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:44:57.322435 31608 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:44:57.322633 31608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:44:57.327993 31608 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.190:39009
I20260808 14:44:57.328143 31711 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.190:39009 every 8 connection(s)
I20260808 14:44:57.328720 31608 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
I20260808 14:44:57.330335 31712 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:44:57.333729 31712 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a49f7e312b864b079a36b22c88b19b07: Bootstrap starting.
I20260808 14:44:57.334774 31712 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a49f7e312b864b079a36b22c88b19b07: Neither blocks nor log segments found. Creating new log.
I20260808 14:44:57.335115 31712 log.cc:824] T 00000000000000000000000000000000 P a49f7e312b864b079a36b22c88b19b07: Log is configured to *not* fsync() on all Append() calls
I20260808 14:44:57.336001 31712 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a49f7e312b864b079a36b22c88b19b07: No bootstrap required, opened a new log
I20260808 14:44:57.337191 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 31608
I20260808 14:44:57.337291 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/minicluster-data/master-0/wal/instance
I20260808 14:44:57.337950 31578 external_mini_cluster.cc:1428] Setting key 1f6b5c6807c7577bcc94ca2b94513531
I20260808 14:44:57.337873 31712 raft_consensus.cc:348] T 00000000000000000000000000000000 P a49f7e312b864b079a36b22c88b19b07 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a49f7e312b864b079a36b22c88b19b07" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 39009 } }
I20260808 14:44:57.338083 31712 raft_consensus.cc:374] T 00000000000000000000000000000000 P a49f7e312b864b079a36b22c88b19b07 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:44:57.338197 31712 raft_consensus.cc:729] T 00000000000000000000000000000000 P a49f7e312b864b079a36b22c88b19b07 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a49f7e312b864b079a36b22c88b19b07, State: Initialized, Role: FOLLOWER
I20260808 14:44:57.338408 31712 consensus_queue.cc:260] T 00000000000000000000000000000000 P a49f7e312b864b079a36b22c88b19b07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a49f7e312b864b079a36b22c88b19b07" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 39009 } }
I20260808 14:44:57.338578 31712 raft_consensus.cc:388] T 00000000000000000000000000000000 P a49f7e312b864b079a36b22c88b19b07 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:44:57.338613 31712 raft_consensus.cc:482] T 00000000000000000000000000000000 P a49f7e312b864b079a36b22c88b19b07 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:44:57.338666 31712 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a49f7e312b864b079a36b22c88b19b07 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:44:57.339490 31712 raft_consensus.cc:504] T 00000000000000000000000000000000 P a49f7e312b864b079a36b22c88b19b07 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a49f7e312b864b079a36b22c88b19b07" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 39009 } }
I20260808 14:44:57.339730 31712 leader_election.cc:302] T 00000000000000000000000000000000 P a49f7e312b864b079a36b22c88b19b07 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a49f7e312b864b079a36b22c88b19b07; no voters:
I20260808 14:44:57.339982 31712 leader_election.cc:288] T 00000000000000000000000000000000 P a49f7e312b864b079a36b22c88b19b07 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:44:57.340023 31718 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a49f7e312b864b079a36b22c88b19b07 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:44:57.340179 31718 raft_consensus.cc:686] T 00000000000000000000000000000000 P a49f7e312b864b079a36b22c88b19b07 [term 1 LEADER]: Becoming Leader. State: Replica: a49f7e312b864b079a36b22c88b19b07, State: Running, Role: LEADER
I20260808 14:44:57.340384 31718 consensus_queue.cc:237] T 00000000000000000000000000000000 P a49f7e312b864b079a36b22c88b19b07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a49f7e312b864b079a36b22c88b19b07" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 39009 } }
I20260808 14:44:57.340555 31712 sys_catalog.cc:564] T 00000000000000000000000000000000 P a49f7e312b864b079a36b22c88b19b07 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:44:57.340958 31718 sys_catalog.cc:455] T 00000000000000000000000000000000 P a49f7e312b864b079a36b22c88b19b07 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a49f7e312b864b079a36b22c88b19b07. Latest consensus state: current_term: 1 leader_uuid: "a49f7e312b864b079a36b22c88b19b07" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a49f7e312b864b079a36b22c88b19b07" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 39009 } } }
I20260808 14:44:57.341040 31718 sys_catalog.cc:458] T 00000000000000000000000000000000 P a49f7e312b864b079a36b22c88b19b07 [sys.catalog]: This master's current role is: LEADER
I20260808 14:44:57.341503 31719 sys_catalog.cc:455] T 00000000000000000000000000000000 P a49f7e312b864b079a36b22c88b19b07 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a49f7e312b864b079a36b22c88b19b07" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a49f7e312b864b079a36b22c88b19b07" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 39009 } } }
I20260808 14:44:57.341532 31728 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:44:57.341586 31719 sys_catalog.cc:458] T 00000000000000000000000000000000 P a49f7e312b864b079a36b22c88b19b07 [sys.catalog]: This master's current role is: LEADER
I20260808 14:44:57.342826 31728 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:44:57.345080 31728 catalog_manager.cc:1347] Generated new cluster ID: a6bfa39e21f54cbca7f54aa9fa4b5a4f
I20260808 14:44:57.345131 31728 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 14:44:57 dist-test-slave-42z9 krb5kdc[31589](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200297, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:44:57.358071 31716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:57.339440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55022 (local address 127.30.214.190:39009)
0808 14:44:57.342573 (+ 3133us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:57.342585 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:57.342620 (+ 35us) server_negotiation.cc:407] Connection header received
0808 14:44:57.342796 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:57.342803 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:57.342932 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:57.344105 (+ 1173us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:57.345502 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:57.346841 (+ 1339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:57.348407 (+ 1566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:57.349016 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:57.349115 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:57.353719 (+ 4604us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:57.353725 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:57.353725 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:44:57.353741 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:57.355799 (+ 2058us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:57.356310 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:57.356314 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:57.356314 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:57.356462 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:57.356721 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:57.356722 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:57.356722 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:57.357081 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:57.357250 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:57.357576 (+ 326us) server_negotiation.cc:299] Negotiation successful
0808 14:44:57.357788 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3024,"thread_start_us":111,"threads_started":1}
I20260808 14:44:57.358388 31728 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:44:57.358913 31728 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:44:57.366086 31728 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a49f7e312b864b079a36b22c88b19b07: Generated new TSK 0
I20260808 14:44:57.366312 31728 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.214.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab.
Entry for principal kudu/127.30.214.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab.
I20260808 14:44:57.396391 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.129:0
--local_ip_for_outbound_sockets=127.30.214.129
--webserver_interface=127.30.214.129
--webserver_port=0
--tserver_master_addrs=127.30.214.190:39009
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab
--principal=kudu/127.30.214.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:41411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:44:57.498207 31757 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:44:57.498446 31757 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:44:57.498485 31757 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:44:57.499845 31757 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:44:57.499899 31757 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:44:57.499938 31757 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.129
I20260808 14:44:57.501889 31757 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:41411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab
--principal=kudu/127.30.214.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.214.129
--webserver_port=0
--tserver_master_addrs=127.30.214.190:39009
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31757
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.129
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:44:57.502233 31757 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:44:57.502485 31757 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:44:57.509976 31766 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:57.510241 31765 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:57.510354 31768 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:44:57.510430 31757 server_base.cc:1034] running on GCE node
I20260808 14:44:57.510787 31757 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:44:57.511119 31757 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:44:57.512338 31757 hybrid_clock.cc:648] HybridClock initialized: now 1786200297512302 us; error 42 us; skew 500 ppm
Aug 08 14:44:57 dist-test-slave-42z9 krb5kdc[31589](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200297, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:44:57.516691 31757 init.cc:377] Logged in from keytab as kudu/127.30.214.129@KRBTEST.COM (short username kudu)
I20260808 14:44:57.517304 31757 webserver.cc:460] Webserver started at http://127.30.214.129:39185/ using document root <none> and password file <none>
I20260808 14:44:57.517585 31757 fs_manager.cc:359] Metadata directory not provided
I20260808 14:44:57.517638 31757 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:44:57.517778 31757 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:44:57.519116 31757 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/minicluster-data/ts-0/data/instance:
uuid: "8e3080f106d049c086f53fe148f0fd81"
format_stamp: "Formatted at 2026-08-08 14:44:57 on dist-test-slave-42z9"
server_key: "3651897f6a650bdac95b96f391be2d39"
server_key_iv: "7ee1520cf3b80d2e2b53dca48a151f80"
server_key_version: "encryptionkey@0"
I20260808 14:44:57.519554 31757 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/minicluster-data/ts-0/wal/instance:
uuid: "8e3080f106d049c086f53fe148f0fd81"
format_stamp: "Formatted at 2026-08-08 14:44:57 on dist-test-slave-42z9"
server_key: "3651897f6a650bdac95b96f391be2d39"
server_key_iv: "7ee1520cf3b80d2e2b53dca48a151f80"
server_key_version: "encryptionkey@0"
I20260808 14:44:57.521210 31757 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:44:57.522159 31779 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:57.522363 31757 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:44:57.522457 31757 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/minicluster-data/ts-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/minicluster-data/ts-0/wal
uuid: "8e3080f106d049c086f53fe148f0fd81"
format_stamp: "Formatted at 2026-08-08 14:44:57 on dist-test-slave-42z9"
server_key: "3651897f6a650bdac95b96f391be2d39"
server_key_iv: "7ee1520cf3b80d2e2b53dca48a151f80"
server_key_version: "encryptionkey@0"
I20260808 14:44:57.522538 31757 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:44:57.532681 31757 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:44:57.535034 31757 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:44:57.535238 31757 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:44:57.535709 31757 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:44:57.536209 31757 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:44:57.536316 31757 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:57.536355 31757 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:44:57.536381 31757 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:57.546455 31757 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.129:34935
I20260808 14:44:57.546540 31950 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.129:34935 every 8 connection(s)
I20260808 14:44:57.546857 31757 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
I20260808 14:44:57.553120 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 31757
I20260808 14:44:57.553207 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/minicluster-data/ts-0/wal/instance
I20260808 14:44:57.553344 31578 external_mini_cluster.cc:1428] Setting key 1c7ba355404f21f0e371bcd9bb940713
Aug 08 14:44:57 dist-test-slave-42z9 krb5kdc[31589](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200297, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.129@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:44:57.556797 31716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:57.547849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.129:37197 (local address 127.30.214.190:39009)
0808 14:44:57.547902 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:57.547904 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:57.548124 (+ 220us) server_negotiation.cc:407] Connection header received
0808 14:44:57.548657 (+ 533us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:57.548659 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:57.548673 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:57.548726 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:57.549970 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:57.550483 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:57.551464 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:57.551666 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:57.551723 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:57.554189 (+ 2466us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:57.554191 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:57.554191 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:44:57.554199 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:57.555397 (+ 1198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:57.555832 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:57.555833 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:57.555834 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:57.555893 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:57.556132 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:57.556133 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:57.556133 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:57.556253 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:57.556314 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:57.556607 (+ 293us) server_negotiation.cc:299] Negotiation successful
0808 14:44:57.556703 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260808 14:44:57.556983 31954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:57.547828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:39009 (local address 127.30.214.129:37197)
0808 14:44:57.548000 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:57.548039 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 14:44:57.548556 (+ 517us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:44:57.548806 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:44:57.548811 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:44:57.549655 (+ 844us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:44:57.549868 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:57.549875 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:57.550578 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:57.550579 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:57.551377 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:57.551379 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:57.551745 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:57.551746 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:57.551862 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:57.552354 (+ 492us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:44:57.552362 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:44:57.554083 (+ 1721us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:44:57.555495 (+ 1412us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:44:57.555504 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:44:57.555507 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:44:57.555756 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:44:57.555953 (+ 197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:44:57.555955 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:44:57.555955 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:44:57.556073 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:44:57.556313 (+ 240us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:44:57.556320 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:44:57.556478 (+ 158us) client_negotiation.cc:769] Sending connection context
0808 14:44:57.556575 (+ 97us) client_negotiation.cc:240] Negotiation successful
0808 14:44:57.556752 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":81,"threads_started":1}
I20260808 14:44:57.557574 31952 heartbeater.cc:347] Connected to a master server at 127.30.214.190:39009
I20260808 14:44:57.557693 31952 heartbeater.cc:464] Registering TS with master...
I20260808 14:44:57.557893 31952 heartbeater.cc:511] Master 127.30.214.190:39009 requested a full tablet report, sending...
I20260808 14:44:57.558954 31661 ts_manager.cc:194] Registered new tserver with Master: 8e3080f106d049c086f53fe148f0fd81 (127.30.214.129:34935)
I20260808 14:44:57.560117 31661 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.214.129@KRBTEST.COM'} at 127.30.214.129:37197
WARNING: no policy specified for kudu/127.30.214.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab.
Entry for principal kudu/127.30.214.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab.
I20260808 14:44:57.580649 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.130:0
--local_ip_for_outbound_sockets=127.30.214.130
--webserver_interface=127.30.214.130
--webserver_port=0
--tserver_master_addrs=127.30.214.190:39009
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab
--principal=kudu/127.30.214.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:41411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:44:57.670300 31957 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:44:57.670562 31957 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:44:57.670590 31957 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:44:57.671859 31957 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:44:57.671921 31957 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:44:57.671952 31957 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.130
I20260808 14:44:57.673628 31957 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:41411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab
--principal=kudu/127.30.214.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.214.130
--webserver_port=0
--tserver_master_addrs=127.30.214.190:39009
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31957
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.130
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:44:57.673913 31957 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:44:57.674155 31957 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:44:57.679487 31969 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:57.679512 31964 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:44:57.679698 31957 server_base.cc:1034] running on GCE node
W20260808 14:44:57.679487 31965 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:44:57.680035 31957 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:44:57.680276 31957 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:44:57.681547 31957 hybrid_clock.cc:648] HybridClock initialized: now 1786200297681511 us; error 31 us; skew 500 ppm
Aug 08 14:44:57 dist-test-slave-42z9 krb5kdc[31589](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200297, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:44:57.685001 31957 init.cc:377] Logged in from keytab as kudu/127.30.214.130@KRBTEST.COM (short username kudu)
I20260808 14:44:57.685563 31957 webserver.cc:460] Webserver started at http://127.30.214.130:45425/ using document root <none> and password file <none>
I20260808 14:44:57.685797 31957 fs_manager.cc:359] Metadata directory not provided
I20260808 14:44:57.685843 31957 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:44:57.685954 31957 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:44:57.687055 31957 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/minicluster-data/ts-1/data/instance:
uuid: "92b843806d1b4772897949e42f3b340f"
format_stamp: "Formatted at 2026-08-08 14:44:57 on dist-test-slave-42z9"
server_key: "55b041dfa11a82ddf05c1ff05a866368"
server_key_iv: "b0c2fa9fd03fffcf8b92adb48f0b34a3"
server_key_version: "encryptionkey@0"
I20260808 14:44:57.687427 31957 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/minicluster-data/ts-1/wal/instance:
uuid: "92b843806d1b4772897949e42f3b340f"
format_stamp: "Formatted at 2026-08-08 14:44:57 on dist-test-slave-42z9"
server_key: "55b041dfa11a82ddf05c1ff05a866368"
server_key_iv: "b0c2fa9fd03fffcf8b92adb48f0b34a3"
server_key_version: "encryptionkey@0"
I20260808 14:44:57.688934 31957 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:44:57.689747 31978 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:57.689936 31957 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:44:57.690032 31957 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/minicluster-data/ts-1/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/minicluster-data/ts-1/wal
uuid: "92b843806d1b4772897949e42f3b340f"
format_stamp: "Formatted at 2026-08-08 14:44:57 on dist-test-slave-42z9"
server_key: "55b041dfa11a82ddf05c1ff05a866368"
server_key_iv: "b0c2fa9fd03fffcf8b92adb48f0b34a3"
server_key_version: "encryptionkey@0"
I20260808 14:44:57.690097 31957 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:44:57.712706 31957 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:44:57.714941 31957 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:44:57.715065 31957 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:44:57.715270 31957 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:44:57.715587 31957 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:44:57.715623 31957 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:57.715646 31957 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:44:57.715668 31957 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:57.724166 31957 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.130:37887
I20260808 14:44:57.724205 32142 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.130:37887 every 8 connection(s)
I20260808 14:44:57.724706 31957 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
I20260808 14:44:57.728149 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 31957
I20260808 14:44:57.728237 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/minicluster-data/ts-1/wal/instance
I20260808 14:44:57.728387 31578 external_mini_cluster.cc:1428] Setting key 7f9a6bf58b30a8f7da7635da70ac4942
Aug 08 14:44:57 dist-test-slave-42z9 krb5kdc[31589](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200297, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.130@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:44:57.734747 31716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:57.725643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.130:33775 (local address 127.30.214.190:39009)
0808 14:44:57.725705 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:57.725707 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:57.725958 (+ 251us) server_negotiation.cc:407] Connection header received
0808 14:44:57.726585 (+ 627us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:57.726587 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:57.726600 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:57.726646 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:57.727644 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:57.728173 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:57.729342 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:57.729591 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:57.729650 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:57.731903 (+ 2253us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:57.731905 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:57.731906 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:44:57.731914 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:57.733272 (+ 1358us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:57.733799 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:57.733800 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:57.733801 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:57.733868 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:57.734095 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:57.734096 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:57.734096 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:57.734239 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:57.734305 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:57.734550 (+ 245us) server_negotiation.cc:299] Negotiation successful
0808 14:44:57.734650 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 14:44:57.734830 32145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:57.725642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:39009 (local address 127.30.214.130:33775)
0808 14:44:57.725809 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:57.725850 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 14:44:57.726483 (+ 633us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:44:57.726726 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:44:57.726731 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:44:57.727333 (+ 602us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:44:57.727546 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:57.727552 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:57.728310 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:57.728311 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:57.729262 (+ 951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:57.729265 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:57.729666 (+ 401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:57.729667 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:57.729788 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:57.730392 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:44:57.730400 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:44:57.731808 (+ 1408us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:44:57.733380 (+ 1572us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:44:57.733387 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:44:57.733389 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:44:57.733701 (+ 312us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:44:57.733931 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:44:57.733931 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:44:57.733931 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:44:57.734044 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:44:57.734300 (+ 256us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:44:57.734303 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:44:57.734425 (+ 122us) client_negotiation.cc:769] Sending connection context
0808 14:44:57.734506 (+ 81us) client_negotiation.cc:240] Negotiation successful
0808 14:44:57.734647 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":82,"threads_started":1}
I20260808 14:44:57.735328 32143 heartbeater.cc:347] Connected to a master server at 127.30.214.190:39009
I20260808 14:44:57.735428 32143 heartbeater.cc:464] Registering TS with master...
I20260808 14:44:57.735642 32143 heartbeater.cc:511] Master 127.30.214.190:39009 requested a full tablet report, sending...
I20260808 14:44:57.736042 31661 ts_manager.cc:194] Registered new tserver with Master: 92b843806d1b4772897949e42f3b340f (127.30.214.130:37887)
I20260808 14:44:57.736403 31661 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.214.130@KRBTEST.COM'} at 127.30.214.130:33775
WARNING: no policy specified for kudu/127.30.214.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab.
Entry for principal kudu/127.30.214.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab.
I20260808 14:44:57.754352 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.131:0
--local_ip_for_outbound_sockets=127.30.214.131
--webserver_interface=127.30.214.131
--webserver_port=0
--tserver_master_addrs=127.30.214.190:39009
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab
--principal=kudu/127.30.214.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:41411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:44:57.841620 32149 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:44:57.841836 32149 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:44:57.841861 32149 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:44:57.843075 32149 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:44:57.843120 32149 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:44:57.843147 32149 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.131
I20260808 14:44:57.844655 32149 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:41411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab
--principal=kudu/127.30.214.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.214.131
--webserver_port=0
--tserver_master_addrs=127.30.214.190:39009
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32149
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.131
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:44:57.844900 32149 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:44:57.845140 32149 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:44:57.850152 32154 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:57.850162 32157 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:57.850173 32155 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:44:57.850327 32149 server_base.cc:1034] running on GCE node
I20260808 14:44:57.850562 32149 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:44:57.850808 32149 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:44:57.851981 32149 hybrid_clock.cc:648] HybridClock initialized: now 1786200297851967 us; error 30 us; skew 500 ppm
Aug 08 14:44:57 dist-test-slave-42z9 krb5kdc[31589](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200297, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:44:57.854534 32149 init.cc:377] Logged in from keytab as kudu/127.30.214.131@KRBTEST.COM (short username kudu)
I20260808 14:44:57.855012 32149 webserver.cc:460] Webserver started at http://127.30.214.131:42947/ using document root <none> and password file <none>
I20260808 14:44:57.855247 32149 fs_manager.cc:359] Metadata directory not provided
I20260808 14:44:57.855295 32149 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:44:57.855432 32149 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:44:57.856513 32149 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/minicluster-data/ts-2/data/instance:
uuid: "2d362aec99f64faf8b02ea978f12fb97"
format_stamp: "Formatted at 2026-08-08 14:44:57 on dist-test-slave-42z9"
server_key: "9586f7dd8a98ba57e879f7594a7792b6"
server_key_iv: "e2a14c66a3599809646c9f4f6f167c28"
server_key_version: "encryptionkey@0"
I20260808 14:44:57.856856 32149 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/minicluster-data/ts-2/wal/instance:
uuid: "2d362aec99f64faf8b02ea978f12fb97"
format_stamp: "Formatted at 2026-08-08 14:44:57 on dist-test-slave-42z9"
server_key: "9586f7dd8a98ba57e879f7594a7792b6"
server_key_iv: "e2a14c66a3599809646c9f4f6f167c28"
server_key_version: "encryptionkey@0"
I20260808 14:44:57.858331 32149 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:44:57.859097 32167 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:57.859254 32149 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:44:57.859342 32149 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/minicluster-data/ts-2/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/minicluster-data/ts-2/wal
uuid: "2d362aec99f64faf8b02ea978f12fb97"
format_stamp: "Formatted at 2026-08-08 14:44:57 on dist-test-slave-42z9"
server_key: "9586f7dd8a98ba57e879f7594a7792b6"
server_key_iv: "e2a14c66a3599809646c9f4f6f167c28"
server_key_version: "encryptionkey@0"
I20260808 14:44:57.859418 32149 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:44:57.880275 32149 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:44:57.882458 32149 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:44:57.882614 32149 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:44:57.882858 32149 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:44:57.883172 32149 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:44:57.883206 32149 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:57.883236 32149 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:44:57.883261 32149 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:57.889526 32149 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.131:37231
I20260808 14:44:57.889585 32337 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.131:37231 every 8 connection(s)
I20260808 14:44:57.889925 32149 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
I20260808 14:44:57.890350 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 32149
I20260808 14:44:57.890435 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786200295877777-31578-0/minicluster-data/ts-2/wal/instance
I20260808 14:44:57.890604 31578 external_mini_cluster.cc:1428] Setting key bfacddf7a0b2907dc253dd73605db89c
Aug 08 14:44:57 dist-test-slave-42z9 krb5kdc[31589](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200297, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.131@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:44:57.899533 31716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:57.890800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:45831 (local address 127.30.214.190:39009)
0808 14:44:57.890867 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:57.890869 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:57.891124 (+ 255us) server_negotiation.cc:407] Connection header received
0808 14:44:57.891787 (+ 663us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:57.891788 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:57.891800 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:57.891851 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:57.892853 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:57.893425 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:57.894464 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:57.894664 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:57.894720 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:57.896993 (+ 2273us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:57.896995 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:57.896995 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:44:57.897004 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:57.898184 (+ 1180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:57.898589 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:57.898590 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:57.898590 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:57.898650 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:57.898880 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:57.898881 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:57.898882 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:57.899001 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:57.899060 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:57.899329 (+ 269us) server_negotiation.cc:299] Negotiation successful
0808 14:44:57.899439 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 14:44:57.899703 32343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:57.890803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:39009 (local address 127.30.214.131:45831)
0808 14:44:57.891000 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:57.891054 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 14:44:57.891684 (+ 630us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:44:57.891934 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:44:57.891938 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:44:57.892545 (+ 607us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:44:57.892755 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:57.892760 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:57.893547 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:57.893548 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:57.894376 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:57.894379 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:57.894735 (+ 356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:57.894736 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:57.894874 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:57.895373 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:44:57.895382 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:44:57.896899 (+ 1517us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:44:57.898264 (+ 1365us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:44:57.898273 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:44:57.898275 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:44:57.898515 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:44:57.898706 (+ 191us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:44:57.898707 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:44:57.898707 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:44:57.898821 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:44:57.899054 (+ 233us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:44:57.899061 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:44:57.899206 (+ 145us) client_negotiation.cc:769] Sending connection context
0808 14:44:57.899296 (+ 90us) client_negotiation.cc:240] Negotiation successful
0808 14:44:57.899475 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":97,"threads_started":1}
I20260808 14:44:57.900441 32340 heartbeater.cc:347] Connected to a master server at 127.30.214.190:39009
I20260808 14:44:57.900545 32340 heartbeater.cc:464] Registering TS with master...
I20260808 14:44:57.900736 32340 heartbeater.cc:511] Master 127.30.214.190:39009 requested a full tablet report, sending...
I20260808 14:44:57.901115 31661 ts_manager.cc:194] Registered new tserver with Master: 2d362aec99f64faf8b02ea978f12fb97 (127.30.214.131:37231)
I20260808 14:44:57.901518 31661 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.214.131@KRBTEST.COM'} at 127.30.214.131:45831
I20260808 14:44:57.903465 31578 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 14:44:57 dist-test-slave-42z9 krb5kdc[31589](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200297, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 14:44:57 dist-test-slave-42z9 krb5kdc[31589](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200297, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.30.214.129@KRBTEST.COM
I20260808 14:44:57.929471 32348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:57.922146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54808 (local address 127.30.214.129:34935)
0808 14:44:57.922312 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:57.922318 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:57.922329 (+ 11us) server_negotiation.cc:407] Connection header received
0808 14:44:57.922357 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:57.922359 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:57.922373 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:57.922444 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:57.923001 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:57.923739 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:57.924450 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:57.924783 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:57.924833 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:57.927147 (+ 2314us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:57.927153 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:57.927154 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:44:57.927160 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:57.928474 (+ 1314us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:57.928783 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:57.928786 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:57.928786 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:57.928840 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:57.928975 (+ 135us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:57.928976 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:57.928976 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:57.929115 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:57.929246 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:57.929279 (+ 33us) server_negotiation.cc:299] Negotiation successful
0808 14:44:57.929346 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":83,"threads_started":1}
W20260808 14:44:57.930022 31818 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54808
Aug 08 14:44:57 dist-test-slave-42z9 krb5kdc[31589](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200297, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 14:44:57 dist-test-slave-42z9 krb5kdc[31589](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200297, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.214.129@KRBTEST.COM
I20260808 14:44:57.953819 32348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:57.947142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54816 (local address 127.30.214.129:34935)
0808 14:44:57.947203 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:57.947205 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:57.947260 (+ 55us) server_negotiation.cc:407] Connection header received
0808 14:44:57.947337 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:57.947338 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:57.947352 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:57.947399 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:57.947969 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:57.948459 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:57.949191 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:57.949395 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:57.949476 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:57.951638 (+ 2162us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:57.951640 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:57.951640 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:44:57.951648 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:57.952753 (+ 1105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:57.953068 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:57.953069 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:57.953069 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:57.953122 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:57.953284 (+ 162us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:57.953285 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:57.953285 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:57.953383 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:57.953515 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:57.953636 (+ 121us) server_negotiation.cc:299] Negotiation successful
0808 14:44:57.953725 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 14:44:57.954366 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 31757
I20260808 14:44:57.967397 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 31957
I20260808 14:44:57.980973 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 32149
I20260808 14:44:57.992931 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 31608
2026-08-08T14:44:58Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2116 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:44:58 dist-test-slave-42z9 krb5kdc[32358](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:44:58 dist-test-slave-42z9 krb5kdc[32358](info): set up 2 sockets
Aug 08 14:44:58 dist-test-slave-42z9 krb5kdc[32358](info): commencing operation
krb5kdc: starting...
W20260808 14:44:59.127604 31578 mini_kdc.cc:121] Time spent starting KDC: real 1.108s user 0.005s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Aug 08 14:44:59 dist-test-slave-42z9 krb5kdc[32358](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200299, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:44:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:44:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.214.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab.
Entry for principal kudu/127.30.214.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab.
I20260808 14:44:59.260520 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:38907
--webserver_interface=127.30.214.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab
--principal=kudu/127.30.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:42937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.214.190:38907
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:44:59.361431 32376 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:44:59.361742 32376 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:44:59.361769 32376 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:44:59.363025 32376 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:44:59.363088 32376 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:44:59.363102 32376 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:44:59.363114 32376 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:44:59.363126 32376 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:44:59.364758 32376 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:42937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.214.190:38907
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab
--principal=kudu/127.30.214.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:38907
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32376
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:44:59.365018 32376 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:44:59.365257 32376 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:44:59.370316 32384 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:59.370323 32387 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:59.370318 32389 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:44:59.370587 32376 server_base.cc:1034] running on GCE node
I20260808 14:44:59.370855 32376 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:44:59.371151 32376 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:44:59.372327 32376 hybrid_clock.cc:648] HybridClock initialized: now 1786200299372315 us; error 29 us; skew 500 ppm
Aug 08 14:44:59 dist-test-slave-42z9 krb5kdc[32358](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200299, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:44:59.374922 32376 init.cc:377] Logged in from keytab as kudu/127.30.214.190@KRBTEST.COM (short username kudu)
I20260808 14:44:59.375391 32376 webserver.cc:460] Webserver started at http://127.30.214.190:35969/ using document root <none> and password file <none>
I20260808 14:44:59.375607 32376 fs_manager.cc:359] Metadata directory not provided
I20260808 14:44:59.375656 32376 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:44:59.375787 32376 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:44:59.376899 32376 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/minicluster-data/master-0/data/instance:
uuid: "82b3c1d7c0f243da8944dce9e56a77a2"
format_stamp: "Formatted at 2026-08-08 14:44:59 on dist-test-slave-42z9"
server_key: "993d0b2eff03b437d0b6dbe72a338e04"
server_key_iv: "20ebbe8b3c73868f1c46d630c402955b"
server_key_version: "encryptionkey@0"
I20260808 14:44:59.377239 32376 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/minicluster-data/master-0/wal/instance:
uuid: "82b3c1d7c0f243da8944dce9e56a77a2"
format_stamp: "Formatted at 2026-08-08 14:44:59 on dist-test-slave-42z9"
server_key: "993d0b2eff03b437d0b6dbe72a338e04"
server_key_iv: "20ebbe8b3c73868f1c46d630c402955b"
server_key_version: "encryptionkey@0"
I20260808 14:44:59.378638 32376 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260808 14:44:59.379556 32398 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:59.379755 32376 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:44:59.379850 32376 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/minicluster-data/master-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/minicluster-data/master-0/wal
uuid: "82b3c1d7c0f243da8944dce9e56a77a2"
format_stamp: "Formatted at 2026-08-08 14:44:59 on dist-test-slave-42z9"
server_key: "993d0b2eff03b437d0b6dbe72a338e04"
server_key_iv: "20ebbe8b3c73868f1c46d630c402955b"
server_key_version: "encryptionkey@0"
I20260808 14:44:59.379918 32376 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:44:59.403496 32376 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:44:59.405727 32376 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:44:59.405874 32376 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:44:59.409814 32376 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.190:38907
I20260808 14:44:59.409871 32470 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.190:38907 every 8 connection(s)
I20260808 14:44:59.410216 32376 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
I20260808 14:44:59.411110 32471 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:44:59.413627 32471 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 82b3c1d7c0f243da8944dce9e56a77a2: Bootstrap starting.
I20260808 14:44:59.414258 32471 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 82b3c1d7c0f243da8944dce9e56a77a2: Neither blocks nor log segments found. Creating new log.
I20260808 14:44:59.414552 32471 log.cc:824] T 00000000000000000000000000000000 P 82b3c1d7c0f243da8944dce9e56a77a2: Log is configured to *not* fsync() on all Append() calls
I20260808 14:44:59.415367 32471 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 82b3c1d7c0f243da8944dce9e56a77a2: No bootstrap required, opened a new log
I20260808 14:44:59.417025 32471 raft_consensus.cc:348] T 00000000000000000000000000000000 P 82b3c1d7c0f243da8944dce9e56a77a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82b3c1d7c0f243da8944dce9e56a77a2" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 38907 } }
I20260808 14:44:59.417176 32471 raft_consensus.cc:374] T 00000000000000000000000000000000 P 82b3c1d7c0f243da8944dce9e56a77a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:44:59.417197 32471 raft_consensus.cc:729] T 00000000000000000000000000000000 P 82b3c1d7c0f243da8944dce9e56a77a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82b3c1d7c0f243da8944dce9e56a77a2, State: Initialized, Role: FOLLOWER
I20260808 14:44:59.417236 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 32376
I20260808 14:44:59.417323 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/minicluster-data/master-0/wal/instance
I20260808 14:44:59.417366 32471 consensus_queue.cc:260] T 00000000000000000000000000000000 P 82b3c1d7c0f243da8944dce9e56a77a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82b3c1d7c0f243da8944dce9e56a77a2" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 38907 } }
I20260808 14:44:59.417472 32471 raft_consensus.cc:388] T 00000000000000000000000000000000 P 82b3c1d7c0f243da8944dce9e56a77a2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:44:59.417505 31578 external_mini_cluster.cc:1428] Setting key b3172104d5299e1dfa9cf1cd0019a42e
I20260808 14:44:59.417516 32471 raft_consensus.cc:482] T 00000000000000000000000000000000 P 82b3c1d7c0f243da8944dce9e56a77a2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:44:59.417559 32471 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 82b3c1d7c0f243da8944dce9e56a77a2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:44:59.418883 32471 raft_consensus.cc:504] T 00000000000000000000000000000000 P 82b3c1d7c0f243da8944dce9e56a77a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82b3c1d7c0f243da8944dce9e56a77a2" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 38907 } }
I20260808 14:44:59.419003 32471 leader_election.cc:302] T 00000000000000000000000000000000 P 82b3c1d7c0f243da8944dce9e56a77a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 82b3c1d7c0f243da8944dce9e56a77a2; no voters:
I20260808 14:44:59.419163 32471 leader_election.cc:288] T 00000000000000000000000000000000 P 82b3c1d7c0f243da8944dce9e56a77a2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:44:59.419210 32476 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 82b3c1d7c0f243da8944dce9e56a77a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:44:59.419386 32476 raft_consensus.cc:686] T 00000000000000000000000000000000 P 82b3c1d7c0f243da8944dce9e56a77a2 [term 1 LEADER]: Becoming Leader. State: Replica: 82b3c1d7c0f243da8944dce9e56a77a2, State: Running, Role: LEADER
I20260808 14:44:59.419449 32471 sys_catalog.cc:564] T 00000000000000000000000000000000 P 82b3c1d7c0f243da8944dce9e56a77a2 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:44:59.419483 32476 consensus_queue.cc:237] T 00000000000000000000000000000000 P 82b3c1d7c0f243da8944dce9e56a77a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82b3c1d7c0f243da8944dce9e56a77a2" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 38907 } }
I20260808 14:44:59.419828 32476 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82b3c1d7c0f243da8944dce9e56a77a2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 82b3c1d7c0f243da8944dce9e56a77a2. Latest consensus state: current_term: 1 leader_uuid: "82b3c1d7c0f243da8944dce9e56a77a2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82b3c1d7c0f243da8944dce9e56a77a2" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 38907 } } }
I20260808 14:44:59.419906 32476 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82b3c1d7c0f243da8944dce9e56a77a2 [sys.catalog]: This master's current role is: LEADER
I20260808 14:44:59.419941 32479 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82b3c1d7c0f243da8944dce9e56a77a2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "82b3c1d7c0f243da8944dce9e56a77a2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82b3c1d7c0f243da8944dce9e56a77a2" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 38907 } } }
I20260808 14:44:59.420043 32479 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82b3c1d7c0f243da8944dce9e56a77a2 [sys.catalog]: This master's current role is: LEADER
I20260808 14:44:59.420131 32486 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:44:59.420624 32486 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:44:59.422261 32486 catalog_manager.cc:1347] Generated new cluster ID: ebce13527ed1450bbc15386c24c03b4e
I20260808 14:44:59.422307 32486 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 14:44:59 dist-test-slave-42z9 krb5kdc[32358](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200299, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:44:59.429555 32475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:59.418013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46652 (local address 127.30.214.190:38907)
0808 14:44:59.418305 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:59.418316 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:59.418355 (+ 39us) server_negotiation.cc:407] Connection header received
0808 14:44:59.418496 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:59.418505 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:59.418567 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:59.418716 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:59.419329 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:59.420756 (+ 1427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:59.421777 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:59.422363 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:59.422479 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:59.425125 (+ 2646us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:59.425129 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:59.425130 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:44:59.425143 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:59.427626 (+ 2483us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:59.427996 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:59.427999 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:59.428000 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:59.428128 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:59.428304 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:59.428304 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:59.428305 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:59.428591 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:59.429090 (+ 499us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:59.429159 (+ 69us) server_negotiation.cc:299] Negotiation successful
0808 14:44:59.429297 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":235,"thread_start_us":181,"threads_started":1}
I20260808 14:44:59.451047 32486 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:44:59.451588 32486 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:44:59.458024 32486 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 82b3c1d7c0f243da8944dce9e56a77a2: Generated new TSK 0
I20260808 14:44:59.458233 32486 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.214.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab.
Entry for principal kudu/127.30.214.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab.
I20260808 14:44:59.488854 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.129:0
--local_ip_for_outbound_sockets=127.30.214.129
--webserver_interface=127.30.214.129
--webserver_port=0
--tserver_master_addrs=127.30.214.190:38907
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab
--principal=kudu/127.30.214.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:42937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:44:59.574754 32511 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:44:59.574970 32511 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:44:59.574994 32511 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:44:59.576180 32511 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:44:59.576222 32511 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:44:59.576249 32511 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.129
I20260808 14:44:59.577803 32511 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:42937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab
--principal=kudu/127.30.214.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.214.129
--webserver_port=0
--tserver_master_addrs=127.30.214.190:38907
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32511
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.129
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:44:59.578035 32511 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:44:59.578286 32511 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:44:59.583328 32518 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:59.583382 32517 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:59.583343 32521 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:44:59.583479 32511 server_base.cc:1034] running on GCE node
I20260808 14:44:59.583776 32511 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:44:59.584033 32511 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:44:59.585181 32511 hybrid_clock.cc:648] HybridClock initialized: now 1786200299585165 us; error 32 us; skew 500 ppm
Aug 08 14:44:59 dist-test-slave-42z9 krb5kdc[32358](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200299, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:44:59.587656 32511 init.cc:377] Logged in from keytab as kudu/127.30.214.129@KRBTEST.COM (short username kudu)
I20260808 14:44:59.588112 32511 webserver.cc:460] Webserver started at http://127.30.214.129:46377/ using document root <none> and password file <none>
I20260808 14:44:59.588315 32511 fs_manager.cc:359] Metadata directory not provided
I20260808 14:44:59.588362 32511 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:44:59.588490 32511 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:44:59.589574 32511 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/minicluster-data/ts-0/data/instance:
uuid: "bf84464f6714419593450b7989a6a985"
format_stamp: "Formatted at 2026-08-08 14:44:59 on dist-test-slave-42z9"
server_key: "79d8ed6eabb60cb850f3ac73a0e345dc"
server_key_iv: "086feac7504dfc92e5303efabb41dfa6"
server_key_version: "encryptionkey@0"
I20260808 14:44:59.589910 32511 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/minicluster-data/ts-0/wal/instance:
uuid: "bf84464f6714419593450b7989a6a985"
format_stamp: "Formatted at 2026-08-08 14:44:59 on dist-test-slave-42z9"
server_key: "79d8ed6eabb60cb850f3ac73a0e345dc"
server_key_iv: "086feac7504dfc92e5303efabb41dfa6"
server_key_version: "encryptionkey@0"
I20260808 14:44:59.591217 32511 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:44:59.591893 32533 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:59.592062 32511 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:59.592147 32511 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/minicluster-data/ts-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/minicluster-data/ts-0/wal
uuid: "bf84464f6714419593450b7989a6a985"
format_stamp: "Formatted at 2026-08-08 14:44:59 on dist-test-slave-42z9"
server_key: "79d8ed6eabb60cb850f3ac73a0e345dc"
server_key_iv: "086feac7504dfc92e5303efabb41dfa6"
server_key_version: "encryptionkey@0"
I20260808 14:44:59.592211 32511 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:44:59.603040 32511 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:44:59.604763 32511 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:44:59.604902 32511 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:44:59.605131 32511 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:44:59.605460 32511 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:44:59.605495 32511 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:59.605526 32511 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:44:59.605543 32511 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:59.611187 32511 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.129:44375
I20260808 14:44:59.611249 32704 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.129:44375 every 8 connection(s)
I20260808 14:44:59.611547 32511 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
I20260808 14:44:59.614744 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 32511
I20260808 14:44:59.614840 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/minicluster-data/ts-0/wal/instance
I20260808 14:44:59.614997 31578 external_mini_cluster.cc:1428] Setting key 53f2c744819c26927ad986598ac96ff6
Aug 08 14:44:59 dist-test-slave-42z9 krb5kdc[32358](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200299, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.129@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:44:59.621551 32475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:59.612246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.129:51417 (local address 127.30.214.190:38907)
0808 14:44:59.612308 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:59.612310 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:59.612497 (+ 187us) server_negotiation.cc:407] Connection header received
0808 14:44:59.613625 (+ 1128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:59.613626 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:59.613642 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:59.613700 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:59.614298 (+ 598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:59.614935 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:59.616033 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:59.616302 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:59.616366 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:59.618536 (+ 2170us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:59.618538 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:59.618538 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:44:59.618547 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:59.620056 (+ 1509us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:59.620559 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:59.620561 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:59.620561 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:59.620623 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:59.620860 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:59.620861 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:59.620862 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:59.621003 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:59.621091 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:59.621312 (+ 221us) server_negotiation.cc:299] Negotiation successful
0808 14:44:59.621401 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 14:44:59.621695 32710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:59.612201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:38907 (local address 127.30.214.129:51417)
0808 14:44:59.612380 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:59.612418 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 14:44:59.613467 (+ 1049us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:44:59.613769 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:44:59.613773 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:44:59.614033 (+ 260us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:44:59.614229 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:59.614233 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:59.615017 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:59.615018 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:59.615955 (+ 937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:59.615958 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:59.616378 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:59.616378 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:59.616471 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:59.616953 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:44:59.616962 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:44:59.618436 (+ 1474us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:44:59.620151 (+ 1715us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:44:59.620158 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:44:59.620160 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:44:59.620488 (+ 328us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:44:59.620700 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:44:59.620701 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:44:59.620701 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:44:59.620806 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:44:59.621078 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:44:59.621081 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:44:59.621193 (+ 112us) client_negotiation.cc:769] Sending connection context
0808 14:44:59.621271 (+ 78us) client_negotiation.cc:240] Negotiation successful
0808 14:44:59.621394 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":91,"threads_started":1}
I20260808 14:44:59.622218 32708 heartbeater.cc:347] Connected to a master server at 127.30.214.190:38907
I20260808 14:44:59.622308 32708 heartbeater.cc:464] Registering TS with master...
I20260808 14:44:59.622478 32708 heartbeater.cc:511] Master 127.30.214.190:38907 requested a full tablet report, sending...
I20260808 14:44:59.622982 32422 ts_manager.cc:194] Registered new tserver with Master: bf84464f6714419593450b7989a6a985 (127.30.214.129:44375)
I20260808 14:44:59.623595 32422 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.214.129@KRBTEST.COM'} at 127.30.214.129:51417
WARNING: no policy specified for kudu/127.30.214.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab.
Entry for principal kudu/127.30.214.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab.
I20260808 14:44:59.639734 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.130:0
--local_ip_for_outbound_sockets=127.30.214.130
--webserver_interface=127.30.214.130
--webserver_port=0
--tserver_master_addrs=127.30.214.190:38907
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab
--principal=kudu/127.30.214.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:42937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:44:59.723281 32715 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:44:59.723496 32715 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:44:59.723521 32715 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:44:59.724663 32715 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:44:59.724704 32715 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:44:59.724730 32715 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.130
I20260808 14:44:59.726302 32715 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:42937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab
--principal=kudu/127.30.214.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.214.130
--webserver_port=0
--tserver_master_addrs=127.30.214.190:38907
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32715
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.130
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:44:59.726548 32715 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:44:59.726773 32715 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:44:59.731665 32721 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:59.731665 32727 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:59.731673 32722 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:44:59.731891 32715 server_base.cc:1034] running on GCE node
I20260808 14:44:59.732084 32715 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:44:59.732285 32715 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:44:59.733423 32715 hybrid_clock.cc:648] HybridClock initialized: now 1786200299733408 us; error 27 us; skew 500 ppm
Aug 08 14:44:59 dist-test-slave-42z9 krb5kdc[32358](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200299, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:44:59.735930 32715 init.cc:377] Logged in from keytab as kudu/127.30.214.130@KRBTEST.COM (short username kudu)
I20260808 14:44:59.736356 32715 webserver.cc:460] Webserver started at http://127.30.214.130:42751/ using document root <none> and password file <none>
I20260808 14:44:59.736579 32715 fs_manager.cc:359] Metadata directory not provided
I20260808 14:44:59.736624 32715 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:44:59.736745 32715 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:44:59.737840 32715 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/minicluster-data/ts-1/data/instance:
uuid: "27568bd2175e46b9adc0e28407e5adbc"
format_stamp: "Formatted at 2026-08-08 14:44:59 on dist-test-slave-42z9"
server_key: "a5566622dda67422ed33eb80e5ea5f82"
server_key_iv: "c4b569764a67060151557d9ae26d0b5e"
server_key_version: "encryptionkey@0"
I20260808 14:44:59.738242 32715 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/minicluster-data/ts-1/wal/instance:
uuid: "27568bd2175e46b9adc0e28407e5adbc"
format_stamp: "Formatted at 2026-08-08 14:44:59 on dist-test-slave-42z9"
server_key: "a5566622dda67422ed33eb80e5ea5f82"
server_key_iv: "c4b569764a67060151557d9ae26d0b5e"
server_key_version: "encryptionkey@0"
I20260808 14:44:59.739524 32715 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260808 14:44:59.740201 32738 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:59.740358 32715 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:59.740437 32715 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/minicluster-data/ts-1/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/minicluster-data/ts-1/wal
uuid: "27568bd2175e46b9adc0e28407e5adbc"
format_stamp: "Formatted at 2026-08-08 14:44:59 on dist-test-slave-42z9"
server_key: "a5566622dda67422ed33eb80e5ea5f82"
server_key_iv: "c4b569764a67060151557d9ae26d0b5e"
server_key_version: "encryptionkey@0"
I20260808 14:44:59.740504 32715 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:44:59.750524 32715 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:44:59.752607 32715 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:44:59.752727 32715 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:44:59.752959 32715 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:44:59.753274 32715 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:44:59.753307 32715 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:59.753330 32715 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:44:59.753353 32715 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:59.759423 32715 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.130:39765
I20260808 14:44:59.759469 449 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.130:39765 every 8 connection(s)
I20260808 14:44:59.759773 32715 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
I20260808 14:44:59.765283 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 32715
I20260808 14:44:59.765370 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/minicluster-data/ts-1/wal/instance
I20260808 14:44:59.765556 31578 external_mini_cluster.cc:1428] Setting key 8f7c4c08f78c5e08c719c1aacfc075a8
Aug 08 14:44:59 dist-test-slave-42z9 krb5kdc[32358](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200299, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.130@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:44:59.769989 32475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:59.760489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.130:34701 (local address 127.30.214.190:38907)
0808 14:44:59.760543 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:59.760545 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:59.760775 (+ 230us) server_negotiation.cc:407] Connection header received
0808 14:44:59.761721 (+ 946us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:59.761722 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:59.761735 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:59.761797 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:59.762417 (+ 620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:59.762919 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:59.764322 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:59.764516 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:59.764566 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:59.766931 (+ 2365us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:59.766933 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:59.766934 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:44:59.766942 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:59.768257 (+ 1315us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:59.768836 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:59.768837 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:59.768837 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:59.768902 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:59.769239 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:59.769240 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:59.769241 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:59.769375 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:59.769484 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:59.769797 (+ 313us) server_negotiation.cc:299] Negotiation successful
0808 14:44:59.769905 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 14:44:59.770077 455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:59.760451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:38907 (local address 127.30.214.130:34701)
0808 14:44:59.760623 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:59.760667 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 14:44:59.761625 (+ 958us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:44:59.761861 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:44:59.761864 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:44:59.762121 (+ 257us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:44:59.762324 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:59.762328 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:59.763054 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:59.763055 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:59.764245 (+ 1190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:59.764248 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:59.764579 (+ 331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:59.764580 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:59.764689 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:59.765186 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:44:59.765195 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:44:59.766817 (+ 1622us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:44:59.768340 (+ 1523us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:44:59.768349 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:44:59.768351 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:44:59.768663 (+ 312us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:44:59.768974 (+ 311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:44:59.768975 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:44:59.768976 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:44:59.769146 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:44:59.769500 (+ 354us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:44:59.769507 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:44:59.769649 (+ 142us) client_negotiation.cc:769] Sending connection context
0808 14:44:59.769752 (+ 103us) client_negotiation.cc:240] Negotiation successful
0808 14:44:59.769892 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":79,"threads_started":1}
I20260808 14:44:59.770545 451 heartbeater.cc:347] Connected to a master server at 127.30.214.190:38907
I20260808 14:44:59.770642 451 heartbeater.cc:464] Registering TS with master...
I20260808 14:44:59.770817 451 heartbeater.cc:511] Master 127.30.214.190:38907 requested a full tablet report, sending...
I20260808 14:44:59.771251 32422 ts_manager.cc:194] Registered new tserver with Master: 27568bd2175e46b9adc0e28407e5adbc (127.30.214.130:39765)
I20260808 14:44:59.771778 32422 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.214.130@KRBTEST.COM'} at 127.30.214.130:34701
WARNING: no policy specified for kudu/127.30.214.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab.
Entry for principal kudu/127.30.214.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab.
I20260808 14:44:59.790493 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.131:0
--local_ip_for_outbound_sockets=127.30.214.131
--webserver_interface=127.30.214.131
--webserver_port=0
--tserver_master_addrs=127.30.214.190:38907
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab
--principal=kudu/127.30.214.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:42937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:44:59.872728 463 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:44:59.872937 463 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:44:59.872960 463 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:44:59.874119 463 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:44:59.874155 463 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:44:59.874181 463 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.131
I20260808 14:44:59.875681 463 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:42937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab
--principal=kudu/127.30.214.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.214.131
--webserver_port=0
--tserver_master_addrs=127.30.214.190:38907
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.463
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.131
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:44:59.875885 463 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:44:59.876077 463 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 14:44:59.881121 463 server_base.cc:1034] running on GCE node
W20260808 14:44:59.881181 476 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:59.881093 473 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:44:59.881079 471 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:44:59.881587 463 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:44:59.881842 463 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:44:59.882978 463 hybrid_clock.cc:648] HybridClock initialized: now 1786200299882967 us; error 30 us; skew 500 ppm
Aug 08 14:44:59 dist-test-slave-42z9 krb5kdc[32358](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200299, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:44:59.885514 463 init.cc:377] Logged in from keytab as kudu/127.30.214.131@KRBTEST.COM (short username kudu)
I20260808 14:44:59.885985 463 webserver.cc:460] Webserver started at http://127.30.214.131:42617/ using document root <none> and password file <none>
I20260808 14:44:59.886214 463 fs_manager.cc:359] Metadata directory not provided
I20260808 14:44:59.886264 463 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:44:59.886394 463 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:44:59.887420 463 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/minicluster-data/ts-2/data/instance:
uuid: "4d720ef6623446bdad83bcbdfad7df63"
format_stamp: "Formatted at 2026-08-08 14:44:59 on dist-test-slave-42z9"
server_key: "13dcd3fba67045f5b1d805b3f2be9456"
server_key_iv: "a8a2fd0b344aefafe28942f26b70686e"
server_key_version: "encryptionkey@0"
I20260808 14:44:59.887753 463 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/minicluster-data/ts-2/wal/instance:
uuid: "4d720ef6623446bdad83bcbdfad7df63"
format_stamp: "Formatted at 2026-08-08 14:44:59 on dist-test-slave-42z9"
server_key: "13dcd3fba67045f5b1d805b3f2be9456"
server_key_iv: "a8a2fd0b344aefafe28942f26b70686e"
server_key_version: "encryptionkey@0"
I20260808 14:44:59.889065 463 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 14:44:59.889822 485 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:59.889966 463 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:59.890050 463 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/minicluster-data/ts-2/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/minicluster-data/ts-2/wal
uuid: "4d720ef6623446bdad83bcbdfad7df63"
format_stamp: "Formatted at 2026-08-08 14:44:59 on dist-test-slave-42z9"
server_key: "13dcd3fba67045f5b1d805b3f2be9456"
server_key_iv: "a8a2fd0b344aefafe28942f26b70686e"
server_key_version: "encryptionkey@0"
I20260808 14:44:59.890115 463 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:44:59.904841 463 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:44:59.906677 463 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:44:59.906838 463 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:44:59.907065 463 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:44:59.907370 463 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:44:59.907405 463 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:59.907433 463 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:44:59.907456 463 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:44:59.913659 463 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.131:37841
I20260808 14:44:59.913713 667 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.131:37841 every 8 connection(s)
I20260808 14:44:59.914032 463 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
I20260808 14:44:59.915889 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 463
I20260808 14:44:59.915992 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786200295877777-31578-0/minicluster-data/ts-2/wal/instance
I20260808 14:44:59.916169 31578 external_mini_cluster.cc:1428] Setting key 39f6f9d18c5a6fdf9bf22f99d894be7c
Aug 08 14:44:59 dist-test-slave-42z9 krb5kdc[32358](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200299, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.131@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:44:59.923240 32475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:59.914771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:49377 (local address 127.30.214.190:38907)
0808 14:44:59.914826 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:59.914828 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:59.915041 (+ 213us) server_negotiation.cc:407] Connection header received
0808 14:44:59.916049 (+ 1008us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:59.916051 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:59.916063 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:59.916119 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:59.916936 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:59.917486 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:59.918458 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:59.918640 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:59.918686 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:59.920980 (+ 2294us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:59.920981 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:59.920981 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:44:59.920989 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:59.922187 (+ 1198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:59.922549 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:59.922549 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:59.922550 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:59.922596 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:59.922770 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:59.922771 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:59.922771 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:59.922865 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:59.922910 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:59.923116 (+ 206us) server_negotiation.cc:299] Negotiation successful
0808 14:44:59.923176 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 14:44:59.923424 670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:59.914736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:38907 (local address 127.30.214.131:49377)
0808 14:44:59.914919 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:59.914963 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 14:44:59.915944 (+ 981us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:44:59.916212 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:44:59.916216 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:44:59.916578 (+ 362us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:44:59.916842 (+ 264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:59.916848 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:59.917568 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:59.917569 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:59.918396 (+ 827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:59.918398 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:59.918754 (+ 356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:59.918755 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:59.918892 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:59.919442 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:44:59.919452 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:44:59.920886 (+ 1434us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:44:59.922252 (+ 1366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:44:59.922259 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:44:59.922261 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:44:59.922491 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:44:59.922640 (+ 149us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:44:59.922640 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:44:59.922640 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:44:59.922730 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:44:59.922906 (+ 176us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:44:59.922909 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:44:59.923024 (+ 115us) client_negotiation.cc:769] Sending connection context
0808 14:44:59.923099 (+ 75us) client_negotiation.cc:240] Negotiation successful
0808 14:44:59.923219 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":88,"threads_started":1}
I20260808 14:44:59.923879 668 heartbeater.cc:347] Connected to a master server at 127.30.214.190:38907
I20260808 14:44:59.923993 668 heartbeater.cc:464] Registering TS with master...
I20260808 14:44:59.924171 668 heartbeater.cc:511] Master 127.30.214.190:38907 requested a full tablet report, sending...
I20260808 14:44:59.924566 32422 ts_manager.cc:194] Registered new tserver with Master: 4d720ef6623446bdad83bcbdfad7df63 (127.30.214.131:37841)
I20260808 14:44:59.924926 32422 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.214.131@KRBTEST.COM'} at 127.30.214.131:49377
I20260808 14:44:59.927714 31578 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:44:59.935000 32475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:59.929739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48306 (local address 127.30.214.190:38907)
0808 14:44:59.929780 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:59.929781 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:59.929832 (+ 51us) server_negotiation.cc:407] Connection header received
0808 14:44:59.929879 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:59.929880 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:59.929893 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:59.929943 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:44:59.930407 (+ 464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:59.930857 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:59.931489 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:59.931655 (+ 166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:59.931695 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:59.932711 (+ 1016us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:44:59.932712 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:44:59.932713 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:44:59.932719 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:44:59.934036 (+ 1317us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:59.934368 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:59.934369 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:59.934369 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:59.934429 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:44:59.934575 (+ 146us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:44:59.934576 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:44:59.934576 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:44:59.934723 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:44:59.934794 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:59.934868 (+ 74us) server_negotiation.cc:299] Negotiation successful
0808 14:44:59.934938 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 14:44:59.937587 32422 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48306:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:44:59.939339 32422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:44:59.946179 686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:59.942326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52834 (local address 127.30.214.131:37841)
0808 14:44:59.942678 (+ 352us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:59.942682 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:59.942691 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:44:59.942725 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:59.942727 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:59.942742 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:59.942814 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:44:59.942909 (+ 95us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:59.944063 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:59.945053 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:59.945785 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:59.945866 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:59.945934 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:59.946055 (+ 121us) server_negotiation.cc:299] Negotiation successful
0808 14:44:59.946097 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":319,"thread_start_us":99,"threads_started":1}
I20260808 14:44:59.946165 684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:59.942143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.131:37841 (local address 127.0.0.1:52834)
0808 14:44:59.942326 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:59.942336 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:44:59.942380 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:44:59.942814 (+ 434us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:44:59.942814 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:44:59.942816 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:44:59.942856 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:59.942858 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:59.944153 (+ 1295us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:59.944154 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:59.944970 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:59.944973 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:59.945873 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:59.945874 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:59.945950 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:59.945964 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 14:44:59.946033 (+ 69us) client_negotiation.cc:240] Negotiation successful
0808 14:44:59.946088 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":53,"threads_started":1}
I20260808 14:44:59.946303 685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:59.942136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38104 (local address 127.30.214.129:44375)
0808 14:44:59.942303 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:59.942308 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:59.942370 (+ 62us) server_negotiation.cc:407] Connection header received
0808 14:44:59.942459 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:59.942461 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:59.942477 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:59.942552 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:44:59.942770 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:59.943641 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:59.945172 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:59.945873 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:59.945931 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:59.945977 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:59.946186 (+ 209us) server_negotiation.cc:299] Negotiation successful
0808 14:44:59.946231 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":84,"threads_started":1}
I20260808 14:44:59.946453 682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:59.941933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.130:39765 (local address 127.0.0.1:48568)
0808 14:44:59.942092 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:59.942132 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 14:44:59.942194 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:44:59.942653 (+ 459us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:44:59.942654 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:44:59.942656 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:44:59.942713 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:59.942714 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:59.944060 (+ 1346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:59.944061 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:59.945123 (+ 1062us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:59.945125 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:59.946012 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:59.946013 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:59.946089 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:59.946093 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:44:59.946136 (+ 43us) client_negotiation.cc:240] Negotiation successful
0808 14:44:59.946168 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"mutex_wait_us":12,"thread_start_us":63,"threads_started":1}
I20260808 14:44:59.946727 683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:59.942065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48568 (local address 127.30.214.130:39765)
0808 14:44:59.942496 (+ 431us) server_negotiation.cc:206] Beginning negotiation
0808 14:44:59.942500 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:44:59.942508 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:44:59.942542 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:44:59.942544 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:44:59.942560 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:44:59.942639 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:44:59.942801 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:59.943955 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:59.945204 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:44:59.945862 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:44:59.945927 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:59.945980 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 14:44:59.946209 (+ 229us) server_negotiation.cc:299] Negotiation successful
0808 14:44:59.946652 (+ 443us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":397,"thread_start_us":93,"threads_started":1}
I20260808 14:44:59.946977 560 tablet_service.cc:1467] Processing CreateTablet for tablet be584da8c28f47e08412e3d341d9544f (DEFAULT_TABLE table=test-table [id=4803ebaee7004968a576555e8d02fe9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:44:59.947321 560 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet be584da8c28f47e08412e3d341d9544f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:44:59.947327 348 tablet_service.cc:1467] Processing CreateTablet for tablet be584da8c28f47e08412e3d341d9544f (DEFAULT_TABLE table=test-table [id=4803ebaee7004968a576555e8d02fe9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:44:59.947638 348 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet be584da8c28f47e08412e3d341d9544f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:44:59.950186 687 tablet_bootstrap.cc:492] T be584da8c28f47e08412e3d341d9544f P 4d720ef6623446bdad83bcbdfad7df63: Bootstrap starting.
I20260808 14:44:59.950186 688 tablet_bootstrap.cc:492] T be584da8c28f47e08412e3d341d9544f P 27568bd2175e46b9adc0e28407e5adbc: Bootstrap starting.
I20260808 14:44:59.950511 679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:44:59.941934 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.129:44375 (local address 127.0.0.1:38104)
0808 14:44:59.942308 (+ 374us) negotiation.cc:107] Waiting for socket to connect
0808 14:44:59.942319 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:44:59.942390 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:44:59.942585 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:44:59.942588 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:44:59.942590 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:44:59.942662 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:59.942664 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:59.943730 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:59.943731 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:59.945079 (+ 1348us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:44:59.945083 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:44:59.946011 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:44:59.946012 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:44:59.946093 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:44:59.946097 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:44:59.946429 (+ 332us) client_negotiation.cc:240] Negotiation successful
0808 14:44:59.950434 (+ 4005us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":359,"mutex_wait_us":3,"thread_start_us":56,"threads_started":1}
I20260808 14:44:59.950891 688 tablet_bootstrap.cc:654] T be584da8c28f47e08412e3d341d9544f P 27568bd2175e46b9adc0e28407e5adbc: Neither blocks nor log segments found. Creating new log.
I20260808 14:44:59.951027 687 tablet_bootstrap.cc:654] T be584da8c28f47e08412e3d341d9544f P 4d720ef6623446bdad83bcbdfad7df63: Neither blocks nor log segments found. Creating new log.
I20260808 14:44:59.951229 32607 tablet_service.cc:1467] Processing CreateTablet for tablet be584da8c28f47e08412e3d341d9544f (DEFAULT_TABLE table=test-table [id=4803ebaee7004968a576555e8d02fe9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:44:59.951614 32607 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet be584da8c28f47e08412e3d341d9544f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:44:59.951678 687 log.cc:824] T be584da8c28f47e08412e3d341d9544f P 4d720ef6623446bdad83bcbdfad7df63: Log is configured to *not* fsync() on all Append() calls
I20260808 14:44:59.951695 688 log.cc:824] T be584da8c28f47e08412e3d341d9544f P 27568bd2175e46b9adc0e28407e5adbc: Log is configured to *not* fsync() on all Append() calls
I20260808 14:44:59.952469 687 tablet_bootstrap.cc:492] T be584da8c28f47e08412e3d341d9544f P 4d720ef6623446bdad83bcbdfad7df63: No bootstrap required, opened a new log
I20260808 14:44:59.952531 687 ts_tablet_manager.cc:1397] T be584da8c28f47e08412e3d341d9544f P 4d720ef6623446bdad83bcbdfad7df63: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:44:59.952705 688 tablet_bootstrap.cc:492] T be584da8c28f47e08412e3d341d9544f P 27568bd2175e46b9adc0e28407e5adbc: No bootstrap required, opened a new log
I20260808 14:44:59.952783 688 ts_tablet_manager.cc:1397] T be584da8c28f47e08412e3d341d9544f P 27568bd2175e46b9adc0e28407e5adbc: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 14:44:59.954025 687 raft_consensus.cc:348] T be584da8c28f47e08412e3d341d9544f P 4d720ef6623446bdad83bcbdfad7df63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf84464f6714419593450b7989a6a985" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 44375 } } peers { permanent_uuid: "27568bd2175e46b9adc0e28407e5adbc" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 39765 } } peers { permanent_uuid: "4d720ef6623446bdad83bcbdfad7df63" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 37841 } }
I20260808 14:44:59.954174 687 raft_consensus.cc:374] T be584da8c28f47e08412e3d341d9544f P 4d720ef6623446bdad83bcbdfad7df63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:44:59.954210 687 raft_consensus.cc:729] T be584da8c28f47e08412e3d341d9544f P 4d720ef6623446bdad83bcbdfad7df63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d720ef6623446bdad83bcbdfad7df63, State: Initialized, Role: FOLLOWER
I20260808 14:44:59.954344 687 consensus_queue.cc:260] T be584da8c28f47e08412e3d341d9544f P 4d720ef6623446bdad83bcbdfad7df63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf84464f6714419593450b7989a6a985" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 44375 } } peers { permanent_uuid: "27568bd2175e46b9adc0e28407e5adbc" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 39765 } } peers { permanent_uuid: "4d720ef6623446bdad83bcbdfad7df63" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 37841 } }
I20260808 14:44:59.954639 687 ts_tablet_manager.cc:1428] T be584da8c28f47e08412e3d341d9544f P 4d720ef6623446bdad83bcbdfad7df63: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260808 14:44:59.954808 668 heartbeater.cc:503] Master 127.30.214.190:38907 was elected leader, sending a full tablet report...
I20260808 14:44:59.954746 688 raft_consensus.cc:348] T be584da8c28f47e08412e3d341d9544f P 27568bd2175e46b9adc0e28407e5adbc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf84464f6714419593450b7989a6a985" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 44375 } } peers { permanent_uuid: "27568bd2175e46b9adc0e28407e5adbc" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 39765 } } peers { permanent_uuid: "4d720ef6623446bdad83bcbdfad7df63" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 37841 } }
I20260808 14:44:59.954923 688 raft_consensus.cc:374] T be584da8c28f47e08412e3d341d9544f P 27568bd2175e46b9adc0e28407e5adbc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:44:59.954967 688 raft_consensus.cc:729] T be584da8c28f47e08412e3d341d9544f P 27568bd2175e46b9adc0e28407e5adbc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27568bd2175e46b9adc0e28407e5adbc, State: Initialized, Role: FOLLOWER
I20260808 14:44:59.955075 688 consensus_queue.cc:260] T be584da8c28f47e08412e3d341d9544f P 27568bd2175e46b9adc0e28407e5adbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf84464f6714419593450b7989a6a985" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 44375 } } peers { permanent_uuid: "27568bd2175e46b9adc0e28407e5adbc" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 39765 } } peers { permanent_uuid: "4d720ef6623446bdad83bcbdfad7df63" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 37841 } }
I20260808 14:44:59.955152 692 tablet_bootstrap.cc:492] T be584da8c28f47e08412e3d341d9544f P bf84464f6714419593450b7989a6a985: Bootstrap starting.
I20260808 14:44:59.955346 688 ts_tablet_manager.cc:1428] T be584da8c28f47e08412e3d341d9544f P 27568bd2175e46b9adc0e28407e5adbc: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 14:44:59.955488 451 heartbeater.cc:503] Master 127.30.214.190:38907 was elected leader, sending a full tablet report...
I20260808 14:44:59.955816 692 tablet_bootstrap.cc:654] T be584da8c28f47e08412e3d341d9544f P bf84464f6714419593450b7989a6a985: Neither blocks nor log segments found. Creating new log.
I20260808 14:44:59.956400 692 log.cc:824] T be584da8c28f47e08412e3d341d9544f P bf84464f6714419593450b7989a6a985: Log is configured to *not* fsync() on all Append() calls
I20260808 14:44:59.957046 692 tablet_bootstrap.cc:492] T be584da8c28f47e08412e3d341d9544f P bf84464f6714419593450b7989a6a985: No bootstrap required, opened a new log
I20260808 14:44:59.957108 692 ts_tablet_manager.cc:1397] T be584da8c28f47e08412e3d341d9544f P bf84464f6714419593450b7989a6a985: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:44:59.958544 692 raft_consensus.cc:348] T be584da8c28f47e08412e3d341d9544f P bf84464f6714419593450b7989a6a985 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf84464f6714419593450b7989a6a985" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 44375 } } peers { permanent_uuid: "27568bd2175e46b9adc0e28407e5adbc" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 39765 } } peers { permanent_uuid: "4d720ef6623446bdad83bcbdfad7df63" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 37841 } }
I20260808 14:44:59.958725 692 raft_consensus.cc:374] T be584da8c28f47e08412e3d341d9544f P bf84464f6714419593450b7989a6a985 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:44:59.958771 692 raft_consensus.cc:729] T be584da8c28f47e08412e3d341d9544f P bf84464f6714419593450b7989a6a985 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf84464f6714419593450b7989a6a985, State: Initialized, Role: FOLLOWER
I20260808 14:44:59.958858 692 consensus_queue.cc:260] T be584da8c28f47e08412e3d341d9544f P bf84464f6714419593450b7989a6a985 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf84464f6714419593450b7989a6a985" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 44375 } } peers { permanent_uuid: "27568bd2175e46b9adc0e28407e5adbc" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 39765 } } peers { permanent_uuid: "4d720ef6623446bdad83bcbdfad7df63" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 37841 } }
I20260808 14:44:59.959065 692 ts_tablet_manager.cc:1428] T be584da8c28f47e08412e3d341d9544f P bf84464f6714419593450b7989a6a985: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:44:59.959113 32708 heartbeater.cc:503] Master 127.30.214.190:38907 was elected leader, sending a full tablet report...
W20260808 14:45:00.010377 453 tablet.cc:2369] T be584da8c28f47e08412e3d341d9544f P 27568bd2175e46b9adc0e28407e5adbc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:45:00.038988 691 raft_consensus.cc:482] T be584da8c28f47e08412e3d341d9544f P 4d720ef6623446bdad83bcbdfad7df63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:45:00.039157 691 raft_consensus.cc:504] T be584da8c28f47e08412e3d341d9544f P 4d720ef6623446bdad83bcbdfad7df63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf84464f6714419593450b7989a6a985" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 44375 } } peers { permanent_uuid: "27568bd2175e46b9adc0e28407e5adbc" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 39765 } } peers { permanent_uuid: "4d720ef6623446bdad83bcbdfad7df63" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 37841 } }
I20260808 14:45:00.039783 691 leader_election.cc:288] T be584da8c28f47e08412e3d341d9544f P 4d720ef6623446bdad83bcbdfad7df63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bf84464f6714419593450b7989a6a985 (127.30.214.129:44375), 27568bd2175e46b9adc0e28407e5adbc (127.30.214.130:39765)
I20260808 14:45:00.042660 685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:00.040074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:32933 (local address 127.30.214.129:44375)
0808 14:45:00.040122 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:00.040124 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:00.040132 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:45:00.040161 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:00.040161 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:00.040172 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:00.040223 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:45:00.040376 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:00.040848 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:00.041940 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:00.042343 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:00.042409 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:00.042418 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:00.042556 (+ 138us) server_negotiation.cc:299] Negotiation successful
0808 14:45:00.042595 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 14:45:00.042685 683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:00.040142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:59823 (local address 127.30.214.130:39765)
0808 14:45:00.040198 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:00.040199 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:00.040300 (+ 101us) server_negotiation.cc:407] Connection header received
0808 14:45:00.040353 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:00.040355 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:00.040366 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:00.040412 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:45:00.040558 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:00.041047 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:00.042000 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:00.042370 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:00.042433 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:00.042442 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:00.042583 (+ 141us) server_negotiation.cc:299] Negotiation successful
0808 14:45:00.042617 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 14:45:00.042699 670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:00.039968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.129:44375 (local address 127.30.214.131:32933)
0808 14:45:00.040025 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:00.040037 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:00.040081 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:00.040238 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:00.040239 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:00.040241 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:45:00.040315 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:00.040316 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:00.040924 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:00.040925 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:00.041856 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:00.041859 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:00.042418 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:00.042419 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:00.042496 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:00.042500 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:45:00.042545 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 14:45:00.042587 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260808 14:45:00.042716 698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:00.040041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.130:39765 (local address 127.30.214.131:59823)
0808 14:45:00.040227 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:00.040237 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:00.040296 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:00.040416 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:00.040416 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:00.040418 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:45:00.040500 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:00.040501 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:00.041123 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:00.041124 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:00.041915 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:00.041917 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:00.042443 (+ 526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:00.042444 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:00.042524 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:00.042527 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:45:00.042572 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 14:45:00.042613 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":131,"threads_started":1}
I20260808 14:45:00.043167 381 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be584da8c28f47e08412e3d341d9544f" candidate_uuid: "4d720ef6623446bdad83bcbdfad7df63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27568bd2175e46b9adc0e28407e5adbc" is_pre_election: true
I20260808 14:45:00.043344 381 raft_consensus.cc:2454] T be584da8c28f47e08412e3d341d9544f P 27568bd2175e46b9adc0e28407e5adbc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d720ef6623446bdad83bcbdfad7df63 in term 0.
I20260808 14:45:00.043620 487 leader_election.cc:302] T be584da8c28f47e08412e3d341d9544f P 4d720ef6623446bdad83bcbdfad7df63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27568bd2175e46b9adc0e28407e5adbc, 4d720ef6623446bdad83bcbdfad7df63; no voters:
I20260808 14:45:00.043732 691 raft_consensus.cc:2781] T be584da8c28f47e08412e3d341d9544f P 4d720ef6623446bdad83bcbdfad7df63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:45:00.043766 691 raft_consensus.cc:482] T be584da8c28f47e08412e3d341d9544f P 4d720ef6623446bdad83bcbdfad7df63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:45:00.043780 691 raft_consensus.cc:3037] T be584da8c28f47e08412e3d341d9544f P 4d720ef6623446bdad83bcbdfad7df63 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:00.044473 691 raft_consensus.cc:504] T be584da8c28f47e08412e3d341d9544f P 4d720ef6623446bdad83bcbdfad7df63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf84464f6714419593450b7989a6a985" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 44375 } } peers { permanent_uuid: "27568bd2175e46b9adc0e28407e5adbc" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 39765 } } peers { permanent_uuid: "4d720ef6623446bdad83bcbdfad7df63" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 37841 } }
I20260808 14:45:00.044622 691 leader_election.cc:288] T be584da8c28f47e08412e3d341d9544f P 4d720ef6623446bdad83bcbdfad7df63 [CANDIDATE]: Term 1 election: Requested vote from peers bf84464f6714419593450b7989a6a985 (127.30.214.129:44375), 27568bd2175e46b9adc0e28407e5adbc (127.30.214.130:39765)
I20260808 14:45:00.044564 32632 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be584da8c28f47e08412e3d341d9544f" candidate_uuid: "4d720ef6623446bdad83bcbdfad7df63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf84464f6714419593450b7989a6a985" is_pre_election: true
I20260808 14:45:00.044715 32632 raft_consensus.cc:2454] T be584da8c28f47e08412e3d341d9544f P bf84464f6714419593450b7989a6a985 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d720ef6623446bdad83bcbdfad7df63 in term 0.
I20260808 14:45:00.044803 381 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be584da8c28f47e08412e3d341d9544f" candidate_uuid: "4d720ef6623446bdad83bcbdfad7df63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27568bd2175e46b9adc0e28407e5adbc"
I20260808 14:45:00.044839 32632 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be584da8c28f47e08412e3d341d9544f" candidate_uuid: "4d720ef6623446bdad83bcbdfad7df63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf84464f6714419593450b7989a6a985"
I20260808 14:45:00.044891 32632 raft_consensus.cc:3037] T be584da8c28f47e08412e3d341d9544f P bf84464f6714419593450b7989a6a985 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:00.044894 381 raft_consensus.cc:3037] T be584da8c28f47e08412e3d341d9544f P 27568bd2175e46b9adc0e28407e5adbc [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:00.045692 381 raft_consensus.cc:2454] T be584da8c28f47e08412e3d341d9544f P 27568bd2175e46b9adc0e28407e5adbc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d720ef6623446bdad83bcbdfad7df63 in term 1.
I20260808 14:45:00.045706 32632 raft_consensus.cc:2454] T be584da8c28f47e08412e3d341d9544f P bf84464f6714419593450b7989a6a985 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d720ef6623446bdad83bcbdfad7df63 in term 1.
I20260808 14:45:00.045877 489 leader_election.cc:302] T be584da8c28f47e08412e3d341d9544f P 4d720ef6623446bdad83bcbdfad7df63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d720ef6623446bdad83bcbdfad7df63, bf84464f6714419593450b7989a6a985; no voters:
I20260808 14:45:00.045975 691 raft_consensus.cc:2781] T be584da8c28f47e08412e3d341d9544f P 4d720ef6623446bdad83bcbdfad7df63 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:45:00.046168 691 raft_consensus.cc:686] T be584da8c28f47e08412e3d341d9544f P 4d720ef6623446bdad83bcbdfad7df63 [term 1 LEADER]: Becoming Leader. State: Replica: 4d720ef6623446bdad83bcbdfad7df63, State: Running, Role: LEADER
I20260808 14:45:00.046258 691 consensus_queue.cc:237] T be584da8c28f47e08412e3d341d9544f P 4d720ef6623446bdad83bcbdfad7df63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf84464f6714419593450b7989a6a985" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 44375 } } peers { permanent_uuid: "27568bd2175e46b9adc0e28407e5adbc" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 39765 } } peers { permanent_uuid: "4d720ef6623446bdad83bcbdfad7df63" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 37841 } }
I20260808 14:45:00.047251 32422 catalog_manager.cc:5495] T be584da8c28f47e08412e3d341d9544f P 4d720ef6623446bdad83bcbdfad7df63 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d720ef6623446bdad83bcbdfad7df63 (127.30.214.131). New cstate: current_term: 1 leader_uuid: "4d720ef6623446bdad83bcbdfad7df63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf84464f6714419593450b7989a6a985" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 44375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27568bd2175e46b9adc0e28407e5adbc" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 39765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d720ef6623446bdad83bcbdfad7df63" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 37841 } health_report { overall_health: HEALTHY } } }
Aug 08 14:45:00 dist-test-slave-42z9 krb5kdc[32358](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200299, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.214.129@KRBTEST.COM
I20260808 14:45:00.066455 685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:00.058754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38110 (local address 127.30.214.129:44375)
0808 14:45:00.058812 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:00.058814 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:00.058876 (+ 62us) server_negotiation.cc:407] Connection header received
0808 14:45:00.058946 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:00.058947 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:00.058958 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:00.059007 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:00.059573 (+ 566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:00.060052 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:00.060744 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:00.060936 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:00.060992 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:00.063400 (+ 2408us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:00.063418 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:00.063418 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:00.063427 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:00.065255 (+ 1828us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:00.065678 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:00.065681 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:00.065682 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:00.065739 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:00.065908 (+ 169us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:00.065909 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:00.065909 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:00.066064 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:00.066208 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:00.066271 (+ 63us) server_negotiation.cc:299] Negotiation successful
0808 14:45:00.066356 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
Aug 08 14:45:00 dist-test-slave-42z9 krb5kdc[32358](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200300, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 14:45:00 dist-test-slave-42z9 krb5kdc[32358](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200300, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.30.214.129@KRBTEST.COM
I20260808 14:45:00.091480 685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:00.084370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38116 (local address 127.30.214.129:44375)
0808 14:45:00.084437 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:00.084439 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:00.084449 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:45:00.084475 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:00.084476 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:00.084486 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:00.084532 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:00.085107 (+ 575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:00.085631 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:00.086338 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:00.086532 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:00.086591 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:00.088786 (+ 2195us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:00.088788 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:00.088788 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:00.088797 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:00.090122 (+ 1325us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:00.090519 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:00.090521 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:00.090521 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:00.090587 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:00.090851 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:00.090852 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:00.090852 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:00.090977 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:00.091061 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:00.091312 (+ 251us) server_negotiation.cc:299] Negotiation successful
0808 14:45:00.091407 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
Aug 08 14:45:00 dist-test-slave-42z9 krb5kdc[32358](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200300, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 14:45:00 dist-test-slave-42z9 krb5kdc[32358](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200300, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.214.129@KRBTEST.COM
W20260808 14:45:00.112287 32709 tablet.cc:2369] T be584da8c28f47e08412e3d341d9544f P bf84464f6714419593450b7989a6a985: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:45:00.114382 685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:00.108009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38118 (local address 127.30.214.129:44375)
0808 14:45:00.108085 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:00.108087 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:00.108100 (+ 13us) server_negotiation.cc:407] Connection header received
0808 14:45:00.108167 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:00.108168 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:00.108178 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:00.108226 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:00.108729 (+ 503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:00.109201 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:00.109944 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:00.110123 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:00.110171 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:00.112201 (+ 2030us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:00.112203 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:00.112203 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:00.112212 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:00.113482 (+ 1270us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:00.113801 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:00.113801 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:00.113802 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:00.113853 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:00.114016 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:00.114017 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:00.114017 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:00.114111 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:00.114177 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:00.114255 (+ 78us) server_negotiation.cc:299] Negotiation successful
0808 14:45:00.114315 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
W20260808 14:45:00.115209 32575 tablet_service.cc:2908] Rejecting scan request for tablet be584da8c28f47e08412e3d341d9544f: Uninitialized: clean time has not yet been initialized
I20260808 14:45:00.116340 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 32511
I20260808 14:45:00.137362 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 32715
I20260808 14:45:00.150327 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 463
I20260808 14:45:00.172878 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 32376
2026-08-08T14:45:00Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2177 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:45:00 dist-test-slave-42z9 krb5kdc[727](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:45:00 dist-test-slave-42z9 krb5kdc[727](info): set up 2 sockets
Aug 08 14:45:00 dist-test-slave-42z9 krb5kdc[727](info): commencing operation
krb5kdc: starting...
W20260808 14:45:01.325384 31578 mini_kdc.cc:121] Time spent starting KDC: real 1.128s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Aug 08 14:45:01 dist-test-slave-42z9 krb5kdc[727](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200301, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:45:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:45:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.214.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab.
Entry for principal kudu/127.30.214.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab.
I20260808 14:45:01.448670 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:40329
--webserver_interface=127.30.214.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab
--principal=kudu/127.30.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:46001
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.214.190:40329
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:45:01.534453 749 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:45:01.534708 749 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:45:01.534741 749 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:45:01.536096 749 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:45:01.536171 749 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 14:45:01.536193 749 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:45:01.536213 749 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:45:01.536228 749 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:45:01.536244 749 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:45:01.537995 749 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:46001
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.214.190:40329
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab
--principal=kudu/127.30.214.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:40329
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.749
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:45:01.538278 749 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:45:01.538507 749 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:45:01.543682 758 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:01.543740 749 server_base.cc:1034] running on GCE node
W20260808 14:45:01.543687 756 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:01.543684 755 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:01.544176 749 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:45:01.544503 749 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:45:01.545651 749 hybrid_clock.cc:648] HybridClock initialized: now 1786200301545635 us; error 31 us; skew 500 ppm
Aug 08 14:45:01 dist-test-slave-42z9 krb5kdc[727](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200301, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:45:01.552105 749 init.cc:377] Logged in from keytab as kudu/127.30.214.190@KRBTEST.COM (short username kudu)
I20260808 14:45:01.552596 749 webserver.cc:460] Webserver started at http://127.30.214.190:43625/ using document root <none> and password file <none>
I20260808 14:45:01.552820 749 fs_manager.cc:359] Metadata directory not provided
I20260808 14:45:01.552875 749 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:45:01.553020 749 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:45:01.554164 749 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/minicluster-data/master-0/data/instance:
uuid: "6a0f85da59644795976bbf35c1979cbb"
format_stamp: "Formatted at 2026-08-08 14:45:01 on dist-test-slave-42z9"
server_key: "66f9bf9129a37bbe9080e2724aa79880"
server_key_iv: "34243ad779be27243aab05e5bf803806"
server_key_version: "encryptionkey@0"
I20260808 14:45:01.554517 749 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/minicluster-data/master-0/wal/instance:
uuid: "6a0f85da59644795976bbf35c1979cbb"
format_stamp: "Formatted at 2026-08-08 14:45:01 on dist-test-slave-42z9"
server_key: "66f9bf9129a37bbe9080e2724aa79880"
server_key_iv: "34243ad779be27243aab05e5bf803806"
server_key_version: "encryptionkey@0"
I20260808 14:45:01.555878 749 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:45:01.556597 767 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:01.556752 749 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:45:01.556838 749 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/minicluster-data/master-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/minicluster-data/master-0/wal
uuid: "6a0f85da59644795976bbf35c1979cbb"
format_stamp: "Formatted at 2026-08-08 14:45:01 on dist-test-slave-42z9"
server_key: "66f9bf9129a37bbe9080e2724aa79880"
server_key_iv: "34243ad779be27243aab05e5bf803806"
server_key_version: "encryptionkey@0"
I20260808 14:45:01.556900 749 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:45:01.567162 749 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:45:01.569324 749 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:45:01.569531 749 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:45:01.574456 749 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.190:40329
I20260808 14:45:01.574542 861 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.190:40329 every 8 connection(s)
I20260808 14:45:01.574857 749 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
I20260808 14:45:01.575330 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 749
I20260808 14:45:01.575415 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/minicluster-data/master-0/wal/instance
I20260808 14:45:01.575588 31578 external_mini_cluster.cc:1428] Setting key 4cd395bb03895194baaac858608db2aa
I20260808 14:45:01.575650 862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:45:01.579097 862 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a0f85da59644795976bbf35c1979cbb: Bootstrap starting.
I20260808 14:45:01.579912 862 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6a0f85da59644795976bbf35c1979cbb: Neither blocks nor log segments found. Creating new log.
I20260808 14:45:01.580200 862 log.cc:824] T 00000000000000000000000000000000 P 6a0f85da59644795976bbf35c1979cbb: Log is configured to *not* fsync() on all Append() calls
I20260808 14:45:01.580909 862 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a0f85da59644795976bbf35c1979cbb: No bootstrap required, opened a new log
Aug 08 14:45:01 dist-test-slave-42z9 krb5kdc[727](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200301, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:45:01.583035 862 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6a0f85da59644795976bbf35c1979cbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a0f85da59644795976bbf35c1979cbb" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 40329 } }
I20260808 14:45:01.583184 862 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6a0f85da59644795976bbf35c1979cbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:45:01.583220 862 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6a0f85da59644795976bbf35c1979cbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a0f85da59644795976bbf35c1979cbb, State: Initialized, Role: FOLLOWER
I20260808 14:45:01.583353 862 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6a0f85da59644795976bbf35c1979cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a0f85da59644795976bbf35c1979cbb" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 40329 } }
I20260808 14:45:01.583432 862 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6a0f85da59644795976bbf35c1979cbb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:45:01.583464 862 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6a0f85da59644795976bbf35c1979cbb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:45:01.583536 862 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6a0f85da59644795976bbf35c1979cbb [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:01.584264 862 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6a0f85da59644795976bbf35c1979cbb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a0f85da59644795976bbf35c1979cbb" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 40329 } }
I20260808 14:45:01.584380 862 leader_election.cc:302] T 00000000000000000000000000000000 P 6a0f85da59644795976bbf35c1979cbb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6a0f85da59644795976bbf35c1979cbb; no voters:
I20260808 14:45:01.584583 862 leader_election.cc:288] T 00000000000000000000000000000000 P 6a0f85da59644795976bbf35c1979cbb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:45:01.584645 868 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6a0f85da59644795976bbf35c1979cbb [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:45:01.584810 868 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6a0f85da59644795976bbf35c1979cbb [term 1 LEADER]: Becoming Leader. State: Replica: 6a0f85da59644795976bbf35c1979cbb, State: Running, Role: LEADER
I20260808 14:45:01.584904 862 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6a0f85da59644795976bbf35c1979cbb [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:45:01.584966 868 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6a0f85da59644795976bbf35c1979cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a0f85da59644795976bbf35c1979cbb" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 40329 } }
I20260808 14:45:01.585355 868 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a0f85da59644795976bbf35c1979cbb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6a0f85da59644795976bbf35c1979cbb. Latest consensus state: current_term: 1 leader_uuid: "6a0f85da59644795976bbf35c1979cbb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a0f85da59644795976bbf35c1979cbb" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 40329 } } }
I20260808 14:45:01.585558 868 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a0f85da59644795976bbf35c1979cbb [sys.catalog]: This master's current role is: LEADER
I20260808 14:45:01.586043 879 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:45:01.586283 870 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a0f85da59644795976bbf35c1979cbb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6a0f85da59644795976bbf35c1979cbb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a0f85da59644795976bbf35c1979cbb" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 40329 } } }
I20260808 14:45:01.586450 870 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a0f85da59644795976bbf35c1979cbb [sys.catalog]: This master's current role is: LEADER
I20260808 14:45:01.586699 865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:01.576084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49044 (local address 127.30.214.190:40329)
0808 14:45:01.576262 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:01.576272 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:01.576298 (+ 26us) server_negotiation.cc:407] Connection header received
0808 14:45:01.576803 (+ 505us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:01.576811 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:01.576864 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:01.576990 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:01.577851 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:01.578752 (+ 901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:01.579788 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:01.580240 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:01.580343 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:01.582615 (+ 2272us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:01.582620 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:01.582620 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:01.582633 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:01.584515 (+ 1882us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:01.584932 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:01.584935 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:01.584936 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:01.585063 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:01.585290 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:01.585291 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:01.585292 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:01.585792 (+ 500us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:01.585977 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:01.586341 (+ 364us) server_negotiation.cc:299] Negotiation successful
0808 14:45:01.586500 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":76,"threads_started":1}
I20260808 14:45:01.586740 879 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:45:01.588270 879 catalog_manager.cc:1347] Generated new cluster ID: c642bca888b5427e8c19ee5114651896
I20260808 14:45:01.588325 879 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:45:01.598538 879 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:45:01.599061 879 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:45:01.606631 879 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6a0f85da59644795976bbf35c1979cbb: Generated new TSK 0
I20260808 14:45:01.606835 879 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.214.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab.
Entry for principal kudu/127.30.214.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab.
I20260808 14:45:01.636018 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.129:0
--local_ip_for_outbound_sockets=127.30.214.129
--webserver_interface=127.30.214.129
--webserver_port=0
--tserver_master_addrs=127.30.214.190:40329
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab
--principal=kudu/127.30.214.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:46001
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:45:01.746738 907 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:45:01.746987 907 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:45:01.747020 907 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:45:01.748380 907 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:45:01.748445 907 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:45:01.748471 907 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 14:45:01.748504 907 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.129
I20260808 14:45:01.750304 907 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:46001
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab
--principal=kudu/127.30.214.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.214.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.30.214.190:40329
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.907
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.129
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:45:01.750602 907 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:45:01.750840 907 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:45:01.756238 915 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:01.756242 919 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:01.756238 914 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:01.756273 907 server_base.cc:1034] running on GCE node
I20260808 14:45:01.756632 907 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:45:01.756910 907 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:45:01.758050 907 hybrid_clock.cc:648] HybridClock initialized: now 1786200301758038 us; error 34 us; skew 500 ppm
Aug 08 14:45:01 dist-test-slave-42z9 krb5kdc[727](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200301, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:45:01.760795 907 init.cc:377] Logged in from keytab as kudu/127.30.214.129@KRBTEST.COM (short username kudu)
I20260808 14:45:01.761284 907 webserver.cc:460] Webserver started at http://127.30.214.129:37125/ using document root <none> and password file <none>
I20260808 14:45:01.761569 907 fs_manager.cc:359] Metadata directory not provided
I20260808 14:45:01.761626 907 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:45:01.761757 907 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:45:01.762893 907 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/minicluster-data/ts-0/data/instance:
uuid: "ff17f5cd05de4c33a6ee891f5458765d"
format_stamp: "Formatted at 2026-08-08 14:45:01 on dist-test-slave-42z9"
server_key: "0f57b1213fb53926c85745edfe6b6287"
server_key_iv: "a1465cf82453fc188498180dd7b65048"
server_key_version: "encryptionkey@0"
I20260808 14:45:01.763240 907 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/minicluster-data/ts-0/wal/instance:
uuid: "ff17f5cd05de4c33a6ee891f5458765d"
format_stamp: "Formatted at 2026-08-08 14:45:01 on dist-test-slave-42z9"
server_key: "0f57b1213fb53926c85745edfe6b6287"
server_key_iv: "a1465cf82453fc188498180dd7b65048"
server_key_version: "encryptionkey@0"
I20260808 14:45:01.764606 907 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:45:01.765297 929 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:01.765475 907 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:45:01.765570 907 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/minicluster-data/ts-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/minicluster-data/ts-0/wal
uuid: "ff17f5cd05de4c33a6ee891f5458765d"
format_stamp: "Formatted at 2026-08-08 14:45:01 on dist-test-slave-42z9"
server_key: "0f57b1213fb53926c85745edfe6b6287"
server_key_iv: "a1465cf82453fc188498180dd7b65048"
server_key_version: "encryptionkey@0"
I20260808 14:45:01.765640 907 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:45:01.780548 907 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:45:01.782851 907 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:45:01.783000 907 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:45:01.783572 907 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:45:01.783623 907 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:01.783653 907 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:45:01.783680 907 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 14:45:01 dist-test-slave-42z9 krb5kdc[727](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200301, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.129@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:45:01.790879 907 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.129:38585
I20260808 14:45:01.790997 1104 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.129:38585 every 8 connection(s)
I20260808 14:45:01.791343 907 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
I20260808 14:45:01.792763 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 907
I20260808 14:45:01.792855 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/minicluster-data/ts-0/wal/instance
I20260808 14:45:01.793020 31578 external_mini_cluster.cc:1428] Setting key 257d9b0b159f130ce27d6fc7d44148ad
I20260808 14:45:01.793581 865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:01.784083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.129:35523 (local address 127.30.214.190:40329)
0808 14:45:01.784132 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:01.784134 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:01.784384 (+ 250us) server_negotiation.cc:407] Connection header received
0808 14:45:01.784880 (+ 496us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:01.784888 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:01.784902 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:01.784974 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:01.785695 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:01.786464 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:01.787558 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:01.787789 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:01.787850 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:01.790764 (+ 2914us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:01.790766 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:01.790766 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:01.790774 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:01.792221 (+ 1447us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:01.792592 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:01.792592 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:01.792593 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:01.792641 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:01.792884 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:01.792885 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:01.792885 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:01.793007 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:01.793075 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:01.793341 (+ 266us) server_negotiation.cc:299] Negotiation successful
0808 14:45:01.793486 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 14:45:01.793740 943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:01.784084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:40329 (local address 127.30.214.129:35523)
0808 14:45:01.784244 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:01.784283 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:01.784769 (+ 486us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:01.785056 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:01.785059 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:01.785345 (+ 286us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:01.785590 (+ 245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:01.785596 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:01.786576 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:01.786577 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:01.787470 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:01.787473 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:01.787866 (+ 393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:01.787867 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:01.788016 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:01.788535 (+ 519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:01.788553 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:01.790634 (+ 2081us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:01.792296 (+ 1662us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:01.792299 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:01.792301 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:01.792530 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:01.792706 (+ 176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:01.792707 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:01.792707 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:01.792822 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:01.793068 (+ 246us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:01.793075 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:01.793217 (+ 142us) client_negotiation.cc:769] Sending connection context
0808 14:45:01.793308 (+ 91us) client_negotiation.cc:240] Negotiation successful
0808 14:45:01.793501 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":83,"threads_started":1}
I20260808 14:45:01.794222 1105 heartbeater.cc:347] Connected to a master server at 127.30.214.190:40329
I20260808 14:45:01.794314 1105 heartbeater.cc:464] Registering TS with master...
I20260808 14:45:01.794510 1105 heartbeater.cc:511] Master 127.30.214.190:40329 requested a full tablet report, sending...
I20260808 14:45:01.795009 791 ts_manager.cc:194] Registered new tserver with Master: ff17f5cd05de4c33a6ee891f5458765d (127.30.214.129:38585)
I20260808 14:45:01.795637 791 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.214.129@KRBTEST.COM'} at 127.30.214.129:35523
I20260808 14:45:01.801376 865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:01.795703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.129:36859 (local address 127.30.214.190:40329)
0808 14:45:01.795738 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:01.795739 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:01.795842 (+ 103us) server_negotiation.cc:407] Connection header received
0808 14:45:01.795929 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:01.795930 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:01.795939 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:01.795994 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:01.796358 (+ 364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:01.796869 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:01.797833 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:01.798015 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:01.798067 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:01.799094 (+ 1027us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:01.799096 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:01.799096 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:01.799103 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:01.800356 (+ 1253us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:01.800735 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:01.800736 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:01.800736 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:01.800781 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:01.800937 (+ 156us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:01.800937 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:01.800937 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:01.801042 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:01.801086 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:01.801242 (+ 156us) server_negotiation.cc:299] Negotiation successful
0808 14:45:01.801308 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 14:45:01.801481 1117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:01.795643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:40329 (local address 127.30.214.129:36859)
0808 14:45:01.795784 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:01.795793 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:01.795867 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:01.795997 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:01.795998 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:01.796198 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:01.796281 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:01.796283 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:01.796965 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:01.796966 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:01.797759 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:01.797763 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:01.798085 (+ 322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:01.798087 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:01.798165 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:01.798557 (+ 392us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:01.798561 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:01.798948 (+ 387us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:01.800444 (+ 1496us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:01.800445 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:01.800445 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:01.800669 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:01.800821 (+ 152us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:01.800821 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:01.800822 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:01.800885 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:01.801096 (+ 211us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:01.801097 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:01.801152 (+ 55us) client_negotiation.cc:769] Sending connection context
0808 14:45:01.801224 (+ 72us) client_negotiation.cc:240] Negotiation successful
0808 14:45:01.801332 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":80,"threads_started":1}
WARNING: no policy specified for kudu/127.30.214.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab.
Entry for principal kudu/127.30.214.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab.
I20260808 14:45:01.818017 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.130:0
--local_ip_for_outbound_sockets=127.30.214.130
--webserver_interface=127.30.214.130
--webserver_port=0
--tserver_master_addrs=127.30.214.190:40329
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab
--principal=kudu/127.30.214.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:46001
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:45:01.900919 1119 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:45:01.901153 1119 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:45:01.901180 1119 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:45:01.902377 1119 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:45:01.902419 1119 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:45:01.902439 1119 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 14:45:01.902455 1119 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.130
I20260808 14:45:01.903918 1119 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:46001
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab
--principal=kudu/127.30.214.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.214.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.30.214.190:40329
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1119
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.130
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:45:01.904146 1119 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:45:01.904341 1119 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:45:01.909409 1128 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:01.909404 1130 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:01.909416 1119 server_base.cc:1034] running on GCE node
W20260808 14:45:01.909415 1125 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:01.909825 1119 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:45:01.910086 1119 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:45:01.911235 1119 hybrid_clock.cc:648] HybridClock initialized: now 1786200301911221 us; error 31 us; skew 500 ppm
Aug 08 14:45:01 dist-test-slave-42z9 krb5kdc[727](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200301, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:45:01.913692 1119 init.cc:377] Logged in from keytab as kudu/127.30.214.130@KRBTEST.COM (short username kudu)
I20260808 14:45:01.914132 1119 webserver.cc:460] Webserver started at http://127.30.214.130:45089/ using document root <none> and password file <none>
I20260808 14:45:01.914346 1119 fs_manager.cc:359] Metadata directory not provided
I20260808 14:45:01.914394 1119 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:45:01.914520 1119 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:45:01.915581 1119 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/minicluster-data/ts-1/data/instance:
uuid: "08a7b9b322144362a129e7de9e087ddc"
format_stamp: "Formatted at 2026-08-08 14:45:01 on dist-test-slave-42z9"
server_key: "e3fff9dfc5b6ce59dccf05e77e4a116c"
server_key_iv: "4bed78d7150f325acffb1c7bc094b514"
server_key_version: "encryptionkey@0"
I20260808 14:45:01.915925 1119 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/minicluster-data/ts-1/wal/instance:
uuid: "08a7b9b322144362a129e7de9e087ddc"
format_stamp: "Formatted at 2026-08-08 14:45:01 on dist-test-slave-42z9"
server_key: "e3fff9dfc5b6ce59dccf05e77e4a116c"
server_key_iv: "4bed78d7150f325acffb1c7bc094b514"
server_key_version: "encryptionkey@0"
I20260808 14:45:01.917251 1119 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 14:45:01.918007 1142 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:01.918157 1119 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:01.918251 1119 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/minicluster-data/ts-1/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/minicluster-data/ts-1/wal
uuid: "08a7b9b322144362a129e7de9e087ddc"
format_stamp: "Formatted at 2026-08-08 14:45:01 on dist-test-slave-42z9"
server_key: "e3fff9dfc5b6ce59dccf05e77e4a116c"
server_key_iv: "4bed78d7150f325acffb1c7bc094b514"
server_key_version: "encryptionkey@0"
I20260808 14:45:01.918316 1119 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:45:01.930450 1119 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:45:01.932242 1119 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:45:01.932384 1119 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:45:01.932914 1119 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:45:01.932964 1119 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:01.932994 1119 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:45:01.933022 1119 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 14:45:01 dist-test-slave-42z9 krb5kdc[727](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200301, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.130@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:45:01.940091 1119 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.130:40819
I20260808 14:45:01.940181 1320 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.130:40819 every 8 connection(s)
I20260808 14:45:01.940510 1119 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
I20260808 14:45:01.942768 865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:01.933332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.130:56429 (local address 127.30.214.190:40329)
0808 14:45:01.933379 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:01.933381 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:01.933632 (+ 251us) server_negotiation.cc:407] Connection header received
0808 14:45:01.934152 (+ 520us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:01.934154 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:01.934168 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:01.934236 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:01.934903 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:01.935462 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:01.936463 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:01.936708 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:01.936773 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:01.940013 (+ 3240us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:01.940014 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:01.940015 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:01.940024 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:01.941485 (+ 1461us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:01.941854 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:01.941856 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:01.941856 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:01.941924 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:01.942141 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:01.942142 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:01.942142 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:01.942264 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:01.942320 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:01.942587 (+ 267us) server_negotiation.cc:299] Negotiation successful
0808 14:45:01.942676 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 14:45:01.942934 1153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:01.933315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:40329 (local address 127.30.214.130:56429)
0808 14:45:01.933505 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:01.933547 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:01.934043 (+ 496us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:01.934321 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:01.934325 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:01.934608 (+ 283us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:01.934806 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:01.934811 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:01.935556 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:01.935557 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:01.936380 (+ 823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:01.936383 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:01.936790 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:01.936791 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:01.936932 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:01.937510 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:01.937522 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:01.939915 (+ 2393us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:01.941557 (+ 1642us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:01.941564 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:01.941566 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:01.941785 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:01.941978 (+ 193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:01.941979 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:01.941979 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:01.942085 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:01.942319 (+ 234us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:01.942325 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:01.942469 (+ 144us) client_negotiation.cc:769] Sending connection context
0808 14:45:01.942560 (+ 91us) client_negotiation.cc:240] Negotiation successful
0808 14:45:01.942724 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":87,"threads_started":1}
I20260808 14:45:01.943363 1321 heartbeater.cc:347] Connected to a master server at 127.30.214.190:40329
I20260808 14:45:01.943459 1321 heartbeater.cc:464] Registering TS with master...
I20260808 14:45:01.943593 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 1119
I20260808 14:45:01.943645 1321 heartbeater.cc:511] Master 127.30.214.190:40329 requested a full tablet report, sending...
I20260808 14:45:01.943687 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/minicluster-data/ts-1/wal/instance
I20260808 14:45:01.943884 31578 external_mini_cluster.cc:1428] Setting key c9d5d3f5ef9ce473f6e52fcd54603b46
I20260808 14:45:01.943994 792 ts_manager.cc:194] Registered new tserver with Master: 08a7b9b322144362a129e7de9e087ddc (127.30.214.130:40819)
I20260808 14:45:01.944499 792 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.214.130@KRBTEST.COM'} at 127.30.214.130:56429
I20260808 14:45:01.949883 1331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:01.944377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:40329 (local address 127.30.214.130:53219)
0808 14:45:01.944531 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:01.944542 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:01.944617 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:01.944745 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:01.944746 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:01.944910 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:01.944971 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:01.944973 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:01.945749 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:01.945750 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:01.946264 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:01.946266 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:01.946739 (+ 473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:01.946740 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:01.946807 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:01.947212 (+ 405us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:01.947216 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:01.947490 (+ 274us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:01.948847 (+ 1357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:01.948847 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:01.948848 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:01.949017 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:01.949208 (+ 191us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:01.949209 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:01.949209 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:01.949271 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:01.949639 (+ 368us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:01.949640 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:01.949679 (+ 39us) client_negotiation.cc:769] Sending connection context
0808 14:45:01.949728 (+ 49us) client_negotiation.cc:240] Negotiation successful
0808 14:45:01.949813 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":70,"threads_started":1}
I20260808 14:45:01.949925 865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:01.944432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.130:53219 (local address 127.30.214.190:40329)
0808 14:45:01.944467 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:01.944469 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:01.944592 (+ 123us) server_negotiation.cc:407] Connection header received
0808 14:45:01.944669 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:01.944670 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:01.944681 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:01.944742 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:01.945032 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:01.945672 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:01.946483 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:01.946668 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:01.946728 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:01.947569 (+ 841us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:01.947571 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:01.947571 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:01.947578 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:01.948772 (+ 1194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:01.949078 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:01.949079 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:01.949079 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:01.949137 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:01.949334 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:01.949335 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:01.949335 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:01.949572 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:01.949651 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:01.949756 (+ 105us) server_negotiation.cc:299] Negotiation successful
0808 14:45:01.949836 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
WARNING: no policy specified for kudu/127.30.214.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab.
Entry for principal kudu/127.30.214.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab.
I20260808 14:45:01.968446 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.131:0
--local_ip_for_outbound_sockets=127.30.214.131
--webserver_interface=127.30.214.131
--webserver_port=0
--tserver_master_addrs=127.30.214.190:40329
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab
--principal=kudu/127.30.214.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:46001
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:45:02.053944 1337 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:45:02.054168 1337 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:45:02.054195 1337 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:45:02.055440 1337 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:45:02.055493 1337 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:45:02.055517 1337 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 14:45:02.055549 1337 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.131
I20260808 14:45:02.057089 1337 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:46001
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab
--principal=kudu/127.30.214.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.214.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.30.214.190:40329
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1337
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.131
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:45:02.057336 1337 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:45:02.057600 1337 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:45:02.063045 1344 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:02.063092 1343 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:02.063246 1337 server_base.cc:1034] running on GCE node
W20260808 14:45:02.063045 1347 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:02.063629 1337 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:45:02.063902 1337 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:45:02.065050 1337 hybrid_clock.cc:648] HybridClock initialized: now 1786200302065039 us; error 35 us; skew 500 ppm
Aug 08 14:45:02 dist-test-slave-42z9 krb5kdc[727](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200302, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:45:02.067759 1337 init.cc:377] Logged in from keytab as kudu/127.30.214.131@KRBTEST.COM (short username kudu)
I20260808 14:45:02.068259 1337 webserver.cc:460] Webserver started at http://127.30.214.131:34477/ using document root <none> and password file <none>
I20260808 14:45:02.068475 1337 fs_manager.cc:359] Metadata directory not provided
I20260808 14:45:02.068524 1337 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:45:02.068684 1337 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:45:02.069849 1337 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/minicluster-data/ts-2/data/instance:
uuid: "1a023ef861a042839a9fe00ee44e111e"
format_stamp: "Formatted at 2026-08-08 14:45:02 on dist-test-slave-42z9"
server_key: "21642ff31ef4ee0247baddb31c460ab4"
server_key_iv: "2acc3f9d22f28afd61a8c3f87ccc441a"
server_key_version: "encryptionkey@0"
I20260808 14:45:02.070188 1337 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/minicluster-data/ts-2/wal/instance:
uuid: "1a023ef861a042839a9fe00ee44e111e"
format_stamp: "Formatted at 2026-08-08 14:45:02 on dist-test-slave-42z9"
server_key: "21642ff31ef4ee0247baddb31c460ab4"
server_key_iv: "2acc3f9d22f28afd61a8c3f87ccc441a"
server_key_version: "encryptionkey@0"
I20260808 14:45:02.071476 1337 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:45:02.072170 1363 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:02.072324 1337 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:45:02.072424 1337 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/minicluster-data/ts-2/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/minicluster-data/ts-2/wal
uuid: "1a023ef861a042839a9fe00ee44e111e"
format_stamp: "Formatted at 2026-08-08 14:45:02 on dist-test-slave-42z9"
server_key: "21642ff31ef4ee0247baddb31c460ab4"
server_key_iv: "2acc3f9d22f28afd61a8c3f87ccc441a"
server_key_version: "encryptionkey@0"
I20260808 14:45:02.072489 1337 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:45:02.082886 1337 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:45:02.084918 1337 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:45:02.085071 1337 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:45:02.085742 1337 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:45:02.085788 1337 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:02.085819 1337 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:45:02.085842 1337 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 14:45:02 dist-test-slave-42z9 krb5kdc[727](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200302, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.131@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:45:02.093313 1337 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.131:40781
I20260808 14:45:02.093721 1337 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
I20260808 14:45:02.093863 1538 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.131:40781 every 8 connection(s)
I20260808 14:45:02.094020 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 1337
I20260808 14:45:02.094112 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/minicluster-data/ts-2/wal/instance
I20260808 14:45:02.094285 31578 external_mini_cluster.cc:1428] Setting key 0b4e05d934dec4286d90f799366c209e
I20260808 14:45:02.096184 865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:02.086249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:41749 (local address 127.30.214.190:40329)
0808 14:45:02.086297 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:02.086299 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:02.086471 (+ 172us) server_negotiation.cc:407] Connection header received
0808 14:45:02.087147 (+ 676us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:02.087149 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:02.087164 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:02.087237 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:02.087943 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:02.088711 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:02.089777 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:02.090076 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:02.090160 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:02.092771 (+ 2611us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:02.092772 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:02.092773 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:02.092782 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:02.095028 (+ 2246us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:02.095444 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:02.095445 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:02.095445 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:02.095505 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:02.095686 (+ 181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:02.095686 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:02.095686 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:02.095792 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:02.095836 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:02.096042 (+ 206us) server_negotiation.cc:299] Negotiation successful
0808 14:45:02.096119 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 14:45:02.096338 1377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:02.086167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:40329 (local address 127.30.214.131:41749)
0808 14:45:02.086345 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:02.086387 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:02.087020 (+ 633us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:02.087321 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:02.087324 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:02.087654 (+ 330us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:02.087860 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:02.087865 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:02.088813 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:02.088813 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:02.089707 (+ 894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:02.089710 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:02.090170 (+ 460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:02.090171 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:02.090289 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:02.090809 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:02.090818 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:02.092686 (+ 1868us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:02.095120 (+ 2434us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:02.095128 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:02.095130 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:02.095391 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:02.095556 (+ 165us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:02.095556 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:02.095556 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:02.095650 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:02.095827 (+ 177us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:02.095829 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:02.095949 (+ 120us) client_negotiation.cc:769] Sending connection context
0808 14:45:02.096027 (+ 78us) client_negotiation.cc:240] Negotiation successful
0808 14:45:02.096151 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":87,"threads_started":1}
I20260808 14:45:02.096781 1540 heartbeater.cc:347] Connected to a master server at 127.30.214.190:40329
I20260808 14:45:02.096869 1540 heartbeater.cc:464] Registering TS with master...
I20260808 14:45:02.097046 1540 heartbeater.cc:511] Master 127.30.214.190:40329 requested a full tablet report, sending...
I20260808 14:45:02.097417 792 ts_manager.cc:194] Registered new tserver with Master: 1a023ef861a042839a9fe00ee44e111e (127.30.214.131:40781)
I20260808 14:45:02.097918 792 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.214.131@KRBTEST.COM'} at 127.30.214.131:41749
I20260808 14:45:02.103044 865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:02.097897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:60621 (local address 127.30.214.190:40329)
0808 14:45:02.097936 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:02.097937 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:02.098068 (+ 131us) server_negotiation.cc:407] Connection header received
0808 14:45:02.098191 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:02.098192 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:02.098202 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:02.098248 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:02.098583 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:02.099070 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:02.099775 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:02.099980 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:02.100035 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:02.100912 (+ 877us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:02.100913 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:02.100914 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:02.100922 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:02.102013 (+ 1091us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:02.102325 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:02.102327 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:02.102327 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:02.102384 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:02.102549 (+ 165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:02.102550 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:02.102551 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:02.102666 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:02.102722 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:02.102861 (+ 139us) server_negotiation.cc:299] Negotiation successful
0808 14:45:02.102941 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 14:45:02.103047 1552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:02.097835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:40329 (local address 127.30.214.131:60621)
0808 14:45:02.098004 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:02.098015 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:02.098135 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:02.098253 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:02.098254 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:02.098454 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:02.098513 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:02.098515 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:02.099159 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:02.099161 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:02.099700 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:02.099702 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:02.100039 (+ 337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:02.100040 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:02.100123 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:02.100533 (+ 410us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:02.100538 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:02.100825 (+ 287us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:02.102092 (+ 1267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:02.102093 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:02.102093 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:02.102263 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:02.102437 (+ 174us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:02.102438 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:02.102438 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:02.102498 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:02.102719 (+ 221us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:02.102720 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:02.102771 (+ 51us) client_negotiation.cc:769] Sending connection context
0808 14:45:02.102831 (+ 60us) client_negotiation.cc:240] Negotiation successful
0808 14:45:02.102942 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":88,"threads_started":1}
I20260808 14:45:02.105997 31578 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 14:45:02 dist-test-slave-42z9 krb5kdc[727](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200302, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 14:45:02 dist-test-slave-42z9 krb5kdc[727](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200302, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:45:02.129050 865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:02.122484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49046 (local address 127.30.214.190:40329)
0808 14:45:02.122547 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:02.122548 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:02.122556 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:45:02.122580 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:02.122581 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:02.122590 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:02.122637 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:02.123197 (+ 560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:02.123693 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:02.124413 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:02.124603 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:02.124662 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:02.126894 (+ 2232us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:02.126897 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:02.126898 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:02.126906 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:02.128001 (+ 1095us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:02.128326 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:02.128328 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:02.128329 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:02.128383 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:02.128547 (+ 164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:02.128548 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:02.128548 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:02.128664 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:02.128756 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:02.128857 (+ 101us) server_negotiation.cc:299] Negotiation successful
0808 14:45:02.128943 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 14:45:02.130708 792 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49046:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:45:02.132280 792 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:45:02.138989 1571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:02.134617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.130:40819 (local address 127.0.0.1:41242)
0808 14:45:02.135050 (+ 433us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:02.135059 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:02.135100 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:02.135396 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:02.135398 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:02.135400 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:45:02.135476 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:02.135479 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:02.136852 (+ 1373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:02.136853 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:02.137915 (+ 1062us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:02.137917 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:02.138629 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:02.138630 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:02.138735 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:02.138751 (+ 16us) client_negotiation.cc:769] Sending connection context
0808 14:45:02.138824 (+ 73us) client_negotiation.cc:240] Negotiation successful
0808 14:45:02.138883 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":412,"mutex_wait_us":2,"thread_start_us":89,"threads_started":1}
I20260808 14:45:02.139122 1570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:02.134760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59076 (local address 127.30.214.129:38585)
0808 14:45:02.134984 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:02.134989 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:02.135002 (+ 13us) server_negotiation.cc:407] Connection header received
0808 14:45:02.135044 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:02.135046 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:02.135061 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:02.135142 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:45:02.135337 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:02.136267 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:02.138015 (+ 1748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:02.138753 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:02.138834 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:02.138889 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:02.138973 (+ 84us) server_negotiation.cc:299] Negotiation successful
0808 14:45:02.139021 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":191,"thread_start_us":107,"threads_started":1}
I20260808 14:45:02.139246 1566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:02.134579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.129:38585 (local address 127.0.0.1:59076)
0808 14:45:02.134798 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:02.134846 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:02.134918 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:02.135162 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:02.135165 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:02.135168 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:45:02.135251 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:02.135255 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:02.136347 (+ 1092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:02.136348 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:02.137547 (+ 1199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:02.137550 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:02.138839 (+ 1289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:02.138840 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:02.138898 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:02.138901 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:45:02.138955 (+ 54us) client_negotiation.cc:240] Negotiation successful
0808 14:45:02.138993 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":74,"threads_started":1}
I20260808 14:45:02.139251 1569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:02.134757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41242 (local address 127.30.214.130:40819)
0808 14:45:02.135219 (+ 462us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:02.135224 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:02.135236 (+ 12us) server_negotiation.cc:407] Connection header received
0808 14:45:02.135276 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:02.135278 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:02.135294 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:02.135550 (+ 256us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:45:02.135618 (+ 68us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:02.136751 (+ 1133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:02.137991 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:02.138542 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:02.138616 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:02.138681 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:02.139046 (+ 365us) server_negotiation.cc:299] Negotiation successful
0808 14:45:02.139096 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":424,"thread_start_us":89,"threads_started":1}
I20260808 14:45:02.139672 1565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:02.134812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.131:40781 (local address 127.0.0.1:48190)
0808 14:45:02.135231 (+ 419us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:02.135241 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:02.135285 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:02.135582 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:02.135583 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:02.135585 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:45:02.135643 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:02.135644 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:02.136943 (+ 1299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:02.136944 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:02.137896 (+ 952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:02.137899 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:02.138945 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:02.138946 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:02.139030 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:02.139035 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 14:45:02.139546 (+ 511us) client_negotiation.cc:240] Negotiation successful
0808 14:45:02.139601 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":405,"mutex_wait_us":1,"thread_start_us":77,"threads_started":1}
I20260808 14:45:02.139925 1573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:02.135071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48190 (local address 127.30.214.131:40781)
0808 14:45:02.135277 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:02.135280 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:02.135291 (+ 11us) server_negotiation.cc:407] Connection header received
0808 14:45:02.135358 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:02.135360 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:02.135375 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:02.135453 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:45:02.135812 (+ 359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:02.136867 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:02.137972 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:02.138753 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:02.138835 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:02.138889 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:02.139783 (+ 894us) server_negotiation.cc:299] Negotiation successful
0808 14:45:02.139832 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":179,"thread_start_us":102,"threads_started":1}
I20260808 14:45:02.140082 1219 tablet_service.cc:1467] Processing CreateTablet for tablet 755be63c24e743f8ba054614582f8ff9 (DEFAULT_TABLE table=test-table [id=b6023989e754477ca6de9b19f0fbf0cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:45:02.140538 1219 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 755be63c24e743f8ba054614582f8ff9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:45:02.140545 1441 tablet_service.cc:1467] Processing CreateTablet for tablet 755be63c24e743f8ba054614582f8ff9 (DEFAULT_TABLE table=test-table [id=b6023989e754477ca6de9b19f0fbf0cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:45:02.140627 999 tablet_service.cc:1467] Processing CreateTablet for tablet 755be63c24e743f8ba054614582f8ff9 (DEFAULT_TABLE table=test-table [id=b6023989e754477ca6de9b19f0fbf0cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:45:02.140825 1441 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 755be63c24e743f8ba054614582f8ff9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:45:02.140951 999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 755be63c24e743f8ba054614582f8ff9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:45:02.143649 1574 tablet_bootstrap.cc:492] T 755be63c24e743f8ba054614582f8ff9 P 1a023ef861a042839a9fe00ee44e111e: Bootstrap starting.
I20260808 14:45:02.144575 1575 tablet_bootstrap.cc:492] T 755be63c24e743f8ba054614582f8ff9 P ff17f5cd05de4c33a6ee891f5458765d: Bootstrap starting.
I20260808 14:45:02.144796 1574 tablet_bootstrap.cc:654] T 755be63c24e743f8ba054614582f8ff9 P 1a023ef861a042839a9fe00ee44e111e: Neither blocks nor log segments found. Creating new log.
I20260808 14:45:02.145160 1574 log.cc:824] T 755be63c24e743f8ba054614582f8ff9 P 1a023ef861a042839a9fe00ee44e111e: Log is configured to *not* fsync() on all Append() calls
I20260808 14:45:02.145246 1575 tablet_bootstrap.cc:654] T 755be63c24e743f8ba054614582f8ff9 P ff17f5cd05de4c33a6ee891f5458765d: Neither blocks nor log segments found. Creating new log.
I20260808 14:45:02.145605 1575 log.cc:824] T 755be63c24e743f8ba054614582f8ff9 P ff17f5cd05de4c33a6ee891f5458765d: Log is configured to *not* fsync() on all Append() calls
I20260808 14:45:02.145958 1576 tablet_bootstrap.cc:492] T 755be63c24e743f8ba054614582f8ff9 P 08a7b9b322144362a129e7de9e087ddc: Bootstrap starting.
I20260808 14:45:02.146081 1574 tablet_bootstrap.cc:492] T 755be63c24e743f8ba054614582f8ff9 P 1a023ef861a042839a9fe00ee44e111e: No bootstrap required, opened a new log
I20260808 14:45:02.146236 1574 ts_tablet_manager.cc:1397] T 755be63c24e743f8ba054614582f8ff9 P 1a023ef861a042839a9fe00ee44e111e: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 14:45:02.146318 1575 tablet_bootstrap.cc:492] T 755be63c24e743f8ba054614582f8ff9 P ff17f5cd05de4c33a6ee891f5458765d: No bootstrap required, opened a new log
I20260808 14:45:02.146387 1575 ts_tablet_manager.cc:1397] T 755be63c24e743f8ba054614582f8ff9 P ff17f5cd05de4c33a6ee891f5458765d: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260808 14:45:02.146653 1576 tablet_bootstrap.cc:654] T 755be63c24e743f8ba054614582f8ff9 P 08a7b9b322144362a129e7de9e087ddc: Neither blocks nor log segments found. Creating new log.
I20260808 14:45:02.146991 1576 log.cc:824] T 755be63c24e743f8ba054614582f8ff9 P 08a7b9b322144362a129e7de9e087ddc: Log is configured to *not* fsync() on all Append() calls
I20260808 14:45:02.147814 1576 tablet_bootstrap.cc:492] T 755be63c24e743f8ba054614582f8ff9 P 08a7b9b322144362a129e7de9e087ddc: No bootstrap required, opened a new log
I20260808 14:45:02.147899 1576 ts_tablet_manager.cc:1397] T 755be63c24e743f8ba054614582f8ff9 P 08a7b9b322144362a129e7de9e087ddc: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:45:02.148131 1575 raft_consensus.cc:348] T 755be63c24e743f8ba054614582f8ff9 P ff17f5cd05de4c33a6ee891f5458765d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff17f5cd05de4c33a6ee891f5458765d" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38585 } } peers { permanent_uuid: "1a023ef861a042839a9fe00ee44e111e" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40781 } } peers { permanent_uuid: "08a7b9b322144362a129e7de9e087ddc" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 40819 } }
I20260808 14:45:02.148274 1575 raft_consensus.cc:374] T 755be63c24e743f8ba054614582f8ff9 P ff17f5cd05de4c33a6ee891f5458765d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:45:02.148305 1575 raft_consensus.cc:729] T 755be63c24e743f8ba054614582f8ff9 P ff17f5cd05de4c33a6ee891f5458765d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff17f5cd05de4c33a6ee891f5458765d, State: Initialized, Role: FOLLOWER
I20260808 14:45:02.148450 1575 consensus_queue.cc:260] T 755be63c24e743f8ba054614582f8ff9 P ff17f5cd05de4c33a6ee891f5458765d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff17f5cd05de4c33a6ee891f5458765d" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38585 } } peers { permanent_uuid: "1a023ef861a042839a9fe00ee44e111e" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40781 } } peers { permanent_uuid: "08a7b9b322144362a129e7de9e087ddc" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 40819 } }
I20260808 14:45:02.148487 1574 raft_consensus.cc:348] T 755be63c24e743f8ba054614582f8ff9 P 1a023ef861a042839a9fe00ee44e111e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff17f5cd05de4c33a6ee891f5458765d" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38585 } } peers { permanent_uuid: "1a023ef861a042839a9fe00ee44e111e" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40781 } } peers { permanent_uuid: "08a7b9b322144362a129e7de9e087ddc" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 40819 } }
I20260808 14:45:02.148649 1574 raft_consensus.cc:374] T 755be63c24e743f8ba054614582f8ff9 P 1a023ef861a042839a9fe00ee44e111e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:45:02.148693 1574 raft_consensus.cc:729] T 755be63c24e743f8ba054614582f8ff9 P 1a023ef861a042839a9fe00ee44e111e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a023ef861a042839a9fe00ee44e111e, State: Initialized, Role: FOLLOWER
I20260808 14:45:02.148756 1575 ts_tablet_manager.cc:1428] T 755be63c24e743f8ba054614582f8ff9 P ff17f5cd05de4c33a6ee891f5458765d: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260808 14:45:02.148809 1574 consensus_queue.cc:260] T 755be63c24e743f8ba054614582f8ff9 P 1a023ef861a042839a9fe00ee44e111e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff17f5cd05de4c33a6ee891f5458765d" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38585 } } peers { permanent_uuid: "1a023ef861a042839a9fe00ee44e111e" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40781 } } peers { permanent_uuid: "08a7b9b322144362a129e7de9e087ddc" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 40819 } }
I20260808 14:45:02.148880 1105 heartbeater.cc:503] Master 127.30.214.190:40329 was elected leader, sending a full tablet report...
I20260808 14:45:02.149119 1540 heartbeater.cc:503] Master 127.30.214.190:40329 was elected leader, sending a full tablet report...
I20260808 14:45:02.149087 1574 ts_tablet_manager.cc:1428] T 755be63c24e743f8ba054614582f8ff9 P 1a023ef861a042839a9fe00ee44e111e: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 14:45:02.149972 1576 raft_consensus.cc:348] T 755be63c24e743f8ba054614582f8ff9 P 08a7b9b322144362a129e7de9e087ddc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff17f5cd05de4c33a6ee891f5458765d" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38585 } } peers { permanent_uuid: "1a023ef861a042839a9fe00ee44e111e" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40781 } } peers { permanent_uuid: "08a7b9b322144362a129e7de9e087ddc" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 40819 } }
I20260808 14:45:02.150861 1576 raft_consensus.cc:374] T 755be63c24e743f8ba054614582f8ff9 P 08a7b9b322144362a129e7de9e087ddc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:45:02.150910 1576 raft_consensus.cc:729] T 755be63c24e743f8ba054614582f8ff9 P 08a7b9b322144362a129e7de9e087ddc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08a7b9b322144362a129e7de9e087ddc, State: Initialized, Role: FOLLOWER
I20260808 14:45:02.151014 1576 consensus_queue.cc:260] T 755be63c24e743f8ba054614582f8ff9 P 08a7b9b322144362a129e7de9e087ddc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff17f5cd05de4c33a6ee891f5458765d" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38585 } } peers { permanent_uuid: "1a023ef861a042839a9fe00ee44e111e" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40781 } } peers { permanent_uuid: "08a7b9b322144362a129e7de9e087ddc" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 40819 } }
I20260808 14:45:02.151305 1576 ts_tablet_manager.cc:1428] T 755be63c24e743f8ba054614582f8ff9 P 08a7b9b322144362a129e7de9e087ddc: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 14:45:02.151360 1321 heartbeater.cc:503] Master 127.30.214.190:40329 was elected leader, sending a full tablet report...
W20260808 14:45:02.191326 1323 tablet.cc:2369] T 755be63c24e743f8ba054614582f8ff9 P 08a7b9b322144362a129e7de9e087ddc: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:45:02.292169 1107 tablet.cc:2369] T 755be63c24e743f8ba054614582f8ff9 P ff17f5cd05de4c33a6ee891f5458765d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:45:02.345507 1543 tablet.cc:2369] T 755be63c24e743f8ba054614582f8ff9 P 1a023ef861a042839a9fe00ee44e111e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:45:02.609273 1582 raft_consensus.cc:482] T 755be63c24e743f8ba054614582f8ff9 P 1a023ef861a042839a9fe00ee44e111e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:45:02.609422 1582 raft_consensus.cc:504] T 755be63c24e743f8ba054614582f8ff9 P 1a023ef861a042839a9fe00ee44e111e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff17f5cd05de4c33a6ee891f5458765d" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38585 } } peers { permanent_uuid: "1a023ef861a042839a9fe00ee44e111e" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40781 } } peers { permanent_uuid: "08a7b9b322144362a129e7de9e087ddc" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 40819 } }
I20260808 14:45:02.609867 1582 leader_election.cc:288] T 755be63c24e743f8ba054614582f8ff9 P 1a023ef861a042839a9fe00ee44e111e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff17f5cd05de4c33a6ee891f5458765d (127.30.214.129:38585), 08a7b9b322144362a129e7de9e087ddc (127.30.214.130:40819)
I20260808 14:45:02.612730 1569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:02.610146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:43539 (local address 127.30.214.130:40819)
0808 14:45:02.610197 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:02.610199 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:02.610282 (+ 83us) server_negotiation.cc:407] Connection header received
0808 14:45:02.610348 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:02.610349 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:02.610357 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:02.610398 (+ 41us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:45:02.610574 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:02.611040 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:02.612051 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:02.612407 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:02.612469 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:02.612478 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:02.612620 (+ 142us) server_negotiation.cc:299] Negotiation successful
0808 14:45:02.612659 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 14:45:02.612730 1570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:02.610170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:58637 (local address 127.30.214.129:38585)
0808 14:45:02.610216 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:02.610218 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:02.610272 (+ 54us) server_negotiation.cc:407] Connection header received
0808 14:45:02.610342 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:02.610343 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:02.610352 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:02.610396 (+ 44us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:45:02.610541 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:02.611021 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:02.612046 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:02.612411 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:02.612475 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:02.612484 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:02.612619 (+ 135us) server_negotiation.cc:299] Negotiation successful
0808 14:45:02.612659 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 14:45:02.612782 1584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:02.610056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.129:38585 (local address 127.30.214.131:58637)
0808 14:45:02.610193 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:02.610205 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:02.610274 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:02.610411 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:02.610412 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:02.610414 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:45:02.610487 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:02.610488 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:02.611106 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:02.611107 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:02.611954 (+ 847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:02.611957 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:02.612491 (+ 534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:02.612492 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:02.612559 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:02.612563 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:45:02.612607 (+ 44us) client_negotiation.cc:240] Negotiation successful
0808 14:45:02.612655 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"mutex_wait_us":34,"thread_start_us":65,"threads_started":1}
I20260808 14:45:02.612788 1585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:02.610064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.130:40819 (local address 127.30.214.131:43539)
0808 14:45:02.610211 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:02.610221 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:02.610285 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:02.610409 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:02.610410 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:02.610412 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:45:02.610511 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:02.610512 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:02.611111 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:02.611112 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:02.611953 (+ 841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:02.611955 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:02.612478 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:02.612479 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:02.612561 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:02.612564 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:45:02.612609 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 14:45:02.612656 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"mutex_wait_us":45,"thread_start_us":61,"threads_started":1}
I20260808 14:45:02.613085 1038 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "755be63c24e743f8ba054614582f8ff9" candidate_uuid: "1a023ef861a042839a9fe00ee44e111e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff17f5cd05de4c33a6ee891f5458765d" is_pre_election: true
I20260808 14:45:02.613266 1038 raft_consensus.cc:2454] T 755be63c24e743f8ba054614582f8ff9 P ff17f5cd05de4c33a6ee891f5458765d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a023ef861a042839a9fe00ee44e111e in term 0.
I20260808 14:45:02.613266 1251 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "755be63c24e743f8ba054614582f8ff9" candidate_uuid: "1a023ef861a042839a9fe00ee44e111e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08a7b9b322144362a129e7de9e087ddc" is_pre_election: true
I20260808 14:45:02.613409 1251 raft_consensus.cc:2454] T 755be63c24e743f8ba054614582f8ff9 P 08a7b9b322144362a129e7de9e087ddc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a023ef861a042839a9fe00ee44e111e in term 0.
I20260808 14:45:02.613529 1366 leader_election.cc:302] T 755be63c24e743f8ba054614582f8ff9 P 1a023ef861a042839a9fe00ee44e111e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a023ef861a042839a9fe00ee44e111e, ff17f5cd05de4c33a6ee891f5458765d; no voters:
I20260808 14:45:02.613659 1582 raft_consensus.cc:2781] T 755be63c24e743f8ba054614582f8ff9 P 1a023ef861a042839a9fe00ee44e111e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:45:02.613720 1582 raft_consensus.cc:482] T 755be63c24e743f8ba054614582f8ff9 P 1a023ef861a042839a9fe00ee44e111e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:45:02.613737 1582 raft_consensus.cc:3037] T 755be63c24e743f8ba054614582f8ff9 P 1a023ef861a042839a9fe00ee44e111e [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:02.614408 1582 raft_consensus.cc:504] T 755be63c24e743f8ba054614582f8ff9 P 1a023ef861a042839a9fe00ee44e111e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff17f5cd05de4c33a6ee891f5458765d" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38585 } } peers { permanent_uuid: "1a023ef861a042839a9fe00ee44e111e" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40781 } } peers { permanent_uuid: "08a7b9b322144362a129e7de9e087ddc" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 40819 } }
I20260808 14:45:02.614539 1582 leader_election.cc:288] T 755be63c24e743f8ba054614582f8ff9 P 1a023ef861a042839a9fe00ee44e111e [CANDIDATE]: Term 1 election: Requested vote from peers ff17f5cd05de4c33a6ee891f5458765d (127.30.214.129:38585), 08a7b9b322144362a129e7de9e087ddc (127.30.214.130:40819)
I20260808 14:45:02.614702 1251 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "755be63c24e743f8ba054614582f8ff9" candidate_uuid: "1a023ef861a042839a9fe00ee44e111e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08a7b9b322144362a129e7de9e087ddc"
I20260808 14:45:02.614703 1038 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "755be63c24e743f8ba054614582f8ff9" candidate_uuid: "1a023ef861a042839a9fe00ee44e111e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff17f5cd05de4c33a6ee891f5458765d"
I20260808 14:45:02.614791 1038 raft_consensus.cc:3037] T 755be63c24e743f8ba054614582f8ff9 P ff17f5cd05de4c33a6ee891f5458765d [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:02.614791 1251 raft_consensus.cc:3037] T 755be63c24e743f8ba054614582f8ff9 P 08a7b9b322144362a129e7de9e087ddc [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:02.615638 1038 raft_consensus.cc:2454] T 755be63c24e743f8ba054614582f8ff9 P ff17f5cd05de4c33a6ee891f5458765d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a023ef861a042839a9fe00ee44e111e in term 1.
I20260808 14:45:02.615638 1251 raft_consensus.cc:2454] T 755be63c24e743f8ba054614582f8ff9 P 08a7b9b322144362a129e7de9e087ddc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a023ef861a042839a9fe00ee44e111e in term 1.
I20260808 14:45:02.615820 1368 leader_election.cc:302] T 755be63c24e743f8ba054614582f8ff9 P 1a023ef861a042839a9fe00ee44e111e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08a7b9b322144362a129e7de9e087ddc, 1a023ef861a042839a9fe00ee44e111e; no voters:
I20260808 14:45:02.615901 1582 raft_consensus.cc:2781] T 755be63c24e743f8ba054614582f8ff9 P 1a023ef861a042839a9fe00ee44e111e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:45:02.616003 1582 raft_consensus.cc:686] T 755be63c24e743f8ba054614582f8ff9 P 1a023ef861a042839a9fe00ee44e111e [term 1 LEADER]: Becoming Leader. State: Replica: 1a023ef861a042839a9fe00ee44e111e, State: Running, Role: LEADER
I20260808 14:45:02.616078 1582 consensus_queue.cc:237] T 755be63c24e743f8ba054614582f8ff9 P 1a023ef861a042839a9fe00ee44e111e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff17f5cd05de4c33a6ee891f5458765d" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38585 } } peers { permanent_uuid: "1a023ef861a042839a9fe00ee44e111e" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40781 } } peers { permanent_uuid: "08a7b9b322144362a129e7de9e087ddc" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 40819 } }
I20260808 14:45:02.616866 791 catalog_manager.cc:5495] T 755be63c24e743f8ba054614582f8ff9 P 1a023ef861a042839a9fe00ee44e111e reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a023ef861a042839a9fe00ee44e111e (127.30.214.131). New cstate: current_term: 1 leader_uuid: "1a023ef861a042839a9fe00ee44e111e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff17f5cd05de4c33a6ee891f5458765d" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a023ef861a042839a9fe00ee44e111e" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "08a7b9b322144362a129e7de9e087ddc" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 40819 } health_report { overall_health: UNKNOWN } } }
I20260808 14:45:02.690428 1593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:02.687998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48204 (local address 127.30.214.131:40781)
0808 14:45:02.688102 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:02.688103 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:02.688135 (+ 32us) server_negotiation.cc:407] Connection header received
0808 14:45:02.688232 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:02.688233 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:02.688253 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:02.688322 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:45:02.688442 (+ 120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:02.688926 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:02.689691 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:02.689886 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:02.689932 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:02.690135 (+ 203us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:45:02.690243 (+ 108us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:45:02.690319 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:02.690337 (+ 18us) server_negotiation.cc:299] Negotiation successful
0808 14:45:02.690359 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81,"thread_start_us":52,"threads_started":1}
I20260808 14:45:02.692370 1038 raft_consensus.cc:1261] T 755be63c24e743f8ba054614582f8ff9 P ff17f5cd05de4c33a6ee891f5458765d [term 1 FOLLOWER]: Refusing update from remote peer 1a023ef861a042839a9fe00ee44e111e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:45:02.692793 1588 consensus_queue.cc:1035] T 755be63c24e743f8ba054614582f8ff9 P 1a023ef861a042839a9fe00ee44e111e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff17f5cd05de4c33a6ee891f5458765d" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:45:02.694926 1251 raft_consensus.cc:1261] T 755be63c24e743f8ba054614582f8ff9 P 08a7b9b322144362a129e7de9e087ddc [term 1 FOLLOWER]: Refusing update from remote peer 1a023ef861a042839a9fe00ee44e111e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:45:02.695272 1588 consensus_queue.cc:1035] T 755be63c24e743f8ba054614582f8ff9 P 1a023ef861a042839a9fe00ee44e111e [LEADER]: Connected to new peer: Peer: permanent_uuid: "08a7b9b322144362a129e7de9e087ddc" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 40819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:45:02.695447 1594 mvcc.cc:205] Tried to move back new op lower bound from 7316276439824756736 to 7316276439516073984. Current Snapshot: MvccSnapshot[applied={T|T < 7316276439824756736}]
I20260808 14:45:02.695561 1596 mvcc.cc:205] Tried to move back new op lower bound from 7316276439824756736 to 7316276439516073984. Current Snapshot: MvccSnapshot[applied={T|T < 7316276439824756736}]
I20260808 14:45:02.700543 792 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49046:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:45:02.700711 792 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49046:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:45:02.701676 792 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6a0f85da59644795976bbf35c1979cbb: Sending DeleteTablet for 3 replicas of tablet 755be63c24e743f8ba054614582f8ff9
I20260808 14:45:02.702265 1441 tablet_service.cc:1514] Processing DeleteTablet for tablet 755be63c24e743f8ba054614582f8ff9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:45:02 UTC) from {username='kudu', principal='kudu/127.30.214.190@KRBTEST.COM'} at 127.0.0.1:48190
I20260808 14:45:02.702275 999 tablet_service.cc:1514] Processing DeleteTablet for tablet 755be63c24e743f8ba054614582f8ff9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:45:02 UTC) from {username='kudu', principal='kudu/127.30.214.190@KRBTEST.COM'} at 127.0.0.1:59076
I20260808 14:45:02.702419 792 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49046:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 14:45:02.702517 1219 tablet_service.cc:1514] Processing DeleteTablet for tablet 755be63c24e743f8ba054614582f8ff9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:45:02 UTC) from {username='kudu', principal='kudu/127.30.214.190@KRBTEST.COM'} at 127.0.0.1:41242
W20260808 14:45:02.702581 792 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:45:02.702654 1611 tablet_replica.cc:330] T 755be63c24e743f8ba054614582f8ff9 P ff17f5cd05de4c33a6ee891f5458765d: stopping tablet replica
I20260808 14:45:02.702750 1613 tablet_replica.cc:330] T 755be63c24e743f8ba054614582f8ff9 P 08a7b9b322144362a129e7de9e087ddc: stopping tablet replica
I20260808 14:45:02.702766 1611 raft_consensus.cc:2229] T 755be63c24e743f8ba054614582f8ff9 P ff17f5cd05de4c33a6ee891f5458765d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:45:02.702852 1613 raft_consensus.cc:2229] T 755be63c24e743f8ba054614582f8ff9 P 08a7b9b322144362a129e7de9e087ddc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:45:02.702878 1611 raft_consensus.cc:2258] T 755be63c24e743f8ba054614582f8ff9 P ff17f5cd05de4c33a6ee891f5458765d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:45:02.703058 1612 tablet_replica.cc:330] T 755be63c24e743f8ba054614582f8ff9 P 1a023ef861a042839a9fe00ee44e111e: stopping tablet replica
I20260808 14:45:02.702950 1613 raft_consensus.cc:2258] T 755be63c24e743f8ba054614582f8ff9 P 08a7b9b322144362a129e7de9e087ddc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:45:02.703213 1612 raft_consensus.cc:2229] T 755be63c24e743f8ba054614582f8ff9 P 1a023ef861a042839a9fe00ee44e111e [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:45:02.703397 1612 raft_consensus.cc:2258] T 755be63c24e743f8ba054614582f8ff9 P 1a023ef861a042839a9fe00ee44e111e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:45:02.703512 1611 ts_tablet_manager.cc:1905] T 755be63c24e743f8ba054614582f8ff9 P ff17f5cd05de4c33a6ee891f5458765d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:45:02.703878 1612 ts_tablet_manager.cc:1905] T 755be63c24e743f8ba054614582f8ff9 P 1a023ef861a042839a9fe00ee44e111e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:45:02.704233 1219 tablet_service.cc:1467] Processing CreateTablet for tablet 85d90ee3b026423188085b1b82ee68d5 (DEFAULT_TABLE table=test-table [id=c8af5d2af73e4b3d8008b0bc6cf8a76f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:45:02.704356 1219 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 85d90ee3b026423188085b1b82ee68d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:45:02.705312 1611 ts_tablet_manager.cc:1918] T 755be63c24e743f8ba054614582f8ff9 P ff17f5cd05de4c33a6ee891f5458765d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:45:02.705385 1611 log.cc:1196] T 755be63c24e743f8ba054614582f8ff9 P ff17f5cd05de4c33a6ee891f5458765d: Deleting WAL directory at /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/minicluster-data/ts-0/wal/wals/755be63c24e743f8ba054614582f8ff9
I20260808 14:45:02.705621 1612 ts_tablet_manager.cc:1918] T 755be63c24e743f8ba054614582f8ff9 P 1a023ef861a042839a9fe00ee44e111e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:45:02.705708 1611 ts_tablet_manager.cc:1939] T 755be63c24e743f8ba054614582f8ff9 P ff17f5cd05de4c33a6ee891f5458765d: Deleting consensus metadata
I20260808 14:45:02.705839 1612 log.cc:1196] T 755be63c24e743f8ba054614582f8ff9 P 1a023ef861a042839a9fe00ee44e111e: Deleting WAL directory at /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/minicluster-data/ts-2/wal/wals/755be63c24e743f8ba054614582f8ff9
I20260808 14:45:02.705900 999 tablet_service.cc:1467] Processing CreateTablet for tablet 85d90ee3b026423188085b1b82ee68d5 (DEFAULT_TABLE table=test-table [id=c8af5d2af73e4b3d8008b0bc6cf8a76f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:45:02.706008 999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 85d90ee3b026423188085b1b82ee68d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:45:02.706180 1612 ts_tablet_manager.cc:1939] T 755be63c24e743f8ba054614582f8ff9 P 1a023ef861a042839a9fe00ee44e111e: Deleting consensus metadata
I20260808 14:45:02.706674 769 catalog_manager.cc:4841] TS 1a023ef861a042839a9fe00ee44e111e (127.30.214.131:40781): tablet 755be63c24e743f8ba054614582f8ff9 (table test-table [id=b6023989e754477ca6de9b19f0fbf0cd]) successfully deleted
I20260808 14:45:02.707126 1615 tablet_bootstrap.cc:492] T 85d90ee3b026423188085b1b82ee68d5 P ff17f5cd05de4c33a6ee891f5458765d: Bootstrap starting.
I20260808 14:45:02.707125 1441 tablet_service.cc:1467] Processing CreateTablet for tablet 85d90ee3b026423188085b1b82ee68d5 (DEFAULT_TABLE table=test-table [id=c8af5d2af73e4b3d8008b0bc6cf8a76f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:45:02.707226 1441 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 85d90ee3b026423188085b1b82ee68d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:45:02.707497 1615 tablet_bootstrap.cc:654] T 85d90ee3b026423188085b1b82ee68d5 P ff17f5cd05de4c33a6ee891f5458765d: Neither blocks nor log segments found. Creating new log.
I20260808 14:45:02.708191 1615 tablet_bootstrap.cc:492] T 85d90ee3b026423188085b1b82ee68d5 P ff17f5cd05de4c33a6ee891f5458765d: No bootstrap required, opened a new log
I20260808 14:45:02.708237 1615 ts_tablet_manager.cc:1397] T 85d90ee3b026423188085b1b82ee68d5 P ff17f5cd05de4c33a6ee891f5458765d: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 14:45:02.708381 1615 raft_consensus.cc:348] T 85d90ee3b026423188085b1b82ee68d5 P ff17f5cd05de4c33a6ee891f5458765d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff17f5cd05de4c33a6ee891f5458765d" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38585 } } peers { permanent_uuid: "08a7b9b322144362a129e7de9e087ddc" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 40819 } } peers { permanent_uuid: "1a023ef861a042839a9fe00ee44e111e" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40781 } }
I20260808 14:45:02.708451 1615 raft_consensus.cc:374] T 85d90ee3b026423188085b1b82ee68d5 P ff17f5cd05de4c33a6ee891f5458765d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:45:02.708469 1615 raft_consensus.cc:729] T 85d90ee3b026423188085b1b82ee68d5 P ff17f5cd05de4c33a6ee891f5458765d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff17f5cd05de4c33a6ee891f5458765d, State: Initialized, Role: FOLLOWER
I20260808 14:45:02.708509 1621 tablet_bootstrap.cc:492] T 85d90ee3b026423188085b1b82ee68d5 P 1a023ef861a042839a9fe00ee44e111e: Bootstrap starting.
I20260808 14:45:02.708531 1615 consensus_queue.cc:260] T 85d90ee3b026423188085b1b82ee68d5 P ff17f5cd05de4c33a6ee891f5458765d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff17f5cd05de4c33a6ee891f5458765d" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38585 } } peers { permanent_uuid: "08a7b9b322144362a129e7de9e087ddc" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 40819 } } peers { permanent_uuid: "1a023ef861a042839a9fe00ee44e111e" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40781 } }
I20260808 14:45:02.708693 769 catalog_manager.cc:4841] TS ff17f5cd05de4c33a6ee891f5458765d (127.30.214.129:38585): tablet 755be63c24e743f8ba054614582f8ff9 (table test-table [id=b6023989e754477ca6de9b19f0fbf0cd]) successfully deleted
I20260808 14:45:02.708940 1621 tablet_bootstrap.cc:654] T 85d90ee3b026423188085b1b82ee68d5 P 1a023ef861a042839a9fe00ee44e111e: Neither blocks nor log segments found. Creating new log.
I20260808 14:45:02.709103 1615 ts_tablet_manager.cc:1428] T 85d90ee3b026423188085b1b82ee68d5 P ff17f5cd05de4c33a6ee891f5458765d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 14:45:02.709764 1625 tablet_bootstrap.cc:492] T 85d90ee3b026423188085b1b82ee68d5 P 08a7b9b322144362a129e7de9e087ddc: Bootstrap starting.
I20260808 14:45:02.710188 1613 ts_tablet_manager.cc:1905] T 755be63c24e743f8ba054614582f8ff9 P 08a7b9b322144362a129e7de9e087ddc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:45:02.710216 1625 tablet_bootstrap.cc:654] T 85d90ee3b026423188085b1b82ee68d5 P 08a7b9b322144362a129e7de9e087ddc: Neither blocks nor log segments found. Creating new log.
I20260808 14:45:02.710861 1625 tablet_bootstrap.cc:492] T 85d90ee3b026423188085b1b82ee68d5 P 08a7b9b322144362a129e7de9e087ddc: No bootstrap required, opened a new log
I20260808 14:45:02.710922 1625 ts_tablet_manager.cc:1397] T 85d90ee3b026423188085b1b82ee68d5 P 08a7b9b322144362a129e7de9e087ddc: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 14:45:02.711066 1625 raft_consensus.cc:348] T 85d90ee3b026423188085b1b82ee68d5 P 08a7b9b322144362a129e7de9e087ddc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff17f5cd05de4c33a6ee891f5458765d" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38585 } } peers { permanent_uuid: "08a7b9b322144362a129e7de9e087ddc" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 40819 } } peers { permanent_uuid: "1a023ef861a042839a9fe00ee44e111e" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40781 } }
I20260808 14:45:02.711143 1625 raft_consensus.cc:374] T 85d90ee3b026423188085b1b82ee68d5 P 08a7b9b322144362a129e7de9e087ddc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:45:02.711163 1625 raft_consensus.cc:729] T 85d90ee3b026423188085b1b82ee68d5 P 08a7b9b322144362a129e7de9e087ddc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08a7b9b322144362a129e7de9e087ddc, State: Initialized, Role: FOLLOWER
I20260808 14:45:02.711246 1625 consensus_queue.cc:260] T 85d90ee3b026423188085b1b82ee68d5 P 08a7b9b322144362a129e7de9e087ddc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff17f5cd05de4c33a6ee891f5458765d" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38585 } } peers { permanent_uuid: "08a7b9b322144362a129e7de9e087ddc" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 40819 } } peers { permanent_uuid: "1a023ef861a042839a9fe00ee44e111e" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40781 } }
I20260808 14:45:02.711619 1625 ts_tablet_manager.cc:1428] T 85d90ee3b026423188085b1b82ee68d5 P 08a7b9b322144362a129e7de9e087ddc: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 14:45:02.711629 1613 ts_tablet_manager.cc:1918] T 755be63c24e743f8ba054614582f8ff9 P 08a7b9b322144362a129e7de9e087ddc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:45:02.711730 1613 log.cc:1196] T 755be63c24e743f8ba054614582f8ff9 P 08a7b9b322144362a129e7de9e087ddc: Deleting WAL directory at /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/minicluster-data/ts-1/wal/wals/755be63c24e743f8ba054614582f8ff9
I20260808 14:45:02.711994 1613 ts_tablet_manager.cc:1939] T 755be63c24e743f8ba054614582f8ff9 P 08a7b9b322144362a129e7de9e087ddc: Deleting consensus metadata
I20260808 14:45:02.712426 771 catalog_manager.cc:4841] TS 08a7b9b322144362a129e7de9e087ddc (127.30.214.130:40819): tablet 755be63c24e743f8ba054614582f8ff9 (table test-table [id=b6023989e754477ca6de9b19f0fbf0cd]) successfully deleted
I20260808 14:45:02.718058 1621 tablet_bootstrap.cc:492] T 85d90ee3b026423188085b1b82ee68d5 P 1a023ef861a042839a9fe00ee44e111e: No bootstrap required, opened a new log
I20260808 14:45:02.718128 1621 ts_tablet_manager.cc:1397] T 85d90ee3b026423188085b1b82ee68d5 P 1a023ef861a042839a9fe00ee44e111e: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.000s
I20260808 14:45:02.718303 1621 raft_consensus.cc:348] T 85d90ee3b026423188085b1b82ee68d5 P 1a023ef861a042839a9fe00ee44e111e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff17f5cd05de4c33a6ee891f5458765d" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38585 } } peers { permanent_uuid: "08a7b9b322144362a129e7de9e087ddc" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 40819 } } peers { permanent_uuid: "1a023ef861a042839a9fe00ee44e111e" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40781 } }
I20260808 14:45:02.718380 1621 raft_consensus.cc:374] T 85d90ee3b026423188085b1b82ee68d5 P 1a023ef861a042839a9fe00ee44e111e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:45:02.718394 1621 raft_consensus.cc:729] T 85d90ee3b026423188085b1b82ee68d5 P 1a023ef861a042839a9fe00ee44e111e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a023ef861a042839a9fe00ee44e111e, State: Initialized, Role: FOLLOWER
I20260808 14:45:02.718436 1621 consensus_queue.cc:260] T 85d90ee3b026423188085b1b82ee68d5 P 1a023ef861a042839a9fe00ee44e111e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff17f5cd05de4c33a6ee891f5458765d" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38585 } } peers { permanent_uuid: "08a7b9b322144362a129e7de9e087ddc" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 40819 } } peers { permanent_uuid: "1a023ef861a042839a9fe00ee44e111e" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40781 } }
I20260808 14:45:02.718536 1621 ts_tablet_manager.cc:1428] T 85d90ee3b026423188085b1b82ee68d5 P 1a023ef861a042839a9fe00ee44e111e: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:02.885152 1595 raft_consensus.cc:482] T 85d90ee3b026423188085b1b82ee68d5 P ff17f5cd05de4c33a6ee891f5458765d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:45:02.885290 1595 raft_consensus.cc:504] T 85d90ee3b026423188085b1b82ee68d5 P ff17f5cd05de4c33a6ee891f5458765d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff17f5cd05de4c33a6ee891f5458765d" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38585 } } peers { permanent_uuid: "08a7b9b322144362a129e7de9e087ddc" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 40819 } } peers { permanent_uuid: "1a023ef861a042839a9fe00ee44e111e" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40781 } }
I20260808 14:45:02.885722 1595 leader_election.cc:288] T 85d90ee3b026423188085b1b82ee68d5 P ff17f5cd05de4c33a6ee891f5458765d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08a7b9b322144362a129e7de9e087ddc (127.30.214.130:40819), 1a023ef861a042839a9fe00ee44e111e (127.30.214.131:40781)
I20260808 14:45:02.888787 1593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:02.886094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.129:34441 (local address 127.30.214.131:40781)
0808 14:45:02.886139 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:02.886141 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:02.886216 (+ 75us) server_negotiation.cc:407] Connection header received
0808 14:45:02.886329 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:02.886330 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:02.886342 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:02.886391 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:45:02.886552 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:02.887051 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:02.888096 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:02.888469 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:02.888531 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:02.888541 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:02.888675 (+ 134us) server_negotiation.cc:299] Negotiation successful
0808 14:45:02.888719 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 14:45:02.888801 1569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:02.886036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.129:41197 (local address 127.30.214.130:40819)
0808 14:45:02.886098 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:02.886100 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:02.886236 (+ 136us) server_negotiation.cc:407] Connection header received
0808 14:45:02.886324 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:02.886326 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:02.886337 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:02.886384 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:45:02.886559 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:02.887056 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:02.888110 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:02.888468 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:02.888532 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:02.888540 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:02.888697 (+ 157us) server_negotiation.cc:299] Negotiation successful
0808 14:45:02.888736 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 14:45:02.888825 1627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:02.885908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.131:40781 (local address 127.30.214.129:34441)
0808 14:45:02.886135 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:02.886147 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:02.886221 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:02.886415 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:02.886416 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:02.886418 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:45:02.886489 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:02.886491 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:02.887133 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:02.887134 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:02.888004 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:02.888006 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:02.888545 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:02.888546 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:02.888610 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:02.888614 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:45:02.888661 (+ 47us) client_negotiation.cc:240] Negotiation successful
0808 14:45:02.888701 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":201,"mutex_wait_us":41,"thread_start_us":108,"threads_started":1}
I20260808 14:45:02.888837 1630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:02.885917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.130:40819 (local address 127.30.214.129:41197)
0808 14:45:02.886163 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:02.886173 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:02.886254 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:02.886407 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:02.886408 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:02.886410 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:45:02.886495 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:02.886497 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:02.887140 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:02.887141 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:02.888003 (+ 862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:02.888005 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:02.888546 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:02.888547 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:02.888627 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:02.888630 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:45:02.888676 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 14:45:02.888719 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":228,"mutex_wait_us":7,"thread_start_us":136,"threads_started":1}
I20260808 14:45:02.889125 1251 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85d90ee3b026423188085b1b82ee68d5" candidate_uuid: "ff17f5cd05de4c33a6ee891f5458765d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08a7b9b322144362a129e7de9e087ddc" is_pre_election: true
I20260808 14:45:02.889103 1465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85d90ee3b026423188085b1b82ee68d5" candidate_uuid: "ff17f5cd05de4c33a6ee891f5458765d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a023ef861a042839a9fe00ee44e111e" is_pre_election: true
I20260808 14:45:02.889223 1251 raft_consensus.cc:2454] T 85d90ee3b026423188085b1b82ee68d5 P 08a7b9b322144362a129e7de9e087ddc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff17f5cd05de4c33a6ee891f5458765d in term 0.
I20260808 14:45:02.889240 1465 raft_consensus.cc:2454] T 85d90ee3b026423188085b1b82ee68d5 P 1a023ef861a042839a9fe00ee44e111e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff17f5cd05de4c33a6ee891f5458765d in term 0.
I20260808 14:45:02.889467 933 leader_election.cc:302] T 85d90ee3b026423188085b1b82ee68d5 P ff17f5cd05de4c33a6ee891f5458765d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 08a7b9b322144362a129e7de9e087ddc, 1a023ef861a042839a9fe00ee44e111e, ff17f5cd05de4c33a6ee891f5458765d; no voters:
I20260808 14:45:02.889611 1595 raft_consensus.cc:2781] T 85d90ee3b026423188085b1b82ee68d5 P ff17f5cd05de4c33a6ee891f5458765d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:45:02.889664 1595 raft_consensus.cc:482] T 85d90ee3b026423188085b1b82ee68d5 P ff17f5cd05de4c33a6ee891f5458765d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:45:02.889685 1595 raft_consensus.cc:3037] T 85d90ee3b026423188085b1b82ee68d5 P ff17f5cd05de4c33a6ee891f5458765d [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:02.890411 1595 raft_consensus.cc:504] T 85d90ee3b026423188085b1b82ee68d5 P ff17f5cd05de4c33a6ee891f5458765d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff17f5cd05de4c33a6ee891f5458765d" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38585 } } peers { permanent_uuid: "08a7b9b322144362a129e7de9e087ddc" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 40819 } } peers { permanent_uuid: "1a023ef861a042839a9fe00ee44e111e" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40781 } }
I20260808 14:45:02.890542 1595 leader_election.cc:288] T 85d90ee3b026423188085b1b82ee68d5 P ff17f5cd05de4c33a6ee891f5458765d [CANDIDATE]: Term 1 election: Requested vote from peers 08a7b9b322144362a129e7de9e087ddc (127.30.214.130:40819), 1a023ef861a042839a9fe00ee44e111e (127.30.214.131:40781)
I20260808 14:45:02.890712 1465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85d90ee3b026423188085b1b82ee68d5" candidate_uuid: "ff17f5cd05de4c33a6ee891f5458765d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a023ef861a042839a9fe00ee44e111e"
I20260808 14:45:02.890735 1251 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85d90ee3b026423188085b1b82ee68d5" candidate_uuid: "ff17f5cd05de4c33a6ee891f5458765d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08a7b9b322144362a129e7de9e087ddc"
I20260808 14:45:02.890801 1251 raft_consensus.cc:3037] T 85d90ee3b026423188085b1b82ee68d5 P 08a7b9b322144362a129e7de9e087ddc [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:02.890801 1465 raft_consensus.cc:3037] T 85d90ee3b026423188085b1b82ee68d5 P 1a023ef861a042839a9fe00ee44e111e [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:02.891570 1251 raft_consensus.cc:2454] T 85d90ee3b026423188085b1b82ee68d5 P 08a7b9b322144362a129e7de9e087ddc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff17f5cd05de4c33a6ee891f5458765d in term 1.
I20260808 14:45:02.891570 1465 raft_consensus.cc:2454] T 85d90ee3b026423188085b1b82ee68d5 P 1a023ef861a042839a9fe00ee44e111e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff17f5cd05de4c33a6ee891f5458765d in term 1.
I20260808 14:45:02.891736 937 leader_election.cc:302] T 85d90ee3b026423188085b1b82ee68d5 P ff17f5cd05de4c33a6ee891f5458765d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08a7b9b322144362a129e7de9e087ddc, ff17f5cd05de4c33a6ee891f5458765d; no voters:
I20260808 14:45:02.891832 1595 raft_consensus.cc:2781] T 85d90ee3b026423188085b1b82ee68d5 P ff17f5cd05de4c33a6ee891f5458765d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:45:02.892005 1595 raft_consensus.cc:686] T 85d90ee3b026423188085b1b82ee68d5 P ff17f5cd05de4c33a6ee891f5458765d [term 1 LEADER]: Becoming Leader. State: Replica: ff17f5cd05de4c33a6ee891f5458765d, State: Running, Role: LEADER
I20260808 14:45:02.892081 1595 consensus_queue.cc:237] T 85d90ee3b026423188085b1b82ee68d5 P ff17f5cd05de4c33a6ee891f5458765d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff17f5cd05de4c33a6ee891f5458765d" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38585 } } peers { permanent_uuid: "08a7b9b322144362a129e7de9e087ddc" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 40819 } } peers { permanent_uuid: "1a023ef861a042839a9fe00ee44e111e" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40781 } }
I20260808 14:45:02.892813 792 catalog_manager.cc:5495] T 85d90ee3b026423188085b1b82ee68d5 P ff17f5cd05de4c33a6ee891f5458765d reported cstate change: term changed from 0 to 1, leader changed from <none> to ff17f5cd05de4c33a6ee891f5458765d (127.30.214.129). New cstate: current_term: 1 leader_uuid: "ff17f5cd05de4c33a6ee891f5458765d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff17f5cd05de4c33a6ee891f5458765d" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "08a7b9b322144362a129e7de9e087ddc" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 40819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a023ef861a042839a9fe00ee44e111e" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40781 } health_report { overall_health: UNKNOWN } } }
Aug 08 14:45:02 dist-test-slave-42z9 krb5kdc[727](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200301, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.190@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:45:02.965117 1642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:02.958275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49054 (local address 127.30.214.190:40329)
0808 14:45:02.958418 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:02.958420 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:02.958485 (+ 65us) server_negotiation.cc:407] Connection header received
0808 14:45:02.958549 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:02.958549 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:02.958561 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:02.958614 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:02.959060 (+ 446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:02.959569 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:02.960237 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:02.960425 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:02.960470 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:02.962651 (+ 2181us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:02.962653 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:02.962654 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:02.962662 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:02.963780 (+ 1118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:02.964140 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:02.964140 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:02.964141 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:02.964192 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:02.964564 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:02.964565 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:02.964565 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:02.964677 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:02.964732 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:02.964956 (+ 224us) server_negotiation.cc:299] Negotiation successful
0808 14:45:02.965042 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":80,"threads_started":1}
I20260808 14:45:02.965240 1641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:02.958222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:40329 (local address 127.0.0.1:49054)
0808 14:45:02.958411 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:02.958422 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:02.958492 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:02.958626 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:02.958627 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:02.958948 (+ 321us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:02.959003 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:02.959005 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:02.959627 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:02.959627 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:02.960172 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:02.960174 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:02.960475 (+ 301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:02.960476 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:02.960520 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:02.961020 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:02.961025 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:02.962566 (+ 1541us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:02.963859 (+ 1293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:02.963867 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:02.963869 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:02.964084 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:02.964330 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:02.964333 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:02.964333 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:02.964469 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:02.964772 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:02.964780 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:02.964836 (+ 56us) client_negotiation.cc:769] Sending connection context
0808 14:45:02.964928 (+ 92us) client_negotiation.cc:240] Negotiation successful
0808 14:45:02.965119 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"mutex_wait_us":70,"thread_start_us":104,"threads_started":1}
I20260808 14:45:02.967288 792 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.30.214.190@KRBTEST.COM'} at 127.0.0.1:49054:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 14:45:02.967569 792 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:45:02.969036 1441 tablet_service.cc:1467] Processing CreateTablet for tablet 5954b0fea40549218b37f29333da9072 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=36fa216971494a4b8b75ed273c98e64c]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 14:45:02.969260 1441 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5954b0fea40549218b37f29333da9072. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:45:02.970368 1621 tablet_bootstrap.cc:492] T 5954b0fea40549218b37f29333da9072 P 1a023ef861a042839a9fe00ee44e111e: Bootstrap starting.
I20260808 14:45:02.970743 1621 tablet_bootstrap.cc:654] T 5954b0fea40549218b37f29333da9072 P 1a023ef861a042839a9fe00ee44e111e: Neither blocks nor log segments found. Creating new log.
I20260808 14:45:02.971241 1621 tablet_bootstrap.cc:492] T 5954b0fea40549218b37f29333da9072 P 1a023ef861a042839a9fe00ee44e111e: No bootstrap required, opened a new log
I20260808 14:45:02.971285 1621 ts_tablet_manager.cc:1397] T 5954b0fea40549218b37f29333da9072 P 1a023ef861a042839a9fe00ee44e111e: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 14:45:02.971390 1621 raft_consensus.cc:348] T 5954b0fea40549218b37f29333da9072 P 1a023ef861a042839a9fe00ee44e111e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff17f5cd05de4c33a6ee891f5458765d" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38585 } } peers { permanent_uuid: "08a7b9b322144362a129e7de9e087ddc" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 40819 } } peers { permanent_uuid: "1a023ef861a042839a9fe00ee44e111e" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40781 } }
I20260808 14:45:02.971453 1621 raft_consensus.cc:374] T 5954b0fea40549218b37f29333da9072 P 1a023ef861a042839a9fe00ee44e111e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:45:02.971467 1621 raft_consensus.cc:729] T 5954b0fea40549218b37f29333da9072 P 1a023ef861a042839a9fe00ee44e111e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a023ef861a042839a9fe00ee44e111e, State: Initialized, Role: FOLLOWER
I20260808 14:45:02.969043 999 tablet_service.cc:1467] Processing CreateTablet for tablet 5954b0fea40549218b37f29333da9072 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=36fa216971494a4b8b75ed273c98e64c]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 14:45:02.971508 1621 consensus_queue.cc:260] T 5954b0fea40549218b37f29333da9072 P 1a023ef861a042839a9fe00ee44e111e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff17f5cd05de4c33a6ee891f5458765d" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38585 } } peers { permanent_uuid: "08a7b9b322144362a129e7de9e087ddc" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 40819 } } peers { permanent_uuid: "1a023ef861a042839a9fe00ee44e111e" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40781 } }
I20260808 14:45:02.971612 999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5954b0fea40549218b37f29333da9072. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:45:02.971604 1621 ts_tablet_manager.cc:1428] T 5954b0fea40549218b37f29333da9072 P 1a023ef861a042839a9fe00ee44e111e: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:02.971616 1588 tablet_replica.cc:439] T 5954b0fea40549218b37f29333da9072 P 1a023ef861a042839a9fe00ee44e111e: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff17f5cd05de4c33a6ee891f5458765d" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38585 } } peers { permanent_uuid: "08a7b9b322144362a129e7de9e087ddc" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 40819 } } peers { permanent_uuid: "1a023ef861a042839a9fe00ee44e111e" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40781 } } }
I20260808 14:45:02.971714 1588 tablet_replica.cc:442] T 5954b0fea40549218b37f29333da9072 P 1a023ef861a042839a9fe00ee44e111e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:45:02.972906 1615 tablet_bootstrap.cc:492] T 5954b0fea40549218b37f29333da9072 P ff17f5cd05de4c33a6ee891f5458765d: Bootstrap starting.
I20260808 14:45:02.973011 1219 tablet_service.cc:1467] Processing CreateTablet for tablet 5954b0fea40549218b37f29333da9072 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=36fa216971494a4b8b75ed273c98e64c]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 14:45:02.973151 1219 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5954b0fea40549218b37f29333da9072. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:45:02.973336 1615 tablet_bootstrap.cc:654] T 5954b0fea40549218b37f29333da9072 P ff17f5cd05de4c33a6ee891f5458765d: Neither blocks nor log segments found. Creating new log.
I20260808 14:45:02.974047 1615 tablet_bootstrap.cc:492] T 5954b0fea40549218b37f29333da9072 P ff17f5cd05de4c33a6ee891f5458765d: No bootstrap required, opened a new log
I20260808 14:45:02.974094 1615 ts_tablet_manager.cc:1397] T 5954b0fea40549218b37f29333da9072 P ff17f5cd05de4c33a6ee891f5458765d: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 14:45:02.974238 1615 raft_consensus.cc:348] T 5954b0fea40549218b37f29333da9072 P ff17f5cd05de4c33a6ee891f5458765d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff17f5cd05de4c33a6ee891f5458765d" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38585 } } peers { permanent_uuid: "08a7b9b322144362a129e7de9e087ddc" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 40819 } } peers { permanent_uuid: "1a023ef861a042839a9fe00ee44e111e" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40781 } }
I20260808 14:45:02.974296 1615 raft_consensus.cc:374] T 5954b0fea40549218b37f29333da9072 P ff17f5cd05de4c33a6ee891f5458765d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:45:02.974314 1615 raft_consensus.cc:729] T 5954b0fea40549218b37f29333da9072 P ff17f5cd05de4c33a6ee891f5458765d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff17f5cd05de4c33a6ee891f5458765d, State: Initialized, Role: FOLLOWER
I20260808 14:45:02.974359 1615 consensus_queue.cc:260] T 5954b0fea40549218b37f29333da9072 P ff17f5cd05de4c33a6ee891f5458765d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff17f5cd05de4c33a6ee891f5458765d" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38585 } } peers { permanent_uuid: "08a7b9b322144362a129e7de9e087ddc" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 40819 } } peers { permanent_uuid: "1a023ef861a042839a9fe00ee44e111e" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40781 } }
I20260808 14:45:02.974437 1625 tablet_bootstrap.cc:492] T 5954b0fea40549218b37f29333da9072 P 08a7b9b322144362a129e7de9e087ddc: Bootstrap starting.
I20260808 14:45:02.974458 1615 ts_tablet_manager.cc:1428] T 5954b0fea40549218b37f29333da9072 P ff17f5cd05de4c33a6ee891f5458765d: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 14:45:02.974584 1595 tablet_replica.cc:439] T 5954b0fea40549218b37f29333da9072 P ff17f5cd05de4c33a6ee891f5458765d: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff17f5cd05de4c33a6ee891f5458765d" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38585 } } peers { permanent_uuid: "08a7b9b322144362a129e7de9e087ddc" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 40819 } } peers { permanent_uuid: "1a023ef861a042839a9fe00ee44e111e" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40781 } } }
I20260808 14:45:02.974660 1595 tablet_replica.cc:442] T 5954b0fea40549218b37f29333da9072 P ff17f5cd05de4c33a6ee891f5458765d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:45:02.974852 1625 tablet_bootstrap.cc:654] T 5954b0fea40549218b37f29333da9072 P 08a7b9b322144362a129e7de9e087ddc: Neither blocks nor log segments found. Creating new log.
I20260808 14:45:02.975572 1625 tablet_bootstrap.cc:492] T 5954b0fea40549218b37f29333da9072 P 08a7b9b322144362a129e7de9e087ddc: No bootstrap required, opened a new log
I20260808 14:45:02.975627 1625 ts_tablet_manager.cc:1397] T 5954b0fea40549218b37f29333da9072 P 08a7b9b322144362a129e7de9e087ddc: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 14:45:02.975772 1625 raft_consensus.cc:348] T 5954b0fea40549218b37f29333da9072 P 08a7b9b322144362a129e7de9e087ddc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff17f5cd05de4c33a6ee891f5458765d" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38585 } } peers { permanent_uuid: "08a7b9b322144362a129e7de9e087ddc" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 40819 } } peers { permanent_uuid: "1a023ef861a042839a9fe00ee44e111e" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40781 } }
I20260808 14:45:02.975828 1625 raft_consensus.cc:374] T 5954b0fea40549218b37f29333da9072 P 08a7b9b322144362a129e7de9e087ddc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:45:02.975840 1625 raft_consensus.cc:729] T 5954b0fea40549218b37f29333da9072 P 08a7b9b322144362a129e7de9e087ddc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08a7b9b322144362a129e7de9e087ddc, State: Initialized, Role: FOLLOWER
I20260808 14:45:02.975885 1625 consensus_queue.cc:260] T 5954b0fea40549218b37f29333da9072 P 08a7b9b322144362a129e7de9e087ddc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff17f5cd05de4c33a6ee891f5458765d" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38585 } } peers { permanent_uuid: "08a7b9b322144362a129e7de9e087ddc" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 40819 } } peers { permanent_uuid: "1a023ef861a042839a9fe00ee44e111e" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40781 } }
I20260808 14:45:02.975992 1625 ts_tablet_manager.cc:1428] T 5954b0fea40549218b37f29333da9072 P 08a7b9b322144362a129e7de9e087ddc: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:02.976073 1604 tablet_replica.cc:439] T 5954b0fea40549218b37f29333da9072 P 08a7b9b322144362a129e7de9e087ddc: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff17f5cd05de4c33a6ee891f5458765d" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38585 } } peers { permanent_uuid: "08a7b9b322144362a129e7de9e087ddc" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 40819 } } peers { permanent_uuid: "1a023ef861a042839a9fe00ee44e111e" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40781 } } }
I20260808 14:45:02.976176 1604 tablet_replica.cc:442] T 5954b0fea40549218b37f29333da9072 P 08a7b9b322144362a129e7de9e087ddc: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:45:03.083719 1588 raft_consensus.cc:482] T 5954b0fea40549218b37f29333da9072 P 1a023ef861a042839a9fe00ee44e111e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:45:03.083845 1588 raft_consensus.cc:504] T 5954b0fea40549218b37f29333da9072 P 1a023ef861a042839a9fe00ee44e111e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff17f5cd05de4c33a6ee891f5458765d" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38585 } } peers { permanent_uuid: "08a7b9b322144362a129e7de9e087ddc" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 40819 } } peers { permanent_uuid: "1a023ef861a042839a9fe00ee44e111e" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40781 } }
I20260808 14:45:03.084004 1588 leader_election.cc:288] T 5954b0fea40549218b37f29333da9072 P 1a023ef861a042839a9fe00ee44e111e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff17f5cd05de4c33a6ee891f5458765d (127.30.214.129:38585), 08a7b9b322144362a129e7de9e087ddc (127.30.214.130:40819)
I20260808 14:45:03.084265 1251 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5954b0fea40549218b37f29333da9072" candidate_uuid: "1a023ef861a042839a9fe00ee44e111e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08a7b9b322144362a129e7de9e087ddc" is_pre_election: true
I20260808 14:45:03.084265 1038 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5954b0fea40549218b37f29333da9072" candidate_uuid: "1a023ef861a042839a9fe00ee44e111e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff17f5cd05de4c33a6ee891f5458765d" is_pre_election: true
I20260808 14:45:03.084375 1251 raft_consensus.cc:2454] T 5954b0fea40549218b37f29333da9072 P 08a7b9b322144362a129e7de9e087ddc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a023ef861a042839a9fe00ee44e111e in term 0.
I20260808 14:45:03.084375 1038 raft_consensus.cc:2454] T 5954b0fea40549218b37f29333da9072 P ff17f5cd05de4c33a6ee891f5458765d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a023ef861a042839a9fe00ee44e111e in term 0.
I20260808 14:45:03.084542 1366 leader_election.cc:302] T 5954b0fea40549218b37f29333da9072 P 1a023ef861a042839a9fe00ee44e111e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a023ef861a042839a9fe00ee44e111e, ff17f5cd05de4c33a6ee891f5458765d; no voters:
I20260808 14:45:03.084650 1588 raft_consensus.cc:2781] T 5954b0fea40549218b37f29333da9072 P 1a023ef861a042839a9fe00ee44e111e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:45:03.084709 1588 raft_consensus.cc:482] T 5954b0fea40549218b37f29333da9072 P 1a023ef861a042839a9fe00ee44e111e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:45:03.084738 1588 raft_consensus.cc:3037] T 5954b0fea40549218b37f29333da9072 P 1a023ef861a042839a9fe00ee44e111e [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:03.085538 1588 raft_consensus.cc:504] T 5954b0fea40549218b37f29333da9072 P 1a023ef861a042839a9fe00ee44e111e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff17f5cd05de4c33a6ee891f5458765d" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38585 } } peers { permanent_uuid: "08a7b9b322144362a129e7de9e087ddc" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 40819 } } peers { permanent_uuid: "1a023ef861a042839a9fe00ee44e111e" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40781 } }
I20260808 14:45:03.085701 1588 leader_election.cc:288] T 5954b0fea40549218b37f29333da9072 P 1a023ef861a042839a9fe00ee44e111e [CANDIDATE]: Term 1 election: Requested vote from peers ff17f5cd05de4c33a6ee891f5458765d (127.30.214.129:38585), 08a7b9b322144362a129e7de9e087ddc (127.30.214.130:40819)
I20260808 14:45:03.085879 1038 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5954b0fea40549218b37f29333da9072" candidate_uuid: "1a023ef861a042839a9fe00ee44e111e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff17f5cd05de4c33a6ee891f5458765d"
I20260808 14:45:03.085886 1251 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5954b0fea40549218b37f29333da9072" candidate_uuid: "1a023ef861a042839a9fe00ee44e111e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08a7b9b322144362a129e7de9e087ddc"
I20260808 14:45:03.085965 1251 raft_consensus.cc:3037] T 5954b0fea40549218b37f29333da9072 P 08a7b9b322144362a129e7de9e087ddc [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:03.085964 1038 raft_consensus.cc:3037] T 5954b0fea40549218b37f29333da9072 P ff17f5cd05de4c33a6ee891f5458765d [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:03.086710 1251 raft_consensus.cc:2454] T 5954b0fea40549218b37f29333da9072 P 08a7b9b322144362a129e7de9e087ddc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a023ef861a042839a9fe00ee44e111e in term 1.
I20260808 14:45:03.086745 1038 raft_consensus.cc:2454] T 5954b0fea40549218b37f29333da9072 P ff17f5cd05de4c33a6ee891f5458765d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a023ef861a042839a9fe00ee44e111e in term 1.
I20260808 14:45:03.086906 1368 leader_election.cc:302] T 5954b0fea40549218b37f29333da9072 P 1a023ef861a042839a9fe00ee44e111e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08a7b9b322144362a129e7de9e087ddc, 1a023ef861a042839a9fe00ee44e111e; no voters:
I20260808 14:45:03.087065 1588 raft_consensus.cc:2781] T 5954b0fea40549218b37f29333da9072 P 1a023ef861a042839a9fe00ee44e111e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:45:03.087129 1588 raft_consensus.cc:686] T 5954b0fea40549218b37f29333da9072 P 1a023ef861a042839a9fe00ee44e111e [term 1 LEADER]: Becoming Leader. State: Replica: 1a023ef861a042839a9fe00ee44e111e, State: Running, Role: LEADER
I20260808 14:45:03.087175 1588 consensus_queue.cc:237] T 5954b0fea40549218b37f29333da9072 P 1a023ef861a042839a9fe00ee44e111e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff17f5cd05de4c33a6ee891f5458765d" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38585 } } peers { permanent_uuid: "08a7b9b322144362a129e7de9e087ddc" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 40819 } } peers { permanent_uuid: "1a023ef861a042839a9fe00ee44e111e" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40781 } }
I20260808 14:45:03.087494 1582 tablet_replica.cc:439] T 5954b0fea40549218b37f29333da9072 P 1a023ef861a042839a9fe00ee44e111e: TxnStatusTablet state changed. Reason: New leader 1a023ef861a042839a9fe00ee44e111e. Latest consensus state: current_term: 1 leader_uuid: "1a023ef861a042839a9fe00ee44e111e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff17f5cd05de4c33a6ee891f5458765d" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38585 } } peers { permanent_uuid: "08a7b9b322144362a129e7de9e087ddc" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 40819 } } peers { permanent_uuid: "1a023ef861a042839a9fe00ee44e111e" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40781 } } }
I20260808 14:45:03.087585 1582 tablet_replica.cc:442] T 5954b0fea40549218b37f29333da9072 P 1a023ef861a042839a9fe00ee44e111e: This TxnStatusTablet replica's current role is: LEADER
I20260808 14:45:03.087774 1654 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 14:45:03.087867 1654 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 14:45:03.087837 791 catalog_manager.cc:5495] T 5954b0fea40549218b37f29333da9072 P 1a023ef861a042839a9fe00ee44e111e reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a023ef861a042839a9fe00ee44e111e (127.30.214.131). New cstate: current_term: 1 leader_uuid: "1a023ef861a042839a9fe00ee44e111e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff17f5cd05de4c33a6ee891f5458765d" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08a7b9b322144362a129e7de9e087ddc" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 40819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a023ef861a042839a9fe00ee44e111e" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40781 } health_report { overall_health: HEALTHY } } }
I20260808 14:45:03.120683 1593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:03.118401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48220 (local address 127.30.214.131:40781)
0808 14:45:03.118454 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:03.118456 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:03.118462 (+ 6us) server_negotiation.cc:407] Connection header received
0808 14:45:03.118484 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:03.118485 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:03.118494 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:03.118540 (+ 46us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:45:03.118687 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:03.119167 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:03.119923 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:03.120113 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:03.120168 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:03.120365 (+ 197us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:45:03.120402 (+ 37us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:45:03.120448 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:03.120552 (+ 104us) server_negotiation.cc:299] Negotiation successful
0808 14:45:03.120598 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 14:45:03.120688 1641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:03.118180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.131:40781 (local address 127.0.0.1:48220)
0808 14:45:03.118262 (+ 82us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:03.118274 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:03.118320 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:03.118569 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:03.118570 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:03.118572 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 14:45:03.118629 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:03.118631 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:03.119241 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:03.119242 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:03.119841 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:03.119843 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:03.120173 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:03.120174 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:03.120240 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:03.120259 (+ 19us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 14:45:03.120468 (+ 209us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 14:45:03.120483 (+ 15us) client_negotiation.cc:769] Sending connection context
0808 14:45:03.120543 (+ 60us) client_negotiation.cc:240] Negotiation successful
0808 14:45:03.120601 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260808 14:45:03.121838 1038 raft_consensus.cc:1261] T 5954b0fea40549218b37f29333da9072 P ff17f5cd05de4c33a6ee891f5458765d [term 1 FOLLOWER]: Refusing update from remote peer 1a023ef861a042839a9fe00ee44e111e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:45:03.121838 1251 raft_consensus.cc:1261] T 5954b0fea40549218b37f29333da9072 P 08a7b9b322144362a129e7de9e087ddc [term 1 FOLLOWER]: Refusing update from remote peer 1a023ef861a042839a9fe00ee44e111e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:45:03.122076 1588 consensus_queue.cc:1035] T 5954b0fea40549218b37f29333da9072 P 1a023ef861a042839a9fe00ee44e111e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff17f5cd05de4c33a6ee891f5458765d" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:45:03.122187 1582 consensus_queue.cc:1035] T 5954b0fea40549218b37f29333da9072 P 1a023ef861a042839a9fe00ee44e111e [LEADER]: Connected to new peer: Peer: permanent_uuid: "08a7b9b322144362a129e7de9e087ddc" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 40819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:45:03.122785 1604 tablet_replica.cc:439] T 5954b0fea40549218b37f29333da9072 P 08a7b9b322144362a129e7de9e087ddc: TxnStatusTablet state changed. Reason: New leader 1a023ef861a042839a9fe00ee44e111e. Latest consensus state: current_term: 1 leader_uuid: "1a023ef861a042839a9fe00ee44e111e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff17f5cd05de4c33a6ee891f5458765d" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38585 } } peers { permanent_uuid: "08a7b9b322144362a129e7de9e087ddc" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 40819 } } peers { permanent_uuid: "1a023ef861a042839a9fe00ee44e111e" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40781 } } }
I20260808 14:45:03.122888 1604 tablet_replica.cc:442] T 5954b0fea40549218b37f29333da9072 P 08a7b9b322144362a129e7de9e087ddc: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:45:03.122895 1595 tablet_replica.cc:439] T 5954b0fea40549218b37f29333da9072 P ff17f5cd05de4c33a6ee891f5458765d: TxnStatusTablet state changed. Reason: New leader 1a023ef861a042839a9fe00ee44e111e. Latest consensus state: current_term: 1 leader_uuid: "1a023ef861a042839a9fe00ee44e111e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff17f5cd05de4c33a6ee891f5458765d" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38585 } } peers { permanent_uuid: "08a7b9b322144362a129e7de9e087ddc" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 40819 } } peers { permanent_uuid: "1a023ef861a042839a9fe00ee44e111e" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40781 } } }
I20260808 14:45:03.122988 1595 tablet_replica.cc:442] T 5954b0fea40549218b37f29333da9072 P ff17f5cd05de4c33a6ee891f5458765d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:45:03.123373 1582 tablet_replica.cc:439] T 5954b0fea40549218b37f29333da9072 P 1a023ef861a042839a9fe00ee44e111e: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1a023ef861a042839a9fe00ee44e111e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff17f5cd05de4c33a6ee891f5458765d" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38585 } } peers { permanent_uuid: "08a7b9b322144362a129e7de9e087ddc" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 40819 } } peers { permanent_uuid: "1a023ef861a042839a9fe00ee44e111e" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40781 } } }
I20260808 14:45:03.123456 1582 tablet_replica.cc:442] T 5954b0fea40549218b37f29333da9072 P 1a023ef861a042839a9fe00ee44e111e: This TxnStatusTablet replica's current role is: LEADER
I20260808 14:45:03.123549 1595 tablet_replica.cc:439] T 5954b0fea40549218b37f29333da9072 P ff17f5cd05de4c33a6ee891f5458765d: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1a023ef861a042839a9fe00ee44e111e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff17f5cd05de4c33a6ee891f5458765d" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38585 } } peers { permanent_uuid: "08a7b9b322144362a129e7de9e087ddc" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 40819 } } peers { permanent_uuid: "1a023ef861a042839a9fe00ee44e111e" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40781 } } }
I20260808 14:45:03.123623 1595 tablet_replica.cc:442] T 5954b0fea40549218b37f29333da9072 P ff17f5cd05de4c33a6ee891f5458765d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:45:03.124323 1588 tablet_replica.cc:439] T 5954b0fea40549218b37f29333da9072 P 1a023ef861a042839a9fe00ee44e111e: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1a023ef861a042839a9fe00ee44e111e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff17f5cd05de4c33a6ee891f5458765d" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38585 } } peers { permanent_uuid: "08a7b9b322144362a129e7de9e087ddc" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 40819 } } peers { permanent_uuid: "1a023ef861a042839a9fe00ee44e111e" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40781 } } }
I20260808 14:45:03.124398 1588 tablet_replica.cc:442] T 5954b0fea40549218b37f29333da9072 P 1a023ef861a042839a9fe00ee44e111e: This TxnStatusTablet replica's current role is: LEADER
I20260808 14:45:03.124579 1605 mvcc.cc:205] Tried to move back new op lower bound from 7316276441585102848 to 7316276441445351424. Current Snapshot: MvccSnapshot[applied={T|T < 7316276441585102848}]
I20260808 14:45:03.124756 1604 tablet_replica.cc:439] T 5954b0fea40549218b37f29333da9072 P 08a7b9b322144362a129e7de9e087ddc: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1a023ef861a042839a9fe00ee44e111e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff17f5cd05de4c33a6ee891f5458765d" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38585 } } peers { permanent_uuid: "08a7b9b322144362a129e7de9e087ddc" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 40819 } } peers { permanent_uuid: "1a023ef861a042839a9fe00ee44e111e" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40781 } } }
I20260808 14:45:03.124837 1604 tablet_replica.cc:442] T 5954b0fea40549218b37f29333da9072 P 08a7b9b322144362a129e7de9e087ddc: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:45:03.129297 1659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:03.126647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59080 (local address 127.30.214.129:38585)
0808 14:45:03.126813 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:03.126815 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:03.126823 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:45:03.126862 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:03.126862 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:03.126880 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:03.126948 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:45:03.127072 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:03.127554 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:03.128581 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:03.128785 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:03.128832 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:03.128988 (+ 156us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:45:03.129097 (+ 109us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:45:03.129146 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:03.129205 (+ 59us) server_negotiation.cc:299] Negotiation successful
0808 14:45:03.129223 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":98,"threads_started":1}
I20260808 14:45:03.135257 1662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:03.132099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.131:40781 (local address 127.30.214.129:40273)
0808 14:45:03.132253 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:03.132264 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:03.132323 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:03.132478 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:03.132480 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:03.132481 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 14:45:03.132550 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:03.132552 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:03.133478 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:03.133479 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:03.134414 (+ 935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:03.134417 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:03.134884 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:03.134885 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:03.134934 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:03.134951 (+ 17us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 14:45:03.135111 (+ 160us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 14:45:03.135112 (+ 1us) client_negotiation.cc:769] Sending connection context
0808 14:45:03.135141 (+ 29us) client_negotiation.cc:240] Negotiation successful
0808 14:45:03.135180 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":71,"threads_started":1}
I20260808 14:45:03.135252 1593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:03.132195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.129:40273 (local address 127.30.214.131:40781)
0808 14:45:03.132250 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:03.132252 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:03.132309 (+ 57us) server_negotiation.cc:407] Connection header received
0808 14:45:03.132381 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:03.132382 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:03.132394 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:03.132445 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:45:03.132614 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:03.133346 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:03.134504 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:03.134814 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:03.134886 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:03.135022 (+ 136us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:45:03.135058 (+ 36us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:45:03.135101 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:03.135145 (+ 44us) server_negotiation.cc:299] Negotiation successful
0808 14:45:03.135167 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260808 14:45:03.137984 1465 raft_consensus.cc:1261] T 85d90ee3b026423188085b1b82ee68d5 P 1a023ef861a042839a9fe00ee44e111e [term 1 FOLLOWER]: Refusing update from remote peer ff17f5cd05de4c33a6ee891f5458765d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:45:03.137964 1251 raft_consensus.cc:1261] T 85d90ee3b026423188085b1b82ee68d5 P 08a7b9b322144362a129e7de9e087ddc [term 1 FOLLOWER]: Refusing update from remote peer ff17f5cd05de4c33a6ee891f5458765d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:45:03.138288 1631 consensus_queue.cc:1035] T 85d90ee3b026423188085b1b82ee68d5 P ff17f5cd05de4c33a6ee891f5458765d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a023ef861a042839a9fe00ee44e111e" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:45:03.138430 1595 consensus_queue.cc:1035] T 85d90ee3b026423188085b1b82ee68d5 P ff17f5cd05de4c33a6ee891f5458765d [LEADER]: Connected to new peer: Peer: permanent_uuid: "08a7b9b322144362a129e7de9e087ddc" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 40819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:45:03.147763 1669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:03.144442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.129:38585 (local address 127.30.214.131:32841)
0808 14:45:03.144601 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:03.144612 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:03.144668 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:03.144787 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:03.144788 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:03.144789 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 14:45:03.144839 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:03.144840 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:03.145697 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:03.145698 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:03.146839 (+ 1141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:03.146843 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:03.147320 (+ 477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:03.147321 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:03.147379 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:03.147400 (+ 21us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 14:45:03.147571 (+ 171us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 14:45:03.147572 (+ 1us) client_negotiation.cc:769] Sending connection context
0808 14:45:03.147617 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 14:45:03.147676 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":78,"threads_started":1}
I20260808 14:45:03.147758 1659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:03.144542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:32841 (local address 127.30.214.129:38585)
0808 14:45:03.144582 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:03.144584 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:03.144660 (+ 76us) server_negotiation.cc:407] Connection header received
0808 14:45:03.144712 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:03.144713 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:03.144724 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:03.144785 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:45:03.144874 (+ 89us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:03.145605 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:03.146936 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:03.147220 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:03.147261 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:03.147474 (+ 213us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:45:03.147512 (+ 38us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:45:03.147565 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:03.147661 (+ 96us) server_negotiation.cc:299] Negotiation successful
0808 14:45:03.147680 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 14:45:03.162397 791 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49046:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:45:03.162534 791 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49046:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:45:03.163252 791 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6a0f85da59644795976bbf35c1979cbb: Sending DeleteTablet for 3 replicas of tablet 85d90ee3b026423188085b1b82ee68d5
I20260808 14:45:03.163609 999 tablet_service.cc:1514] Processing DeleteTablet for tablet 85d90ee3b026423188085b1b82ee68d5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:45:03 UTC) from {username='kudu', principal='kudu/127.30.214.190@KRBTEST.COM'} at 127.0.0.1:59076
I20260808 14:45:03.163621 1219 tablet_service.cc:1514] Processing DeleteTablet for tablet 85d90ee3b026423188085b1b82ee68d5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:45:03 UTC) from {username='kudu', principal='kudu/127.30.214.190@KRBTEST.COM'} at 127.0.0.1:41242
I20260808 14:45:03.163708 1611 tablet_replica.cc:330] T 85d90ee3b026423188085b1b82ee68d5 P ff17f5cd05de4c33a6ee891f5458765d: stopping tablet replica
I20260808 14:45:03.163714 1613 tablet_replica.cc:330] T 85d90ee3b026423188085b1b82ee68d5 P 08a7b9b322144362a129e7de9e087ddc: stopping tablet replica
I20260808 14:45:03.163754 1611 raft_consensus.cc:2229] T 85d90ee3b026423188085b1b82ee68d5 P ff17f5cd05de4c33a6ee891f5458765d [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:45:03.163764 1613 raft_consensus.cc:2229] T 85d90ee3b026423188085b1b82ee68d5 P 08a7b9b322144362a129e7de9e087ddc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:45:03.163813 1613 raft_consensus.cc:2258] T 85d90ee3b026423188085b1b82ee68d5 P 08a7b9b322144362a129e7de9e087ddc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:45:03.163848 1611 raft_consensus.cc:2258] T 85d90ee3b026423188085b1b82ee68d5 P ff17f5cd05de4c33a6ee891f5458765d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:45:03.164172 1613 ts_tablet_manager.cc:1905] T 85d90ee3b026423188085b1b82ee68d5 P 08a7b9b322144362a129e7de9e087ddc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:45:03.164397 1611 ts_tablet_manager.cc:1905] T 85d90ee3b026423188085b1b82ee68d5 P ff17f5cd05de4c33a6ee891f5458765d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:45:03.165901 1613 ts_tablet_manager.cc:1918] T 85d90ee3b026423188085b1b82ee68d5 P 08a7b9b322144362a129e7de9e087ddc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:45:03.165961 1613 log.cc:1196] T 85d90ee3b026423188085b1b82ee68d5 P 08a7b9b322144362a129e7de9e087ddc: Deleting WAL directory at /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/minicluster-data/ts-1/wal/wals/85d90ee3b026423188085b1b82ee68d5
I20260808 14:45:03.166177 1613 ts_tablet_manager.cc:1939] T 85d90ee3b026423188085b1b82ee68d5 P 08a7b9b322144362a129e7de9e087ddc: Deleting consensus metadata
I20260808 14:45:03.166225 1611 ts_tablet_manager.cc:1918] T 85d90ee3b026423188085b1b82ee68d5 P ff17f5cd05de4c33a6ee891f5458765d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:45:03.166298 1611 log.cc:1196] T 85d90ee3b026423188085b1b82ee68d5 P ff17f5cd05de4c33a6ee891f5458765d: Deleting WAL directory at /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/minicluster-data/ts-0/wal/wals/85d90ee3b026423188085b1b82ee68d5
I20260808 14:45:03.166501 1611 ts_tablet_manager.cc:1939] T 85d90ee3b026423188085b1b82ee68d5 P ff17f5cd05de4c33a6ee891f5458765d: Deleting consensus metadata
I20260808 14:45:03.166531 771 catalog_manager.cc:4841] TS 08a7b9b322144362a129e7de9e087ddc (127.30.214.130:40819): tablet 85d90ee3b026423188085b1b82ee68d5 (table test-table [id=c8af5d2af73e4b3d8008b0bc6cf8a76f]) successfully deleted
I20260808 14:45:03.167028 769 catalog_manager.cc:4841] TS ff17f5cd05de4c33a6ee891f5458765d (127.30.214.129:38585): tablet 85d90ee3b026423188085b1b82ee68d5 (table test-table [id=c8af5d2af73e4b3d8008b0bc6cf8a76f]) successfully deleted
I20260808 14:45:03.167943 1441 tablet_service.cc:1514] Processing DeleteTablet for tablet 85d90ee3b026423188085b1b82ee68d5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:45:03 UTC) from {username='kudu', principal='kudu/127.30.214.190@KRBTEST.COM'} at 127.0.0.1:48190
I20260808 14:45:03.168074 1612 tablet_replica.cc:330] T 85d90ee3b026423188085b1b82ee68d5 P 1a023ef861a042839a9fe00ee44e111e: stopping tablet replica
I20260808 14:45:03.168129 1612 raft_consensus.cc:2229] T 85d90ee3b026423188085b1b82ee68d5 P 1a023ef861a042839a9fe00ee44e111e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:45:03.168185 1612 raft_consensus.cc:2258] T 85d90ee3b026423188085b1b82ee68d5 P 1a023ef861a042839a9fe00ee44e111e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:45:03.168601 1612 ts_tablet_manager.cc:1905] T 85d90ee3b026423188085b1b82ee68d5 P 1a023ef861a042839a9fe00ee44e111e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:45:03.170383 1612 ts_tablet_manager.cc:1918] T 85d90ee3b026423188085b1b82ee68d5 P 1a023ef861a042839a9fe00ee44e111e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:45:03.170454 1612 log.cc:1196] T 85d90ee3b026423188085b1b82ee68d5 P 1a023ef861a042839a9fe00ee44e111e: Deleting WAL directory at /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786200295877777-31578-0/minicluster-data/ts-2/wal/wals/85d90ee3b026423188085b1b82ee68d5
I20260808 14:45:03.170691 1612 ts_tablet_manager.cc:1939] T 85d90ee3b026423188085b1b82ee68d5 P 1a023ef861a042839a9fe00ee44e111e: Deleting consensus metadata
I20260808 14:45:03.171077 769 catalog_manager.cc:4841] TS 1a023ef861a042839a9fe00ee44e111e (127.30.214.131:40781): tablet 85d90ee3b026423188085b1b82ee68d5 (table test-table [id=c8af5d2af73e4b3d8008b0bc6cf8a76f]) successfully deleted
Aug 08 14:45:03 dist-test-slave-42z9 krb5kdc[727](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200302, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.30.214.129@KRBTEST.COM
I20260808 14:45:03.180153 1659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:03.168092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59090 (local address 127.30.214.129:38585)
0808 14:45:03.168134 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:03.168136 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:03.169684 (+ 1548us) server_negotiation.cc:407] Connection header received
0808 14:45:03.169783 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:03.169784 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:03.169795 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:03.169826 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:03.170674 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:03.171417 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:03.172573 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:03.172871 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:03.172958 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:03.176642 (+ 3684us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:03.176651 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:03.176652 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:03.176661 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:03.178748 (+ 2087us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:03.179210 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:03.179213 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:03.179214 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:03.179303 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:03.179521 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:03.179522 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:03.179523 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:03.179708 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:03.179864 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:03.179940 (+ 76us) server_negotiation.cc:299] Negotiation successful
0808 14:45:03.180036 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
W20260808 14:45:03.180645 1096 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59090
I20260808 14:45:03.190826 1642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:03.182105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49062 (local address 127.30.214.190:40329)
0808 14:45:03.182187 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:03.182189 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:03.182281 (+ 92us) server_negotiation.cc:407] Connection header received
0808 14:45:03.182340 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:03.182341 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:03.182356 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:03.182428 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:03.183445 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:03.184274 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:03.185633 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:03.186025 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:03.186105 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:03.187747 (+ 1642us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:03.187748 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:03.187748 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:03.187756 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:03.189528 (+ 1772us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:03.189958 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:03.189959 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:03.189960 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:03.190022 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:03.190229 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:03.190229 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:03.190230 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:03.190375 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:03.190478 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:03.190612 (+ 134us) server_negotiation.cc:299] Negotiation successful
0808 14:45:03.190712 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
W20260808 14:45:03.191387 791 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49062
I20260808 14:45:03.192037 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 907
I20260808 14:45:03.208828 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 1119
I20260808 14:45:03.220606 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 1337
I20260808 14:45:03.233948 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 749
2026-08-08T14:45:03Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (3064 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:45:03 dist-test-slave-42z9 krb5kdc[1685](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:45:03 dist-test-slave-42z9 krb5kdc[1685](info): set up 2 sockets
Aug 08 14:45:03 dist-test-slave-42z9 krb5kdc[1685](info): commencing operation
krb5kdc: starting...
W20260808 14:45:04.371726 31578 mini_kdc.cc:121] Time spent starting KDC: real 1.110s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Aug 08 14:45:04 dist-test-slave-42z9 krb5kdc[1685](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200304, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:45:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:45:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.214.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab.
Entry for principal kudu/127.30.214.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab.
I20260808 14:45:04.494163 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:41303
--webserver_interface=127.30.214.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab
--principal=kudu/127.30.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:39301
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.214.190:41303
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:45:04.577591 1705 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:45:04.577872 1705 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:45:04.577912 1705 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:45:04.579156 1705 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:45:04.579203 1705 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 14:45:04.579221 1705 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:45:04.579238 1705 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:45:04.579253 1705 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:45:04.579270 1705 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:45:04.580895 1705 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:39301
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.214.190:41303
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab
--principal=kudu/127.30.214.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:41303
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1705
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:45:04.581178 1705 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:45:04.581401 1705 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:45:04.586616 1718 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:04.586637 1713 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:04.586639 1712 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:04.586907 1705 server_base.cc:1034] running on GCE node
I20260808 14:45:04.587175 1705 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:45:04.587453 1705 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:45:04.588600 1705 hybrid_clock.cc:648] HybridClock initialized: now 1786200304588589 us; error 38 us; skew 500 ppm
Aug 08 14:45:04 dist-test-slave-42z9 krb5kdc[1685](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200304, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:45:04.591148 1705 init.cc:377] Logged in from keytab as kudu/127.30.214.190@KRBTEST.COM (short username kudu)
I20260808 14:45:04.591595 1705 webserver.cc:460] Webserver started at http://127.30.214.190:36497/ using document root <none> and password file <none>
I20260808 14:45:04.591797 1705 fs_manager.cc:359] Metadata directory not provided
I20260808 14:45:04.591843 1705 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:45:04.591975 1705 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:45:04.593027 1705 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/master-0/data/instance:
uuid: "74f16d9037bd49b8bdfa995713fd362a"
format_stamp: "Formatted at 2026-08-08 14:45:04 on dist-test-slave-42z9"
server_key: "6dab4118db0833933f02a77d33677ea9"
server_key_iv: "60d5f1ad81dd6075623dae995f4a813e"
server_key_version: "encryptionkey@0"
I20260808 14:45:04.593367 1705 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/master-0/wal/instance:
uuid: "74f16d9037bd49b8bdfa995713fd362a"
format_stamp: "Formatted at 2026-08-08 14:45:04 on dist-test-slave-42z9"
server_key: "6dab4118db0833933f02a77d33677ea9"
server_key_iv: "60d5f1ad81dd6075623dae995f4a813e"
server_key_version: "encryptionkey@0"
I20260808 14:45:04.594719 1705 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:45:04.595438 1727 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:04.595593 1705 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:45:04.595681 1705 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/master-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/master-0/wal
uuid: "74f16d9037bd49b8bdfa995713fd362a"
format_stamp: "Formatted at 2026-08-08 14:45:04 on dist-test-slave-42z9"
server_key: "6dab4118db0833933f02a77d33677ea9"
server_key_iv: "60d5f1ad81dd6075623dae995f4a813e"
server_key_version: "encryptionkey@0"
I20260808 14:45:04.595748 1705 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:45:04.611591 1705 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:45:04.613865 1705 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:45:04.614014 1705 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:45:04.618724 1705 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.190:41303
I20260808 14:45:04.618809 1828 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.190:41303 every 8 connection(s)
I20260808 14:45:04.619112 1705 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
I20260808 14:45:04.619833 1829 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:45:04.619835 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 1705
I20260808 14:45:04.619907 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/master-0/wal/instance
I20260808 14:45:04.620077 31578 external_mini_cluster.cc:1428] Setting key 47816b32f12219b915288d57194d5483
I20260808 14:45:04.623598 1829 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 74f16d9037bd49b8bdfa995713fd362a: Bootstrap starting.
I20260808 14:45:04.624207 1829 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 74f16d9037bd49b8bdfa995713fd362a: Neither blocks nor log segments found. Creating new log.
I20260808 14:45:04.624537 1829 log.cc:824] T 00000000000000000000000000000000 P 74f16d9037bd49b8bdfa995713fd362a: Log is configured to *not* fsync() on all Append() calls
I20260808 14:45:04.625262 1829 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 74f16d9037bd49b8bdfa995713fd362a: No bootstrap required, opened a new log
Aug 08 14:45:04 dist-test-slave-42z9 krb5kdc[1685](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200304, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:45:04.627498 1829 raft_consensus.cc:348] T 00000000000000000000000000000000 P 74f16d9037bd49b8bdfa995713fd362a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74f16d9037bd49b8bdfa995713fd362a" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41303 } }
I20260808 14:45:04.627668 1829 raft_consensus.cc:374] T 00000000000000000000000000000000 P 74f16d9037bd49b8bdfa995713fd362a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:45:04.627691 1829 raft_consensus.cc:729] T 00000000000000000000000000000000 P 74f16d9037bd49b8bdfa995713fd362a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74f16d9037bd49b8bdfa995713fd362a, State: Initialized, Role: FOLLOWER
I20260808 14:45:04.627816 1829 consensus_queue.cc:260] T 00000000000000000000000000000000 P 74f16d9037bd49b8bdfa995713fd362a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74f16d9037bd49b8bdfa995713fd362a" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41303 } }
I20260808 14:45:04.627897 1829 raft_consensus.cc:388] T 00000000000000000000000000000000 P 74f16d9037bd49b8bdfa995713fd362a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:45:04.627935 1829 raft_consensus.cc:482] T 00000000000000000000000000000000 P 74f16d9037bd49b8bdfa995713fd362a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:45:04.627987 1829 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 74f16d9037bd49b8bdfa995713fd362a [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:04.628722 1829 raft_consensus.cc:504] T 00000000000000000000000000000000 P 74f16d9037bd49b8bdfa995713fd362a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74f16d9037bd49b8bdfa995713fd362a" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41303 } }
I20260808 14:45:04.628834 1829 leader_election.cc:302] T 00000000000000000000000000000000 P 74f16d9037bd49b8bdfa995713fd362a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 74f16d9037bd49b8bdfa995713fd362a; no voters:
I20260808 14:45:04.629037 1829 leader_election.cc:288] T 00000000000000000000000000000000 P 74f16d9037bd49b8bdfa995713fd362a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:45:04.629122 1835 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 74f16d9037bd49b8bdfa995713fd362a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:45:04.629356 1835 raft_consensus.cc:686] T 00000000000000000000000000000000 P 74f16d9037bd49b8bdfa995713fd362a [term 1 LEADER]: Becoming Leader. State: Replica: 74f16d9037bd49b8bdfa995713fd362a, State: Running, Role: LEADER
I20260808 14:45:04.629379 1829 sys_catalog.cc:564] T 00000000000000000000000000000000 P 74f16d9037bd49b8bdfa995713fd362a [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:45:04.629518 1835 consensus_queue.cc:237] T 00000000000000000000000000000000 P 74f16d9037bd49b8bdfa995713fd362a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74f16d9037bd49b8bdfa995713fd362a" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41303 } }
I20260808 14:45:04.630122 1838 sys_catalog.cc:455] T 00000000000000000000000000000000 P 74f16d9037bd49b8bdfa995713fd362a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "74f16d9037bd49b8bdfa995713fd362a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74f16d9037bd49b8bdfa995713fd362a" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41303 } } }
I20260808 14:45:04.630234 1838 sys_catalog.cc:458] T 00000000000000000000000000000000 P 74f16d9037bd49b8bdfa995713fd362a [sys.catalog]: This master's current role is: LEADER
I20260808 14:45:04.630308 1835 sys_catalog.cc:455] T 00000000000000000000000000000000 P 74f16d9037bd49b8bdfa995713fd362a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 74f16d9037bd49b8bdfa995713fd362a. Latest consensus state: current_term: 1 leader_uuid: "74f16d9037bd49b8bdfa995713fd362a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74f16d9037bd49b8bdfa995713fd362a" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41303 } } }
I20260808 14:45:04.630388 1835 sys_catalog.cc:458] T 00000000000000000000000000000000 P 74f16d9037bd49b8bdfa995713fd362a [sys.catalog]: This master's current role is: LEADER
I20260808 14:45:04.630481 1852 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:45:04.631047 1852 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:45:04.632889 1852 catalog_manager.cc:1347] Generated new cluster ID: 46d078d7c8844c7b9702e34cfb370634
I20260808 14:45:04.632897 1833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:04.620595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57782 (local address 127.30.214.190:41303)
0808 14:45:04.620766 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:04.620775 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:04.620810 (+ 35us) server_negotiation.cc:407] Connection header received
0808 14:45:04.621255 (+ 445us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:04.621265 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:04.621329 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:04.621534 (+ 205us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:04.622105 (+ 571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:04.623454 (+ 1349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:04.624277 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:04.624865 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:04.624968 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:04.627862 (+ 2894us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:04.627870 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:04.627870 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:04.627892 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:04.630280 (+ 2388us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:04.630778 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:04.630781 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:04.630781 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:04.630895 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:04.631122 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:04.631123 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:04.631123 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:04.631510 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:04.632415 (+ 905us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:04.632521 (+ 106us) server_negotiation.cc:299] Negotiation successful
0808 14:45:04.632695 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":70,"threads_started":1}
I20260808 14:45:04.632956 1852 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:45:04.645009 1852 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:45:04.645605 1852 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:45:04.648386 1852 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 74f16d9037bd49b8bdfa995713fd362a: Generated new TSK 0
I20260808 14:45:04.648589 1852 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.214.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab.
Entry for principal kudu/127.30.214.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab.
I20260808 14:45:04.678301 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.129:0
--local_ip_for_outbound_sockets=127.30.214.129
--webserver_interface=127.30.214.129
--webserver_port=0
--tserver_master_addrs=127.30.214.190:41303
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab
--principal=kudu/127.30.214.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:39301
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:45:04.772310 1873 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:45:04.772555 1873 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:45:04.772588 1873 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:45:04.774266 1873 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:45:04.774314 1873 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:45:04.774335 1873 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 14:45:04.774346 1873 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 14:45:04.774365 1873 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.129
I20260808 14:45:04.776013 1873 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:39301
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab
--principal=kudu/127.30.214.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.214.129
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.30.214.190:41303
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1873
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.129
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:45:04.776273 1873 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:45:04.776526 1873 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:45:04.781795 1891 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:04.781872 1887 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:04.781908 1886 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:04.782019 1873 server_base.cc:1034] running on GCE node
I20260808 14:45:04.782315 1873 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:45:04.782557 1873 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:45:04.783717 1873 hybrid_clock.cc:648] HybridClock initialized: now 1786200304783702 us; error 33 us; skew 500 ppm
Aug 08 14:45:04 dist-test-slave-42z9 krb5kdc[1685](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200304, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:45:04.786315 1873 init.cc:377] Logged in from keytab as kudu/127.30.214.129@KRBTEST.COM (short username kudu)
I20260808 14:45:04.786757 1873 webserver.cc:460] Webserver started at http://127.30.214.129:33429/ using document root <none> and password file <none>
I20260808 14:45:04.786965 1873 fs_manager.cc:359] Metadata directory not provided
I20260808 14:45:04.787006 1873 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:45:04.787102 1873 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:45:04.788139 1873 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/ts-0/data/instance:
uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4"
format_stamp: "Formatted at 2026-08-08 14:45:04 on dist-test-slave-42z9"
server_key: "7f9f94a49c665e7d5707e48f00ea6f80"
server_key_iv: "4393641ebd09e37fd2b39aff7b021f63"
server_key_version: "encryptionkey@0"
I20260808 14:45:04.788437 1873 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/ts-0/wal/instance:
uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4"
format_stamp: "Formatted at 2026-08-08 14:45:04 on dist-test-slave-42z9"
server_key: "7f9f94a49c665e7d5707e48f00ea6f80"
server_key_iv: "4393641ebd09e37fd2b39aff7b021f63"
server_key_version: "encryptionkey@0"
I20260808 14:45:04.789770 1873 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 14:45:04.790467 1903 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:04.790647 1873 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:45:04.790736 1873 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/ts-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/ts-0/wal
uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4"
format_stamp: "Formatted at 2026-08-08 14:45:04 on dist-test-slave-42z9"
server_key: "7f9f94a49c665e7d5707e48f00ea6f80"
server_key_iv: "4393641ebd09e37fd2b39aff7b021f63"
server_key_version: "encryptionkey@0"
I20260808 14:45:04.790798 1873 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:45:04.808461 1873 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:45:04.810434 1873 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:45:04.810564 1873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:45:04.811058 1873 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:45:04.811098 1873 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:04.811123 1873 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:45:04.811136 1873 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:04.817836 1873 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.129:34173
I20260808 14:45:04.817950 2085 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.129:34173 every 8 connection(s)
Aug 08 14:45:04 dist-test-slave-42z9 krb5kdc[1685](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200304, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.129@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:45:04.818246 1873 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
I20260808 14:45:04.821345 1833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:04.811548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.129:47697 (local address 127.30.214.190:41303)
0808 14:45:04.811595 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:04.811597 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:04.811885 (+ 288us) server_negotiation.cc:407] Connection header received
0808 14:45:04.812400 (+ 515us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:04.812401 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:04.812414 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:04.812468 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:04.813327 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:04.814145 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:04.815697 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:04.815998 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:04.816092 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:04.818739 (+ 2647us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:04.818741 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:04.818742 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:04.818749 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:04.820121 (+ 1372us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:04.820582 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:04.820583 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:04.820583 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:04.820641 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:04.820830 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:04.820830 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:04.820831 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:04.820935 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:04.820980 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:04.821207 (+ 227us) server_negotiation.cc:299] Negotiation successful
0808 14:45:04.821279 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 14:45:04.821576 1915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:04.811516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:41303 (local address 127.30.214.129:47697)
0808 14:45:04.811753 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:04.811795 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:04.812300 (+ 505us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:04.812548 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:04.812552 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:04.812909 (+ 357us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:04.813202 (+ 293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:04.813209 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:04.814254 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:04.814254 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:04.815567 (+ 1313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:04.815570 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:04.816099 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:04.816100 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:04.816223 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:04.816793 (+ 570us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:04.816804 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:04.818632 (+ 1828us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:04.820217 (+ 1585us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:04.820268 (+ 51us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:04.820272 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:04.820519 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:04.820690 (+ 171us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:04.820691 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:04.820691 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:04.820786 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:04.820984 (+ 198us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:04.820987 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:04.821107 (+ 120us) client_negotiation.cc:769] Sending connection context
0808 14:45:04.821189 (+ 82us) client_negotiation.cc:240] Negotiation successful
0808 14:45:04.821318 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":168,"threads_started":1}
I20260808 14:45:04.822109 2088 heartbeater.cc:347] Connected to a master server at 127.30.214.190:41303
I20260808 14:45:04.822196 2088 heartbeater.cc:464] Registering TS with master...
I20260808 14:45:04.822379 2088 heartbeater.cc:511] Master 127.30.214.190:41303 requested a full tablet report, sending...
I20260808 14:45:04.822913 1752 ts_manager.cc:194] Registered new tserver with Master: 2192a7dc109e4cabaa75ce3c13fb3ee4 (127.30.214.129:34173)
I20260808 14:45:04.823810 1752 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.214.129@KRBTEST.COM'} at 127.30.214.129:47697
I20260808 14:45:04.825169 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 1873
I20260808 14:45:04.825318 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/ts-0/wal/instance
I20260808 14:45:04.825573 31578 external_mini_cluster.cc:1428] Setting key 55b5be8eb64c74577d2dcea52ac045aa
I20260808 14:45:04.829006 2095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:04.823076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:41303 (local address 127.30.214.129:45391)
0808 14:45:04.823215 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:04.823227 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:04.823288 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:04.823407 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:04.823408 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:04.823601 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:04.823666 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:04.823668 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:04.824454 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:04.824455 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:04.825025 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:04.825027 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:04.825698 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:04.825699 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:04.825776 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:04.826235 (+ 459us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:04.826240 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:04.826538 (+ 298us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:04.827996 (+ 1458us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:04.827997 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:04.827998 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:04.828210 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:04.828392 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:04.828393 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:04.828393 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:04.828459 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:04.828763 (+ 304us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:04.828764 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:04.828803 (+ 39us) client_negotiation.cc:769] Sending connection context
0808 14:45:04.828846 (+ 43us) client_negotiation.cc:240] Negotiation successful
0808 14:45:04.828936 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":80,"threads_started":1}
I20260808 14:45:04.829051 1833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:04.823132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.129:45391 (local address 127.30.214.190:41303)
0808 14:45:04.823174 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:04.823176 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:04.823274 (+ 98us) server_negotiation.cc:407] Connection header received
0808 14:45:04.823342 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:04.823342 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:04.823350 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:04.823392 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:04.823753 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:04.824359 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:04.825172 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:04.825547 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:04.825695 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:04.826758 (+ 1063us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:04.826760 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:04.826760 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:04.826767 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:04.827915 (+ 1148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:04.828283 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:04.828284 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:04.828284 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:04.828331 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:04.828552 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:04.828554 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:04.828554 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:04.828697 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:04.828765 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:04.828873 (+ 108us) server_negotiation.cc:299] Negotiation successful
0808 14:45:04.828955 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
WARNING: no policy specified for kudu/127.30.214.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab.
Entry for principal kudu/127.30.214.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab.
I20260808 14:45:04.851841 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.130:0
--local_ip_for_outbound_sockets=127.30.214.130
--webserver_interface=127.30.214.130
--webserver_port=0
--tserver_master_addrs=127.30.214.190:41303
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab
--principal=kudu/127.30.214.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:39301
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:45:04.936359 2099 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:45:04.936585 2099 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:45:04.936612 2099 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:45:04.937886 2099 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:45:04.937942 2099 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:45:04.937963 2099 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 14:45:04.937973 2099 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 14:45:04.937991 2099 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.130
I20260808 14:45:04.939536 2099 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:39301
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab
--principal=kudu/127.30.214.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.214.130
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.30.214.190:41303
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2099
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.130
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:45:04.939750 2099 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:45:04.939957 2099 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:45:04.945030 2110 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:04.945087 2105 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:04.945075 2107 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:04.945535 2099 server_base.cc:1034] running on GCE node
I20260808 14:45:04.945851 2099 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:45:04.946313 2099 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:45:04.947497 2099 hybrid_clock.cc:648] HybridClock initialized: now 1786200304947475 us; error 49 us; skew 500 ppm
Aug 08 14:45:04 dist-test-slave-42z9 krb5kdc[1685](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200304, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:45:04.950095 2099 init.cc:377] Logged in from keytab as kudu/127.30.214.130@KRBTEST.COM (short username kudu)
I20260808 14:45:04.950579 2099 webserver.cc:460] Webserver started at http://127.30.214.130:41887/ using document root <none> and password file <none>
I20260808 14:45:04.950801 2099 fs_manager.cc:359] Metadata directory not provided
I20260808 14:45:04.950843 2099 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:45:04.950945 2099 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:45:04.952013 2099 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/ts-1/data/instance:
uuid: "28b81356f6fb4e4d874a2fc241de62a1"
format_stamp: "Formatted at 2026-08-08 14:45:04 on dist-test-slave-42z9"
server_key: "80e48e4e80645153ba8e11d62ab3efcb"
server_key_iv: "29e43ad583eb835f99f3bd6e2c8e675b"
server_key_version: "encryptionkey@0"
I20260808 14:45:04.952329 2099 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/ts-1/wal/instance:
uuid: "28b81356f6fb4e4d874a2fc241de62a1"
format_stamp: "Formatted at 2026-08-08 14:45:04 on dist-test-slave-42z9"
server_key: "80e48e4e80645153ba8e11d62ab3efcb"
server_key_iv: "29e43ad583eb835f99f3bd6e2c8e675b"
server_key_version: "encryptionkey@0"
I20260808 14:45:04.953704 2099 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:45:04.954494 2121 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:04.954658 2099 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:45:04.954749 2099 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/ts-1/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/ts-1/wal
uuid: "28b81356f6fb4e4d874a2fc241de62a1"
format_stamp: "Formatted at 2026-08-08 14:45:04 on dist-test-slave-42z9"
server_key: "80e48e4e80645153ba8e11d62ab3efcb"
server_key_iv: "29e43ad583eb835f99f3bd6e2c8e675b"
server_key_version: "encryptionkey@0"
I20260808 14:45:04.954819 2099 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:45:04.968858 2099 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:45:04.971191 2099 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:45:04.971342 2099 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:45:04.971913 2099 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:45:04.971957 2099 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:04.971989 2099 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:45:04.972010 2099 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:04.979267 2099 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.130:35535
Aug 08 14:45:04 dist-test-slave-42z9 krb5kdc[1685](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200304, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.130@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:45:04.979432 2285 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.130:35535 every 8 connection(s)
I20260808 14:45:04.979707 2099 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
I20260808 14:45:04.982661 1833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:04.972372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.130:47121 (local address 127.30.214.190:41303)
0808 14:45:04.972439 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:04.972441 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:04.972756 (+ 315us) server_negotiation.cc:407] Connection header received
0808 14:45:04.973479 (+ 723us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:04.973481 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:04.973494 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:04.973565 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:04.974497 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:04.975279 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:04.976827 (+ 1548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:04.977141 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:04.977214 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:04.979949 (+ 2735us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:04.979950 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:04.979951 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:04.979961 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:04.981291 (+ 1330us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:04.981734 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:04.981735 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:04.981736 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:04.981796 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:04.982019 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:04.982020 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:04.982020 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:04.982143 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:04.982200 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:04.982467 (+ 267us) server_negotiation.cc:299] Negotiation successful
0808 14:45:04.982569 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 14:45:04.982829 2130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:04.972344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:41303 (local address 127.30.214.130:47121)
0808 14:45:04.972542 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:04.972593 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:04.973281 (+ 688us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:04.973668 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:04.973674 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:04.974069 (+ 395us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:04.974379 (+ 310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:04.974385 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:04.975379 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:04.975380 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:04.976710 (+ 1330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:04.976714 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:04.977230 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:04.977232 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:04.977386 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:04.978074 (+ 688us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:04.978085 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:04.979850 (+ 1765us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:04.981379 (+ 1529us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:04.981388 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:04.981390 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:04.981665 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:04.981849 (+ 184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:04.981850 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:04.981850 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:04.981964 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:04.982197 (+ 233us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:04.982204 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:04.982346 (+ 142us) client_negotiation.cc:769] Sending connection context
0808 14:45:04.982439 (+ 93us) client_negotiation.cc:240] Negotiation successful
0808 14:45:04.982608 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":95,"threads_started":1}
I20260808 14:45:04.983332 2286 heartbeater.cc:347] Connected to a master server at 127.30.214.190:41303
I20260808 14:45:04.983415 2286 heartbeater.cc:464] Registering TS with master...
I20260808 14:45:04.983593 2286 heartbeater.cc:511] Master 127.30.214.190:41303 requested a full tablet report, sending...
I20260808 14:45:04.983943 1753 ts_manager.cc:194] Registered new tserver with Master: 28b81356f6fb4e4d874a2fc241de62a1 (127.30.214.130:35535)
I20260808 14:45:04.984347 1753 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.214.130@KRBTEST.COM'} at 127.30.214.130:47121
I20260808 14:45:04.987819 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 2099
I20260808 14:45:04.987929 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/ts-1/wal/instance
I20260808 14:45:04.988121 31578 external_mini_cluster.cc:1428] Setting key aacea464aa4e7b7990a43bfc0099c5e1
I20260808 14:45:04.989574 1833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:04.984375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.130:46559 (local address 127.30.214.190:41303)
0808 14:45:04.984417 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:04.984419 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:04.984483 (+ 64us) server_negotiation.cc:407] Connection header received
0808 14:45:04.984539 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:04.984539 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:04.984557 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:04.984601 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:04.984913 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:04.985382 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:04.986074 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:04.986271 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:04.986327 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:04.987221 (+ 894us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:04.987222 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:04.987222 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:04.987229 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:04.988446 (+ 1217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:04.988810 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:04.988810 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:04.988810 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:04.988870 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:04.989047 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:04.989047 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:04.989047 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:04.989187 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:04.989238 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:04.989380 (+ 142us) server_negotiation.cc:299] Negotiation successful
0808 14:45:04.989476 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 14:45:04.989588 2295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:04.984292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:41303 (local address 127.30.214.130:46559)
0808 14:45:04.984423 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:04.984435 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:04.984497 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:04.984620 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:04.984621 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:04.984790 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:04.984844 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:04.984846 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:04.985494 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:04.985495 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:04.986000 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:04.986001 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:04.986331 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:04.986332 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:04.986409 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:04.986818 (+ 409us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:04.986822 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:04.987138 (+ 316us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:04.988533 (+ 1395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:04.988534 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:04.988534 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:04.988753 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:04.988925 (+ 172us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:04.988925 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:04.988926 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:04.988992 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:04.989240 (+ 248us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:04.989241 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:04.989290 (+ 49us) client_negotiation.cc:769] Sending connection context
0808 14:45:04.989359 (+ 69us) client_negotiation.cc:240] Negotiation successful
0808 14:45:04.989492 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":70,"threads_started":1}
WARNING: no policy specified for kudu/127.30.214.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab.
Entry for principal kudu/127.30.214.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab.
I20260808 14:45:05.013391 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.131:0
--local_ip_for_outbound_sockets=127.30.214.131
--webserver_interface=127.30.214.131
--webserver_port=0
--tserver_master_addrs=127.30.214.190:41303
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab
--principal=kudu/127.30.214.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:39301
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:45:05.099040 2302 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:45:05.099261 2302 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:45:05.099287 2302 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:45:05.100546 2302 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:45:05.100600 2302 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:45:05.100620 2302 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 14:45:05.100636 2302 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 14:45:05.100654 2302 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.131
I20260808 14:45:05.102232 2302 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:39301
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab
--principal=kudu/127.30.214.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.214.131
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.30.214.190:41303
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2302
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.131
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:45:05.102451 2302 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:45:05.102651 2302 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:45:05.107897 2308 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:05.107930 2309 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:05.107966 2302 server_base.cc:1034] running on GCE node
W20260808 14:45:05.107913 2312 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:05.108294 2302 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:45:05.108551 2302 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:45:05.109702 2302 hybrid_clock.cc:648] HybridClock initialized: now 1786200305109692 us; error 29 us; skew 500 ppm
Aug 08 14:45:05 dist-test-slave-42z9 krb5kdc[1685](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200305, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:45:05.112218 2302 init.cc:377] Logged in from keytab as kudu/127.30.214.131@KRBTEST.COM (short username kudu)
I20260808 14:45:05.112696 2302 webserver.cc:460] Webserver started at http://127.30.214.131:45869/ using document root <none> and password file <none>
I20260808 14:45:05.112907 2302 fs_manager.cc:359] Metadata directory not provided
I20260808 14:45:05.112957 2302 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:45:05.113096 2302 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:45:05.114220 2302 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/ts-2/data/instance:
uuid: "d819ce52bb964e15b7d22471126caf8b"
format_stamp: "Formatted at 2026-08-08 14:45:05 on dist-test-slave-42z9"
server_key: "ac2f562c9db15f4c3f1a85c5e35ef84e"
server_key_iv: "c7baa483625c37c21672228726151b5a"
server_key_version: "encryptionkey@0"
I20260808 14:45:05.114573 2302 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/ts-2/wal/instance:
uuid: "d819ce52bb964e15b7d22471126caf8b"
format_stamp: "Formatted at 2026-08-08 14:45:05 on dist-test-slave-42z9"
server_key: "ac2f562c9db15f4c3f1a85c5e35ef84e"
server_key_iv: "c7baa483625c37c21672228726151b5a"
server_key_version: "encryptionkey@0"
I20260808 14:45:05.115990 2302 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 14:45:05.116714 2323 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:05.116873 2302 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:45:05.116961 2302 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/ts-2/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/ts-2/wal
uuid: "d819ce52bb964e15b7d22471126caf8b"
format_stamp: "Formatted at 2026-08-08 14:45:05 on dist-test-slave-42z9"
server_key: "ac2f562c9db15f4c3f1a85c5e35ef84e"
server_key_iv: "c7baa483625c37c21672228726151b5a"
server_key_version: "encryptionkey@0"
I20260808 14:45:05.117038 2302 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:45:05.127838 2302 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:45:05.129827 2302 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:45:05.130000 2302 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:45:05.130612 2302 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:45:05.130669 2302 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:05.130709 2302 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:45:05.130733 2302 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 14:45:05 dist-test-slave-42z9 krb5kdc[1685](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200305, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.131@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:45:05.138208 2302 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.131:44617
I20260808 14:45:05.138616 2302 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
I20260808 14:45:05.139051 2488 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.131:44617 every 8 connection(s)
I20260808 14:45:05.139274 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 2302
I20260808 14:45:05.139379 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/ts-2/wal/instance
I20260808 14:45:05.139583 31578 external_mini_cluster.cc:1428] Setting key 86057c06b79b75661530afefc974d264
I20260808 14:45:05.141244 1833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:05.130974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:60101 (local address 127.30.214.190:41303)
0808 14:45:05.131043 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:05.131045 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:05.131328 (+ 283us) server_negotiation.cc:407] Connection header received
0808 14:45:05.131832 (+ 504us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:05.131834 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:05.131848 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:05.131922 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:05.132760 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:05.133548 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:05.134589 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:05.134793 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:05.134852 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:05.138236 (+ 3384us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:05.138239 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:05.138239 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:05.138247 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:05.139911 (+ 1664us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:05.140300 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:05.140301 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:05.140301 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:05.140368 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:05.140594 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:05.140595 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:05.140595 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:05.140733 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:05.140790 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:05.141059 (+ 269us) server_negotiation.cc:299] Negotiation successful
0808 14:45:05.141145 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 14:45:05.141419 2336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:05.130980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:41303 (local address 127.30.214.131:60101)
0808 14:45:05.131195 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:05.131237 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:05.131742 (+ 505us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:05.132022 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:05.132027 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:05.132387 (+ 360us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:05.132671 (+ 284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:05.132677 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:05.133643 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:05.133644 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:05.134497 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:05.134500 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:05.134869 (+ 369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:05.134870 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:05.135006 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:05.135575 (+ 569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:05.135586 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:05.138125 (+ 2539us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:05.139994 (+ 1869us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:05.140002 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:05.140004 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:05.140231 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:05.140419 (+ 188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:05.140420 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:05.140420 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:05.140535 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:05.140792 (+ 257us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:05.140799 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:05.140941 (+ 142us) client_negotiation.cc:769] Sending connection context
0808 14:45:05.141031 (+ 90us) client_negotiation.cc:240] Negotiation successful
0808 14:45:05.141202 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":102,"threads_started":1}
I20260808 14:45:05.141927 2489 heartbeater.cc:347] Connected to a master server at 127.30.214.190:41303
I20260808 14:45:05.142014 2489 heartbeater.cc:464] Registering TS with master...
I20260808 14:45:05.142201 2489 heartbeater.cc:511] Master 127.30.214.190:41303 requested a full tablet report, sending...
I20260808 14:45:05.142575 1752 ts_manager.cc:194] Registered new tserver with Master: d819ce52bb964e15b7d22471126caf8b (127.30.214.131:44617)
I20260808 14:45:05.143002 1752 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.214.131@KRBTEST.COM'} at 127.30.214.131:60101
I20260808 14:45:05.148289 1833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:05.142978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:57385 (local address 127.30.214.190:41303)
0808 14:45:05.143016 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:05.143017 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:05.143087 (+ 70us) server_negotiation.cc:407] Connection header received
0808 14:45:05.143187 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:05.143188 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:05.143196 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:05.143233 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:05.143594 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:05.144064 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:05.144751 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:05.144949 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:05.145004 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:05.145980 (+ 976us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:05.145981 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:05.145982 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:05.145989 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:05.147236 (+ 1247us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:05.147546 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:05.147547 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:05.147548 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:05.147604 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:05.147773 (+ 169us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:05.147773 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:05.147773 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:05.147883 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:05.147940 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:05.148101 (+ 161us) server_negotiation.cc:299] Negotiation successful
0808 14:45:05.148184 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 14:45:05.148304 2496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:05.142896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:41303 (local address 127.30.214.131:57385)
0808 14:45:05.143014 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:05.143026 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:05.143092 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:05.143265 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:05.143266 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:05.143444 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:05.143507 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:05.143508 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:05.144149 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:05.144150 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:05.144675 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:05.144677 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:05.145013 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:05.145014 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:05.145093 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:05.145581 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:05.145587 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:05.145894 (+ 307us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:05.147316 (+ 1422us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:05.147317 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:05.147318 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:05.147485 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:05.147660 (+ 175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:05.147661 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:05.147661 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:05.147723 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:05.147939 (+ 216us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:05.147940 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:05.147991 (+ 51us) client_negotiation.cc:769] Sending connection context
0808 14:45:05.148061 (+ 70us) client_negotiation.cc:240] Negotiation successful
0808 14:45:05.148196 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":90,"thread_start_us":59,"threads_started":1}
I20260808 14:45:05.151584 31578 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 14:45:05 dist-test-slave-42z9 krb5kdc[1685](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200305, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 14:45:05 dist-test-slave-42z9 krb5kdc[1685](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200305, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:45:05.182531 1833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:05.175592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57786 (local address 127.30.214.190:41303)
0808 14:45:05.175660 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:05.175663 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:05.175786 (+ 123us) server_negotiation.cc:407] Connection header received
0808 14:45:05.175825 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:05.175827 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:05.175844 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:05.175902 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:05.176457 (+ 555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:05.176953 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:05.177722 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:05.177907 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:05.177952 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:05.180296 (+ 2344us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:05.180297 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:05.180298 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:05.180305 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:05.181658 (+ 1353us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:05.181961 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:05.181962 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:05.181962 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:05.182008 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:05.182139 (+ 131us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:05.182140 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:05.182140 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:05.182241 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:05.182311 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:05.182389 (+ 78us) server_negotiation.cc:299] Negotiation successful
0808 14:45:05.182461 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 14:45:05.184105 1752 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57786:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:45:05.185781 1752 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:45:05.192916 2514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:05.188763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36070 (local address 127.30.214.130:35535)
0808 14:45:05.189076 (+ 313us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:05.189081 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:05.189091 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:45:05.189132 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:05.189134 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:05.189150 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:05.189229 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:45:05.189493 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:05.190333 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:05.191647 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:05.192402 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:05.192443 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:05.192485 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:05.192780 (+ 295us) server_negotiation.cc:299] Negotiation successful
0808 14:45:05.192821 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":279,"thread_start_us":78,"threads_started":1}
I20260808 14:45:05.192935 2513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:05.188872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.129:34173 (local address 127.0.0.1:34176)
0808 14:45:05.189108 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:05.189116 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:05.189152 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:05.189649 (+ 497us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:05.189650 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:05.189652 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:45:05.189687 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:05.189688 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:05.190909 (+ 1221us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:05.190910 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:05.191735 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:05.191738 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:05.192571 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:05.192572 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:05.192651 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:05.192665 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 14:45:05.192737 (+ 72us) client_negotiation.cc:240] Negotiation successful
0808 14:45:05.192799 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":217,"mutex_wait_us":2,"thread_start_us":89,"threads_started":1}
I20260808 14:45:05.192950 2517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:05.189150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34176 (local address 127.30.214.129:34173)
0808 14:45:05.189341 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:05.189345 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:05.189353 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:45:05.189389 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:05.189391 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:05.189405 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:05.189589 (+ 184us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:45:05.189758 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:05.190827 (+ 1069us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:05.191809 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:05.192494 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:05.192568 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:05.192620 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:05.192758 (+ 138us) server_negotiation.cc:299] Negotiation successful
0808 14:45:05.192804 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":93,"threads_started":1}
I20260808 14:45:05.193177 2512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:05.188648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.131:44617 (local address 127.0.0.1:38648)
0808 14:45:05.188841 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:05.188881 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:05.188957 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:05.189490 (+ 533us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:05.189491 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:05.189493 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:45:05.189543 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:05.189545 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:05.190877 (+ 1332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:05.190878 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:05.191986 (+ 1108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:05.191989 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:05.192957 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:05.192958 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:05.193023 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:05.193028 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 14:45:05.193060 (+ 32us) client_negotiation.cc:240] Negotiation successful
0808 14:45:05.193103 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":94,"threads_started":1}
I20260808 14:45:05.193418 2516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:05.188649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.130:35535 (local address 127.0.0.1:36070)
0808 14:45:05.189001 (+ 352us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:05.189013 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:05.189066 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:05.189253 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:05.189256 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:05.189258 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:45:05.189339 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:05.189341 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:05.190426 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:05.190426 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:05.191535 (+ 1109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:05.191538 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:05.192533 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:05.192534 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:05.192649 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:05.192665 (+ 16us) client_negotiation.cc:769] Sending connection context
0808 14:45:05.193319 (+ 654us) client_negotiation.cc:240] Negotiation successful
0808 14:45:05.193362 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":331,"mutex_wait_us":22,"thread_start_us":78,"threads_started":1}
I20260808 14:45:05.193539 2515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:05.188751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38648 (local address 127.30.214.131:44617)
0808 14:45:05.189261 (+ 510us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:05.189266 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:05.189275 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:45:05.189310 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:05.189311 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:05.189327 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:05.189405 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:45:05.189630 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:05.190782 (+ 1152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:05.192074 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:05.192787 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:05.193288 (+ 501us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:05.193357 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:05.193383 (+ 26us) server_negotiation.cc:299] Negotiation successful
0808 14:45:05.193422 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":473,"thread_start_us":99,"threads_started":1}
I20260808 14:45:05.193955 1981 tablet_service.cc:1467] Processing CreateTablet for tablet db1ea691ed9d483dada508c27b3b435f (DEFAULT_TABLE table=test-table [id=aa7ee4630b454caa9bf7f68db9bd65d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:45:05.194108 2400 tablet_service.cc:1467] Processing CreateTablet for tablet db1ea691ed9d483dada508c27b3b435f (DEFAULT_TABLE table=test-table [id=aa7ee4630b454caa9bf7f68db9bd65d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:45:05.194356 1981 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db1ea691ed9d483dada508c27b3b435f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:45:05.194482 2400 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db1ea691ed9d483dada508c27b3b435f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:45:05.197021 2518 tablet_bootstrap.cc:492] T db1ea691ed9d483dada508c27b3b435f P d819ce52bb964e15b7d22471126caf8b: Bootstrap starting.
I20260808 14:45:05.197381 2519 tablet_bootstrap.cc:492] T db1ea691ed9d483dada508c27b3b435f P 2192a7dc109e4cabaa75ce3c13fb3ee4: Bootstrap starting.
I20260808 14:45:05.197850 2194 tablet_service.cc:1467] Processing CreateTablet for tablet db1ea691ed9d483dada508c27b3b435f (DEFAULT_TABLE table=test-table [id=aa7ee4630b454caa9bf7f68db9bd65d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:45:05.198105 2519 tablet_bootstrap.cc:654] T db1ea691ed9d483dada508c27b3b435f P 2192a7dc109e4cabaa75ce3c13fb3ee4: Neither blocks nor log segments found. Creating new log.
I20260808 14:45:05.198120 2518 tablet_bootstrap.cc:654] T db1ea691ed9d483dada508c27b3b435f P d819ce52bb964e15b7d22471126caf8b: Neither blocks nor log segments found. Creating new log.
I20260808 14:45:05.198190 2194 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db1ea691ed9d483dada508c27b3b435f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:45:05.198501 2519 log.cc:824] T db1ea691ed9d483dada508c27b3b435f P 2192a7dc109e4cabaa75ce3c13fb3ee4: Log is configured to *not* fsync() on all Append() calls
I20260808 14:45:05.198546 2518 log.cc:824] T db1ea691ed9d483dada508c27b3b435f P d819ce52bb964e15b7d22471126caf8b: Log is configured to *not* fsync() on all Append() calls
I20260808 14:45:05.199245 2518 tablet_bootstrap.cc:492] T db1ea691ed9d483dada508c27b3b435f P d819ce52bb964e15b7d22471126caf8b: No bootstrap required, opened a new log
I20260808 14:45:05.199301 2518 ts_tablet_manager.cc:1397] T db1ea691ed9d483dada508c27b3b435f P d819ce52bb964e15b7d22471126caf8b: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260808 14:45:05.200668 2518 raft_consensus.cc:348] T db1ea691ed9d483dada508c27b3b435f P d819ce52bb964e15b7d22471126caf8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d819ce52bb964e15b7d22471126caf8b" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44617 } } peers { permanent_uuid: "28b81356f6fb4e4d874a2fc241de62a1" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35535 } } peers { permanent_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34173 } }
I20260808 14:45:05.200836 2518 raft_consensus.cc:374] T db1ea691ed9d483dada508c27b3b435f P d819ce52bb964e15b7d22471126caf8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:45:05.200884 2518 raft_consensus.cc:729] T db1ea691ed9d483dada508c27b3b435f P d819ce52bb964e15b7d22471126caf8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d819ce52bb964e15b7d22471126caf8b, State: Initialized, Role: FOLLOWER
I20260808 14:45:05.201005 2518 consensus_queue.cc:260] T db1ea691ed9d483dada508c27b3b435f P d819ce52bb964e15b7d22471126caf8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d819ce52bb964e15b7d22471126caf8b" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44617 } } peers { permanent_uuid: "28b81356f6fb4e4d874a2fc241de62a1" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35535 } } peers { permanent_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34173 } }
I20260808 14:45:05.201232 2526 tablet_bootstrap.cc:492] T db1ea691ed9d483dada508c27b3b435f P 28b81356f6fb4e4d874a2fc241de62a1: Bootstrap starting.
I20260808 14:45:05.201269 2518 ts_tablet_manager.cc:1428] T db1ea691ed9d483dada508c27b3b435f P d819ce52bb964e15b7d22471126caf8b: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260808 14:45:05.201416 2489 heartbeater.cc:503] Master 127.30.214.190:41303 was elected leader, sending a full tablet report...
I20260808 14:45:05.201851 2519 tablet_bootstrap.cc:492] T db1ea691ed9d483dada508c27b3b435f P 2192a7dc109e4cabaa75ce3c13fb3ee4: No bootstrap required, opened a new log
I20260808 14:45:05.201929 2519 ts_tablet_manager.cc:1397] T db1ea691ed9d483dada508c27b3b435f P 2192a7dc109e4cabaa75ce3c13fb3ee4: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260808 14:45:05.201951 2526 tablet_bootstrap.cc:654] T db1ea691ed9d483dada508c27b3b435f P 28b81356f6fb4e4d874a2fc241de62a1: Neither blocks nor log segments found. Creating new log.
I20260808 14:45:05.202229 2526 log.cc:824] T db1ea691ed9d483dada508c27b3b435f P 28b81356f6fb4e4d874a2fc241de62a1: Log is configured to *not* fsync() on all Append() calls
I20260808 14:45:05.203047 2526 tablet_bootstrap.cc:492] T db1ea691ed9d483dada508c27b3b435f P 28b81356f6fb4e4d874a2fc241de62a1: No bootstrap required, opened a new log
I20260808 14:45:05.203110 2526 ts_tablet_manager.cc:1397] T db1ea691ed9d483dada508c27b3b435f P 28b81356f6fb4e4d874a2fc241de62a1: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:45:05.203598 2519 raft_consensus.cc:348] T db1ea691ed9d483dada508c27b3b435f P 2192a7dc109e4cabaa75ce3c13fb3ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d819ce52bb964e15b7d22471126caf8b" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44617 } } peers { permanent_uuid: "28b81356f6fb4e4d874a2fc241de62a1" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35535 } } peers { permanent_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34173 } }
I20260808 14:45:05.203728 2519 raft_consensus.cc:374] T db1ea691ed9d483dada508c27b3b435f P 2192a7dc109e4cabaa75ce3c13fb3ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:45:05.203750 2519 raft_consensus.cc:729] T db1ea691ed9d483dada508c27b3b435f P 2192a7dc109e4cabaa75ce3c13fb3ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2192a7dc109e4cabaa75ce3c13fb3ee4, State: Initialized, Role: FOLLOWER
I20260808 14:45:05.203848 2519 consensus_queue.cc:260] T db1ea691ed9d483dada508c27b3b435f P 2192a7dc109e4cabaa75ce3c13fb3ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d819ce52bb964e15b7d22471126caf8b" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44617 } } peers { permanent_uuid: "28b81356f6fb4e4d874a2fc241de62a1" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35535 } } peers { permanent_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34173 } }
I20260808 14:45:05.204085 2519 ts_tablet_manager.cc:1428] T db1ea691ed9d483dada508c27b3b435f P 2192a7dc109e4cabaa75ce3c13fb3ee4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:45:05.204136 2088 heartbeater.cc:503] Master 127.30.214.190:41303 was elected leader, sending a full tablet report...
I20260808 14:45:05.204708 2526 raft_consensus.cc:348] T db1ea691ed9d483dada508c27b3b435f P 28b81356f6fb4e4d874a2fc241de62a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d819ce52bb964e15b7d22471126caf8b" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44617 } } peers { permanent_uuid: "28b81356f6fb4e4d874a2fc241de62a1" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35535 } } peers { permanent_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34173 } }
I20260808 14:45:05.204849 2526 raft_consensus.cc:374] T db1ea691ed9d483dada508c27b3b435f P 28b81356f6fb4e4d874a2fc241de62a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:45:05.204879 2526 raft_consensus.cc:729] T db1ea691ed9d483dada508c27b3b435f P 28b81356f6fb4e4d874a2fc241de62a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28b81356f6fb4e4d874a2fc241de62a1, State: Initialized, Role: FOLLOWER
I20260808 14:45:05.205000 2526 consensus_queue.cc:260] T db1ea691ed9d483dada508c27b3b435f P 28b81356f6fb4e4d874a2fc241de62a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d819ce52bb964e15b7d22471126caf8b" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44617 } } peers { permanent_uuid: "28b81356f6fb4e4d874a2fc241de62a1" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35535 } } peers { permanent_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34173 } }
I20260808 14:45:05.205274 2526 ts_tablet_manager.cc:1428] T db1ea691ed9d483dada508c27b3b435f P 28b81356f6fb4e4d874a2fc241de62a1: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:45:05.205363 2286 heartbeater.cc:503] Master 127.30.214.190:41303 was elected leader, sending a full tablet report...
W20260808 14:45:05.230453 2287 tablet.cc:2369] T db1ea691ed9d483dada508c27b3b435f P 28b81356f6fb4e4d874a2fc241de62a1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:45:05.257509 2532 raft_consensus.cc:482] T db1ea691ed9d483dada508c27b3b435f P 28b81356f6fb4e4d874a2fc241de62a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:45:05.257647 2532 raft_consensus.cc:504] T db1ea691ed9d483dada508c27b3b435f P 28b81356f6fb4e4d874a2fc241de62a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d819ce52bb964e15b7d22471126caf8b" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44617 } } peers { permanent_uuid: "28b81356f6fb4e4d874a2fc241de62a1" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35535 } } peers { permanent_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34173 } }
I20260808 14:45:05.258004 2532 leader_election.cc:288] T db1ea691ed9d483dada508c27b3b435f P 28b81356f6fb4e4d874a2fc241de62a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d819ce52bb964e15b7d22471126caf8b (127.30.214.131:44617), 2192a7dc109e4cabaa75ce3c13fb3ee4 (127.30.214.129:34173)
I20260808 14:45:05.261353 2515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:05.258471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.130:55543 (local address 127.30.214.131:44617)
0808 14:45:05.258525 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:05.258527 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:05.258539 (+ 12us) server_negotiation.cc:407] Connection header received
0808 14:45:05.258574 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:05.258576 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:05.258586 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:05.258657 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:45:05.258885 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:05.259485 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:05.260580 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:05.260994 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:05.261055 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:05.261065 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:05.261240 (+ 175us) server_negotiation.cc:299] Negotiation successful
0808 14:45:05.261282 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 14:45:05.261360 2130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:05.258378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.131:44617 (local address 127.30.214.130:55543)
0808 14:45:05.258432 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:05.258444 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:05.258494 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:05.258694 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:05.258695 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:05.258697 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:45:05.258769 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:05.258771 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:05.259586 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:05.259588 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:05.260458 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:05.260472 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:05.261071 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:05.261072 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:05.261165 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:05.261169 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:45:05.261221 (+ 52us) client_negotiation.cc:240] Negotiation successful
0808 14:45:05.261263 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29,"mutex_wait_us":1}
I20260808 14:45:05.261351 2517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:05.258635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.130:34411 (local address 127.30.214.129:34173)
0808 14:45:05.258683 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:05.258685 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:05.258825 (+ 140us) server_negotiation.cc:407] Connection header received
0808 14:45:05.258892 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:05.258893 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:05.258903 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:05.258945 (+ 42us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:45:05.259127 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:05.259690 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:05.260606 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:05.261006 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:05.261076 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:05.261085 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:05.261241 (+ 156us) server_negotiation.cc:299] Negotiation successful
0808 14:45:05.261283 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 14:45:05.261387 2534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:05.258511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.129:34173 (local address 127.30.214.130:34411)
0808 14:45:05.258741 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:05.258749 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:05.258826 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:05.258963 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:05.258964 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:05.258966 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:45:05.259037 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:05.259039 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:05.259798 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:05.259799 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:05.260509 (+ 710us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:05.260511 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:05.261093 (+ 582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:05.261094 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:05.261171 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:05.261174 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:45:05.261224 (+ 50us) client_negotiation.cc:240] Negotiation successful
0808 14:45:05.261266 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":215,"mutex_wait_us":3,"thread_start_us":130,"threads_started":1}
I20260808 14:45:05.261814 2428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db1ea691ed9d483dada508c27b3b435f" candidate_uuid: "28b81356f6fb4e4d874a2fc241de62a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d819ce52bb964e15b7d22471126caf8b" is_pre_election: true
I20260808 14:45:05.261806 2011 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db1ea691ed9d483dada508c27b3b435f" candidate_uuid: "28b81356f6fb4e4d874a2fc241de62a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4" is_pre_election: true
I20260808 14:45:05.261984 2011 raft_consensus.cc:2454] T db1ea691ed9d483dada508c27b3b435f P 2192a7dc109e4cabaa75ce3c13fb3ee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 28b81356f6fb4e4d874a2fc241de62a1 in term 0.
I20260808 14:45:05.261984 2428 raft_consensus.cc:2454] T db1ea691ed9d483dada508c27b3b435f P d819ce52bb964e15b7d22471126caf8b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 28b81356f6fb4e4d874a2fc241de62a1 in term 0.
I20260808 14:45:05.262229 2124 leader_election.cc:302] T db1ea691ed9d483dada508c27b3b435f P 28b81356f6fb4e4d874a2fc241de62a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2192a7dc109e4cabaa75ce3c13fb3ee4, 28b81356f6fb4e4d874a2fc241de62a1; no voters:
I20260808 14:45:05.262401 2532 raft_consensus.cc:2781] T db1ea691ed9d483dada508c27b3b435f P 28b81356f6fb4e4d874a2fc241de62a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:45:05.262480 2532 raft_consensus.cc:482] T db1ea691ed9d483dada508c27b3b435f P 28b81356f6fb4e4d874a2fc241de62a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:45:05.262509 2532 raft_consensus.cc:3037] T db1ea691ed9d483dada508c27b3b435f P 28b81356f6fb4e4d874a2fc241de62a1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:05.263516 2532 raft_consensus.cc:504] T db1ea691ed9d483dada508c27b3b435f P 28b81356f6fb4e4d874a2fc241de62a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d819ce52bb964e15b7d22471126caf8b" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44617 } } peers { permanent_uuid: "28b81356f6fb4e4d874a2fc241de62a1" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35535 } } peers { permanent_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34173 } }
I20260808 14:45:05.263643 2532 leader_election.cc:288] T db1ea691ed9d483dada508c27b3b435f P 28b81356f6fb4e4d874a2fc241de62a1 [CANDIDATE]: Term 1 election: Requested vote from peers d819ce52bb964e15b7d22471126caf8b (127.30.214.131:44617), 2192a7dc109e4cabaa75ce3c13fb3ee4 (127.30.214.129:34173)
I20260808 14:45:05.263870 2011 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db1ea691ed9d483dada508c27b3b435f" candidate_uuid: "28b81356f6fb4e4d874a2fc241de62a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4"
I20260808 14:45:05.263868 2428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db1ea691ed9d483dada508c27b3b435f" candidate_uuid: "28b81356f6fb4e4d874a2fc241de62a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d819ce52bb964e15b7d22471126caf8b"
I20260808 14:45:05.263957 2428 raft_consensus.cc:3037] T db1ea691ed9d483dada508c27b3b435f P d819ce52bb964e15b7d22471126caf8b [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:05.263962 2011 raft_consensus.cc:3037] T db1ea691ed9d483dada508c27b3b435f P 2192a7dc109e4cabaa75ce3c13fb3ee4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:05.264678 2428 raft_consensus.cc:2454] T db1ea691ed9d483dada508c27b3b435f P d819ce52bb964e15b7d22471126caf8b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28b81356f6fb4e4d874a2fc241de62a1 in term 1.
I20260808 14:45:05.264761 2011 raft_consensus.cc:2454] T db1ea691ed9d483dada508c27b3b435f P 2192a7dc109e4cabaa75ce3c13fb3ee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28b81356f6fb4e4d874a2fc241de62a1 in term 1.
I20260808 14:45:05.264858 2124 leader_election.cc:302] T db1ea691ed9d483dada508c27b3b435f P 28b81356f6fb4e4d874a2fc241de62a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28b81356f6fb4e4d874a2fc241de62a1, d819ce52bb964e15b7d22471126caf8b; no voters:
I20260808 14:45:05.264954 2532 raft_consensus.cc:2781] T db1ea691ed9d483dada508c27b3b435f P 28b81356f6fb4e4d874a2fc241de62a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:45:05.265121 2532 raft_consensus.cc:686] T db1ea691ed9d483dada508c27b3b435f P 28b81356f6fb4e4d874a2fc241de62a1 [term 1 LEADER]: Becoming Leader. State: Replica: 28b81356f6fb4e4d874a2fc241de62a1, State: Running, Role: LEADER
I20260808 14:45:05.265216 2532 consensus_queue.cc:237] T db1ea691ed9d483dada508c27b3b435f P 28b81356f6fb4e4d874a2fc241de62a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d819ce52bb964e15b7d22471126caf8b" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44617 } } peers { permanent_uuid: "28b81356f6fb4e4d874a2fc241de62a1" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35535 } } peers { permanent_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34173 } }
I20260808 14:45:05.266290 1752 catalog_manager.cc:5495] T db1ea691ed9d483dada508c27b3b435f P 28b81356f6fb4e4d874a2fc241de62a1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 28b81356f6fb4e4d874a2fc241de62a1 (127.30.214.130). New cstate: current_term: 1 leader_uuid: "28b81356f6fb4e4d874a2fc241de62a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d819ce52bb964e15b7d22471126caf8b" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28b81356f6fb4e4d874a2fc241de62a1" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34173 } health_report { overall_health: UNKNOWN } } }
Aug 08 14:45:05 dist-test-slave-42z9 krb5kdc[1685](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200304, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.190@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:45:05.316628 1833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:05.310267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57794 (local address 127.30.214.190:41303)
0808 14:45:05.310321 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:05.310323 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:05.310433 (+ 110us) server_negotiation.cc:407] Connection header received
0808 14:45:05.310495 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:05.310496 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:05.310508 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:05.310555 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:05.311016 (+ 461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:05.311497 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:05.312157 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:05.312330 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:05.312382 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:05.314399 (+ 2017us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:05.314400 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:05.314401 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:05.314407 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:05.315442 (+ 1035us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:05.315778 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:05.315779 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:05.315779 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:05.315825 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:05.315959 (+ 134us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:05.315959 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:05.315959 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:05.316053 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:05.316098 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:05.316470 (+ 372us) server_negotiation.cc:299] Negotiation successful
0808 14:45:05.316555 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 14:45:05.316813 2544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:05.310216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:41303 (local address 127.0.0.1:57794)
0808 14:45:05.310361 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:05.310371 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:05.310443 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:05.310565 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:05.310566 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:05.310884 (+ 318us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:05.310933 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:05.310936 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:05.311568 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:05.311569 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:05.312084 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:05.312086 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:05.312386 (+ 300us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:05.312387 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:05.312437 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:05.312908 (+ 471us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:05.312913 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:05.314310 (+ 1397us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:05.315511 (+ 1201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:05.315519 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:05.315521 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:05.315721 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:05.315870 (+ 149us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:05.315870 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:05.315870 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:05.315921 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:05.316203 (+ 282us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:05.316222 (+ 19us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:05.316320 (+ 98us) client_negotiation.cc:769] Sending connection context
0808 14:45:05.316448 (+ 128us) client_negotiation.cc:240] Negotiation successful
0808 14:45:05.316673 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"mutex_wait_us":38,"thread_start_us":80,"threads_started":1}
I20260808 14:45:05.318895 1752 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.30.214.190@KRBTEST.COM'} at 127.0.0.1:57794:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 14:45:05.318967 2090 tablet.cc:2369] T db1ea691ed9d483dada508c27b3b435f P 2192a7dc109e4cabaa75ce3c13fb3ee4: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:45:05.319106 1752 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:45:05.320483 2194 tablet_service.cc:1467] Processing CreateTablet for tablet 399e735e8c694f86ad14e4678e8d62ec (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=722dcae9ee934ad480c87b8190c1011b]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 14:45:05.320490 1981 tablet_service.cc:1467] Processing CreateTablet for tablet 399e735e8c694f86ad14e4678e8d62ec (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=722dcae9ee934ad480c87b8190c1011b]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 14:45:05.320484 2400 tablet_service.cc:1467] Processing CreateTablet for tablet 399e735e8c694f86ad14e4678e8d62ec (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=722dcae9ee934ad480c87b8190c1011b]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 14:45:05.320664 1981 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 399e735e8c694f86ad14e4678e8d62ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:45:05.320664 2400 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 399e735e8c694f86ad14e4678e8d62ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:45:05.320665 2194 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 399e735e8c694f86ad14e4678e8d62ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:45:05.322057 2526 tablet_bootstrap.cc:492] T 399e735e8c694f86ad14e4678e8d62ec P 28b81356f6fb4e4d874a2fc241de62a1: Bootstrap starting.
I20260808 14:45:05.322249 2518 tablet_bootstrap.cc:492] T 399e735e8c694f86ad14e4678e8d62ec P d819ce52bb964e15b7d22471126caf8b: Bootstrap starting.
I20260808 14:45:05.322551 2526 tablet_bootstrap.cc:654] T 399e735e8c694f86ad14e4678e8d62ec P 28b81356f6fb4e4d874a2fc241de62a1: Neither blocks nor log segments found. Creating new log.
I20260808 14:45:05.322808 2518 tablet_bootstrap.cc:654] T 399e735e8c694f86ad14e4678e8d62ec P d819ce52bb964e15b7d22471126caf8b: Neither blocks nor log segments found. Creating new log.
I20260808 14:45:05.323174 2519 tablet_bootstrap.cc:492] T 399e735e8c694f86ad14e4678e8d62ec P 2192a7dc109e4cabaa75ce3c13fb3ee4: Bootstrap starting.
I20260808 14:45:05.323458 2526 tablet_bootstrap.cc:492] T 399e735e8c694f86ad14e4678e8d62ec P 28b81356f6fb4e4d874a2fc241de62a1: No bootstrap required, opened a new log
I20260808 14:45:05.323514 2526 ts_tablet_manager.cc:1397] T 399e735e8c694f86ad14e4678e8d62ec P 28b81356f6fb4e4d874a2fc241de62a1: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 14:45:05.323589 2519 tablet_bootstrap.cc:654] T 399e735e8c694f86ad14e4678e8d62ec P 2192a7dc109e4cabaa75ce3c13fb3ee4: Neither blocks nor log segments found. Creating new log.
I20260808 14:45:05.323665 2526 raft_consensus.cc:348] T 399e735e8c694f86ad14e4678e8d62ec P 28b81356f6fb4e4d874a2fc241de62a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34173 } } peers { permanent_uuid: "28b81356f6fb4e4d874a2fc241de62a1" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35535 } } peers { permanent_uuid: "d819ce52bb964e15b7d22471126caf8b" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44617 } }
I20260808 14:45:05.323750 2526 raft_consensus.cc:374] T 399e735e8c694f86ad14e4678e8d62ec P 28b81356f6fb4e4d874a2fc241de62a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:45:05.323768 2526 raft_consensus.cc:729] T 399e735e8c694f86ad14e4678e8d62ec P 28b81356f6fb4e4d874a2fc241de62a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28b81356f6fb4e4d874a2fc241de62a1, State: Initialized, Role: FOLLOWER
I20260808 14:45:05.323824 2526 consensus_queue.cc:260] T 399e735e8c694f86ad14e4678e8d62ec P 28b81356f6fb4e4d874a2fc241de62a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34173 } } peers { permanent_uuid: "28b81356f6fb4e4d874a2fc241de62a1" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35535 } } peers { permanent_uuid: "d819ce52bb964e15b7d22471126caf8b" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44617 } }
I20260808 14:45:05.323925 2526 ts_tablet_manager.cc:1428] T 399e735e8c694f86ad14e4678e8d62ec P 28b81356f6fb4e4d874a2fc241de62a1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:05.324008 2532 tablet_replica.cc:439] T 399e735e8c694f86ad14e4678e8d62ec P 28b81356f6fb4e4d874a2fc241de62a1: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34173 } } peers { permanent_uuid: "28b81356f6fb4e4d874a2fc241de62a1" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35535 } } peers { permanent_uuid: "d819ce52bb964e15b7d22471126caf8b" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44617 } } }
I20260808 14:45:05.324100 2532 tablet_replica.cc:442] T 399e735e8c694f86ad14e4678e8d62ec P 28b81356f6fb4e4d874a2fc241de62a1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:45:05.324476 2518 tablet_bootstrap.cc:492] T 399e735e8c694f86ad14e4678e8d62ec P d819ce52bb964e15b7d22471126caf8b: No bootstrap required, opened a new log
I20260808 14:45:05.324543 2518 ts_tablet_manager.cc:1397] T 399e735e8c694f86ad14e4678e8d62ec P d819ce52bb964e15b7d22471126caf8b: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260808 14:45:05.324700 2518 raft_consensus.cc:348] T 399e735e8c694f86ad14e4678e8d62ec P d819ce52bb964e15b7d22471126caf8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34173 } } peers { permanent_uuid: "28b81356f6fb4e4d874a2fc241de62a1" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35535 } } peers { permanent_uuid: "d819ce52bb964e15b7d22471126caf8b" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44617 } }
I20260808 14:45:05.324788 2518 raft_consensus.cc:374] T 399e735e8c694f86ad14e4678e8d62ec P d819ce52bb964e15b7d22471126caf8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:45:05.324821 2518 raft_consensus.cc:729] T 399e735e8c694f86ad14e4678e8d62ec P d819ce52bb964e15b7d22471126caf8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d819ce52bb964e15b7d22471126caf8b, State: Initialized, Role: FOLLOWER
I20260808 14:45:05.324864 2518 consensus_queue.cc:260] T 399e735e8c694f86ad14e4678e8d62ec P d819ce52bb964e15b7d22471126caf8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34173 } } peers { permanent_uuid: "28b81356f6fb4e4d874a2fc241de62a1" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35535 } } peers { permanent_uuid: "d819ce52bb964e15b7d22471126caf8b" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44617 } }
I20260808 14:45:05.324968 2518 ts_tablet_manager.cc:1428] T 399e735e8c694f86ad14e4678e8d62ec P d819ce52bb964e15b7d22471126caf8b: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:05.325021 2527 tablet_replica.cc:439] T 399e735e8c694f86ad14e4678e8d62ec P d819ce52bb964e15b7d22471126caf8b: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34173 } } peers { permanent_uuid: "28b81356f6fb4e4d874a2fc241de62a1" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35535 } } peers { permanent_uuid: "d819ce52bb964e15b7d22471126caf8b" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44617 } } }
I20260808 14:45:05.325110 2527 tablet_replica.cc:442] T 399e735e8c694f86ad14e4678e8d62ec P d819ce52bb964e15b7d22471126caf8b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:45:05.325189 2519 tablet_bootstrap.cc:492] T 399e735e8c694f86ad14e4678e8d62ec P 2192a7dc109e4cabaa75ce3c13fb3ee4: No bootstrap required, opened a new log
I20260808 14:45:05.325239 2519 ts_tablet_manager.cc:1397] T 399e735e8c694f86ad14e4678e8d62ec P 2192a7dc109e4cabaa75ce3c13fb3ee4: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:45:05.325379 2519 raft_consensus.cc:348] T 399e735e8c694f86ad14e4678e8d62ec P 2192a7dc109e4cabaa75ce3c13fb3ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34173 } } peers { permanent_uuid: "28b81356f6fb4e4d874a2fc241de62a1" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35535 } } peers { permanent_uuid: "d819ce52bb964e15b7d22471126caf8b" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44617 } }
I20260808 14:45:05.325502 2519 raft_consensus.cc:374] T 399e735e8c694f86ad14e4678e8d62ec P 2192a7dc109e4cabaa75ce3c13fb3ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:45:05.325541 2519 raft_consensus.cc:729] T 399e735e8c694f86ad14e4678e8d62ec P 2192a7dc109e4cabaa75ce3c13fb3ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2192a7dc109e4cabaa75ce3c13fb3ee4, State: Initialized, Role: FOLLOWER
I20260808 14:45:05.325587 2519 consensus_queue.cc:260] T 399e735e8c694f86ad14e4678e8d62ec P 2192a7dc109e4cabaa75ce3c13fb3ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34173 } } peers { permanent_uuid: "28b81356f6fb4e4d874a2fc241de62a1" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35535 } } peers { permanent_uuid: "d819ce52bb964e15b7d22471126caf8b" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44617 } }
I20260808 14:45:05.325682 2519 ts_tablet_manager.cc:1428] T 399e735e8c694f86ad14e4678e8d62ec P 2192a7dc109e4cabaa75ce3c13fb3ee4: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:05.325726 2531 tablet_replica.cc:439] T 399e735e8c694f86ad14e4678e8d62ec P 2192a7dc109e4cabaa75ce3c13fb3ee4: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34173 } } peers { permanent_uuid: "28b81356f6fb4e4d874a2fc241de62a1" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35535 } } peers { permanent_uuid: "d819ce52bb964e15b7d22471126caf8b" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44617 } } }
I20260808 14:45:05.325800 2531 tablet_replica.cc:442] T 399e735e8c694f86ad14e4678e8d62ec P 2192a7dc109e4cabaa75ce3c13fb3ee4: This TxnStatusTablet replica's current role is: FOLLOWER
W20260808 14:45:05.389294 2491 tablet.cc:2369] T 399e735e8c694f86ad14e4678e8d62ec P d819ce52bb964e15b7d22471126caf8b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:45:05.532629 2532 raft_consensus.cc:482] T 399e735e8c694f86ad14e4678e8d62ec P 28b81356f6fb4e4d874a2fc241de62a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:45:05.532743 2532 raft_consensus.cc:504] T 399e735e8c694f86ad14e4678e8d62ec P 28b81356f6fb4e4d874a2fc241de62a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34173 } } peers { permanent_uuid: "28b81356f6fb4e4d874a2fc241de62a1" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35535 } } peers { permanent_uuid: "d819ce52bb964e15b7d22471126caf8b" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44617 } }
I20260808 14:45:05.532886 2532 leader_election.cc:288] T 399e735e8c694f86ad14e4678e8d62ec P 28b81356f6fb4e4d874a2fc241de62a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2192a7dc109e4cabaa75ce3c13fb3ee4 (127.30.214.129:34173), d819ce52bb964e15b7d22471126caf8b (127.30.214.131:44617)
I20260808 14:45:05.533172 2011 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "399e735e8c694f86ad14e4678e8d62ec" candidate_uuid: "28b81356f6fb4e4d874a2fc241de62a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4" is_pre_election: true
I20260808 14:45:05.533203 2428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "399e735e8c694f86ad14e4678e8d62ec" candidate_uuid: "28b81356f6fb4e4d874a2fc241de62a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d819ce52bb964e15b7d22471126caf8b" is_pre_election: true
I20260808 14:45:05.533267 2011 raft_consensus.cc:2454] T 399e735e8c694f86ad14e4678e8d62ec P 2192a7dc109e4cabaa75ce3c13fb3ee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 28b81356f6fb4e4d874a2fc241de62a1 in term 0.
I20260808 14:45:05.533313 2428 raft_consensus.cc:2454] T 399e735e8c694f86ad14e4678e8d62ec P d819ce52bb964e15b7d22471126caf8b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 28b81356f6fb4e4d874a2fc241de62a1 in term 0.
I20260808 14:45:05.533460 2124 leader_election.cc:302] T 399e735e8c694f86ad14e4678e8d62ec P 28b81356f6fb4e4d874a2fc241de62a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2192a7dc109e4cabaa75ce3c13fb3ee4, 28b81356f6fb4e4d874a2fc241de62a1; no voters:
I20260808 14:45:05.533567 2532 raft_consensus.cc:2781] T 399e735e8c694f86ad14e4678e8d62ec P 28b81356f6fb4e4d874a2fc241de62a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:45:05.533623 2532 raft_consensus.cc:482] T 399e735e8c694f86ad14e4678e8d62ec P 28b81356f6fb4e4d874a2fc241de62a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:45:05.533639 2532 raft_consensus.cc:3037] T 399e735e8c694f86ad14e4678e8d62ec P 28b81356f6fb4e4d874a2fc241de62a1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:05.534341 2532 raft_consensus.cc:504] T 399e735e8c694f86ad14e4678e8d62ec P 28b81356f6fb4e4d874a2fc241de62a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34173 } } peers { permanent_uuid: "28b81356f6fb4e4d874a2fc241de62a1" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35535 } } peers { permanent_uuid: "d819ce52bb964e15b7d22471126caf8b" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44617 } }
I20260808 14:45:05.534467 2532 leader_election.cc:288] T 399e735e8c694f86ad14e4678e8d62ec P 28b81356f6fb4e4d874a2fc241de62a1 [CANDIDATE]: Term 1 election: Requested vote from peers 2192a7dc109e4cabaa75ce3c13fb3ee4 (127.30.214.129:34173), d819ce52bb964e15b7d22471126caf8b (127.30.214.131:44617)
I20260808 14:45:05.534648 2011 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "399e735e8c694f86ad14e4678e8d62ec" candidate_uuid: "28b81356f6fb4e4d874a2fc241de62a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4"
I20260808 14:45:05.534741 2011 raft_consensus.cc:3037] T 399e735e8c694f86ad14e4678e8d62ec P 2192a7dc109e4cabaa75ce3c13fb3ee4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:05.534704 2428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "399e735e8c694f86ad14e4678e8d62ec" candidate_uuid: "28b81356f6fb4e4d874a2fc241de62a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d819ce52bb964e15b7d22471126caf8b"
I20260808 14:45:05.534776 2428 raft_consensus.cc:3037] T 399e735e8c694f86ad14e4678e8d62ec P d819ce52bb964e15b7d22471126caf8b [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:05.535550 2428 raft_consensus.cc:2454] T 399e735e8c694f86ad14e4678e8d62ec P d819ce52bb964e15b7d22471126caf8b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28b81356f6fb4e4d874a2fc241de62a1 in term 1.
I20260808 14:45:05.535547 2011 raft_consensus.cc:2454] T 399e735e8c694f86ad14e4678e8d62ec P 2192a7dc109e4cabaa75ce3c13fb3ee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28b81356f6fb4e4d874a2fc241de62a1 in term 1.
I20260808 14:45:05.535765 2124 leader_election.cc:302] T 399e735e8c694f86ad14e4678e8d62ec P 28b81356f6fb4e4d874a2fc241de62a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28b81356f6fb4e4d874a2fc241de62a1, d819ce52bb964e15b7d22471126caf8b; no voters:
I20260808 14:45:05.535861 2532 raft_consensus.cc:2781] T 399e735e8c694f86ad14e4678e8d62ec P 28b81356f6fb4e4d874a2fc241de62a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:45:05.535938 2532 raft_consensus.cc:686] T 399e735e8c694f86ad14e4678e8d62ec P 28b81356f6fb4e4d874a2fc241de62a1 [term 1 LEADER]: Becoming Leader. State: Replica: 28b81356f6fb4e4d874a2fc241de62a1, State: Running, Role: LEADER
I20260808 14:45:05.536006 2532 consensus_queue.cc:237] T 399e735e8c694f86ad14e4678e8d62ec P 28b81356f6fb4e4d874a2fc241de62a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34173 } } peers { permanent_uuid: "28b81356f6fb4e4d874a2fc241de62a1" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35535 } } peers { permanent_uuid: "d819ce52bb964e15b7d22471126caf8b" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44617 } }
I20260808 14:45:05.536314 2535 tablet_replica.cc:439] T 399e735e8c694f86ad14e4678e8d62ec P 28b81356f6fb4e4d874a2fc241de62a1: TxnStatusTablet state changed. Reason: New leader 28b81356f6fb4e4d874a2fc241de62a1. Latest consensus state: current_term: 1 leader_uuid: "28b81356f6fb4e4d874a2fc241de62a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34173 } } peers { permanent_uuid: "28b81356f6fb4e4d874a2fc241de62a1" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35535 } } peers { permanent_uuid: "d819ce52bb964e15b7d22471126caf8b" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44617 } } }
I20260808 14:45:05.536386 2535 tablet_replica.cc:442] T 399e735e8c694f86ad14e4678e8d62ec P 28b81356f6fb4e4d874a2fc241de62a1: This TxnStatusTablet replica's current role is: LEADER
I20260808 14:45:05.536554 2551 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 14:45:05.536682 2551 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 14:45:05.536667 1752 catalog_manager.cc:5495] T 399e735e8c694f86ad14e4678e8d62ec P 28b81356f6fb4e4d874a2fc241de62a1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 28b81356f6fb4e4d874a2fc241de62a1 (127.30.214.130). New cstate: current_term: 1 leader_uuid: "28b81356f6fb4e4d874a2fc241de62a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28b81356f6fb4e4d874a2fc241de62a1" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d819ce52bb964e15b7d22471126caf8b" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44617 } health_report { overall_health: UNKNOWN } } }
I20260808 14:45:05.555717 2514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:05.552532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36076 (local address 127.30.214.130:35535)
0808 14:45:05.552577 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:05.552578 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:05.552659 (+ 81us) server_negotiation.cc:407] Connection header received
0808 14:45:05.552760 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:05.552761 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:05.552779 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:05.552847 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:45:05.552989 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:05.553546 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:05.554923 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:05.555124 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:05.555187 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:05.555387 (+ 200us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:45:05.555501 (+ 114us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:45:05.555559 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:05.555616 (+ 57us) server_negotiation.cc:299] Negotiation successful
0808 14:45:05.555636 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 14:45:05.555761 2544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:05.552485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.130:35535 (local address 127.0.0.1:36076)
0808 14:45:05.552599 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:05.552609 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:05.552673 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:05.552867 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:05.552868 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:05.552869 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 14:45:05.552931 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:05.552935 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:05.553655 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:05.553656 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:05.554818 (+ 1162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:05.554822 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:05.555200 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:05.555201 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:05.555274 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:05.555301 (+ 27us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 14:45:05.555556 (+ 255us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 14:45:05.555562 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 14:45:05.555612 (+ 50us) client_negotiation.cc:240] Negotiation successful
0808 14:45:05.555670 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":65}
I20260808 14:45:05.557618 2428 raft_consensus.cc:1261] T 399e735e8c694f86ad14e4678e8d62ec P d819ce52bb964e15b7d22471126caf8b [term 1 FOLLOWER]: Refusing update from remote peer 28b81356f6fb4e4d874a2fc241de62a1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:45:05.557673 2011 raft_consensus.cc:1261] T 399e735e8c694f86ad14e4678e8d62ec P 2192a7dc109e4cabaa75ce3c13fb3ee4 [term 1 FOLLOWER]: Refusing update from remote peer 28b81356f6fb4e4d874a2fc241de62a1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:45:05.557991 2535 consensus_queue.cc:1035] T 399e735e8c694f86ad14e4678e8d62ec P 28b81356f6fb4e4d874a2fc241de62a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d819ce52bb964e15b7d22471126caf8b" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:45:05.558126 2532 consensus_queue.cc:1035] T 399e735e8c694f86ad14e4678e8d62ec P 28b81356f6fb4e4d874a2fc241de62a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:45:05.559401 2531 tablet_replica.cc:439] T 399e735e8c694f86ad14e4678e8d62ec P 2192a7dc109e4cabaa75ce3c13fb3ee4: TxnStatusTablet state changed. Reason: New leader 28b81356f6fb4e4d874a2fc241de62a1. Latest consensus state: current_term: 1 leader_uuid: "28b81356f6fb4e4d874a2fc241de62a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34173 } } peers { permanent_uuid: "28b81356f6fb4e4d874a2fc241de62a1" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35535 } } peers { permanent_uuid: "d819ce52bb964e15b7d22471126caf8b" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44617 } } }
I20260808 14:45:05.559514 2531 tablet_replica.cc:442] T 399e735e8c694f86ad14e4678e8d62ec P 2192a7dc109e4cabaa75ce3c13fb3ee4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:45:05.559525 2527 tablet_replica.cc:439] T 399e735e8c694f86ad14e4678e8d62ec P d819ce52bb964e15b7d22471126caf8b: TxnStatusTablet state changed. Reason: New leader 28b81356f6fb4e4d874a2fc241de62a1. Latest consensus state: current_term: 1 leader_uuid: "28b81356f6fb4e4d874a2fc241de62a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34173 } } peers { permanent_uuid: "28b81356f6fb4e4d874a2fc241de62a1" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35535 } } peers { permanent_uuid: "d819ce52bb964e15b7d22471126caf8b" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44617 } } }
I20260808 14:45:05.559649 2527 tablet_replica.cc:442] T 399e735e8c694f86ad14e4678e8d62ec P d819ce52bb964e15b7d22471126caf8b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:45:05.560665 2532 tablet_replica.cc:439] T 399e735e8c694f86ad14e4678e8d62ec P 28b81356f6fb4e4d874a2fc241de62a1: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "28b81356f6fb4e4d874a2fc241de62a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34173 } } peers { permanent_uuid: "28b81356f6fb4e4d874a2fc241de62a1" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35535 } } peers { permanent_uuid: "d819ce52bb964e15b7d22471126caf8b" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44617 } } }
I20260808 14:45:05.560765 2532 tablet_replica.cc:442] T 399e735e8c694f86ad14e4678e8d62ec P 28b81356f6fb4e4d874a2fc241de62a1: This TxnStatusTablet replica's current role is: LEADER
I20260808 14:45:05.560755 2527 tablet_replica.cc:439] T 399e735e8c694f86ad14e4678e8d62ec P d819ce52bb964e15b7d22471126caf8b: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "28b81356f6fb4e4d874a2fc241de62a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34173 } } peers { permanent_uuid: "28b81356f6fb4e4d874a2fc241de62a1" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35535 } } peers { permanent_uuid: "d819ce52bb964e15b7d22471126caf8b" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44617 } } }
I20260808 14:45:05.560856 2527 tablet_replica.cc:442] T 399e735e8c694f86ad14e4678e8d62ec P d819ce52bb964e15b7d22471126caf8b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:45:05.560922 2555 mvcc.cc:205] Tried to move back new op lower bound from 7316276451561148416 to 7316276451475857408. Current Snapshot: MvccSnapshot[applied={T|T < 7316276451561148416}]
I20260808 14:45:05.562148 2535 tablet_replica.cc:439] T 399e735e8c694f86ad14e4678e8d62ec P 28b81356f6fb4e4d874a2fc241de62a1: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "28b81356f6fb4e4d874a2fc241de62a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34173 } } peers { permanent_uuid: "28b81356f6fb4e4d874a2fc241de62a1" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35535 } } peers { permanent_uuid: "d819ce52bb964e15b7d22471126caf8b" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44617 } } }
I20260808 14:45:05.562248 2535 tablet_replica.cc:442] T 399e735e8c694f86ad14e4678e8d62ec P 28b81356f6fb4e4d874a2fc241de62a1: This TxnStatusTablet replica's current role is: LEADER
I20260808 14:45:05.562546 2560 mvcc.cc:205] Tried to move back new op lower bound from 7316276451561148416 to 7316276451475857408. Current Snapshot: MvccSnapshot[applied={T|T < 7316276451561148416}]
I20260808 14:45:05.563027 2531 tablet_replica.cc:439] T 399e735e8c694f86ad14e4678e8d62ec P 2192a7dc109e4cabaa75ce3c13fb3ee4: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "28b81356f6fb4e4d874a2fc241de62a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34173 } } peers { permanent_uuid: "28b81356f6fb4e4d874a2fc241de62a1" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35535 } } peers { permanent_uuid: "d819ce52bb964e15b7d22471126caf8b" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44617 } } }
I20260808 14:45:05.563123 2531 tablet_replica.cc:442] T 399e735e8c694f86ad14e4678e8d62ec P 2192a7dc109e4cabaa75ce3c13fb3ee4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:45:05.566565 2514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:05.563855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36088 (local address 127.30.214.130:35535)
0808 14:45:05.563895 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:05.563897 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:05.563932 (+ 35us) server_negotiation.cc:407] Connection header received
0808 14:45:05.564002 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:05.564002 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:05.564011 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:05.564052 (+ 41us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:45:05.564190 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:05.564646 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:05.565760 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:05.566007 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:05.566101 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:05.566310 (+ 209us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:45:05.566353 (+ 43us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:45:05.566414 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:05.566478 (+ 64us) server_negotiation.cc:299] Negotiation successful
0808 14:45:05.566506 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 14:45:05.572404 2514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:05.569579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.130:39919 (local address 127.30.214.130:35535)
0808 14:45:05.569613 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:05.569615 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:05.569640 (+ 25us) server_negotiation.cc:407] Connection header received
0808 14:45:05.569660 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:05.569661 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:05.569669 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:05.569706 (+ 37us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:45:05.569858 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:05.570312 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:05.571504 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:05.571694 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:05.571758 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:05.572181 (+ 423us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:45:05.572209 (+ 28us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:45:05.572251 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:05.572327 (+ 76us) server_negotiation.cc:299] Negotiation successful
0808 14:45:05.572346 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 14:45:05.572593 2574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:05.569326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.130:35535 (local address 127.30.214.130:39919)
0808 14:45:05.569523 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:05.569537 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:05.569594 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:05.569725 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:05.569725 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:05.569726 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 14:45:05.569801 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:05.569804 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:05.570372 (+ 568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:05.570373 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:05.571357 (+ 984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:05.571360 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:05.571834 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:05.571836 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:05.571943 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:05.571981 (+ 38us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 14:45:05.572271 (+ 290us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 14:45:05.572273 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 14:45:05.572325 (+ 52us) client_negotiation.cc:240] Negotiation successful
0808 14:45:05.572405 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":83,"threads_started":1}
I20260808 14:45:05.575841 2011 raft_consensus.cc:1261] T db1ea691ed9d483dada508c27b3b435f P 2192a7dc109e4cabaa75ce3c13fb3ee4 [term 1 FOLLOWER]: Refusing update from remote peer 28b81356f6fb4e4d874a2fc241de62a1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:45:05.575887 2428 raft_consensus.cc:1261] T db1ea691ed9d483dada508c27b3b435f P d819ce52bb964e15b7d22471126caf8b [term 1 FOLLOWER]: Refusing update from remote peer 28b81356f6fb4e4d874a2fc241de62a1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:45:05.576136 2535 consensus_queue.cc:1035] T db1ea691ed9d483dada508c27b3b435f P 28b81356f6fb4e4d874a2fc241de62a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:45:05.576292 2532 consensus_queue.cc:1035] T db1ea691ed9d483dada508c27b3b435f P 28b81356f6fb4e4d874a2fc241de62a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d819ce52bb964e15b7d22471126caf8b" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:45:05.579216 2559 mvcc.cc:205] Tried to move back new op lower bound from 7316276451636998144 to 7316276450366947328. Current Snapshot: MvccSnapshot[applied={T|T < 7316276451636998144}]
I20260808 14:45:05.591595 1753 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57786:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:45:05.591713 1753 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57786:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:45:05.592473 1753 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 74f16d9037bd49b8bdfa995713fd362a: Sending DeleteTablet for 3 replicas of tablet db1ea691ed9d483dada508c27b3b435f
I20260808 14:45:05.592758 2194 tablet_service.cc:1514] Processing DeleteTablet for tablet db1ea691ed9d483dada508c27b3b435f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:45:05 UTC) from {username='kudu', principal='kudu/127.30.214.190@KRBTEST.COM'} at 127.0.0.1:36070
I20260808 14:45:05.592850 2400 tablet_service.cc:1514] Processing DeleteTablet for tablet db1ea691ed9d483dada508c27b3b435f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:45:05 UTC) from {username='kudu', principal='kudu/127.30.214.190@KRBTEST.COM'} at 127.0.0.1:38648
I20260808 14:45:05.593148 2584 tablet_replica.cc:330] T db1ea691ed9d483dada508c27b3b435f P d819ce52bb964e15b7d22471126caf8b: stopping tablet replica
I20260808 14:45:05.593133 1981 tablet_service.cc:1514] Processing DeleteTablet for tablet db1ea691ed9d483dada508c27b3b435f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:45:05 UTC) from {username='kudu', principal='kudu/127.30.214.190@KRBTEST.COM'} at 127.0.0.1:34176
I20260808 14:45:05.593281 2584 raft_consensus.cc:2229] T db1ea691ed9d483dada508c27b3b435f P d819ce52bb964e15b7d22471126caf8b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:45:05.593351 2584 raft_consensus.cc:2258] T db1ea691ed9d483dada508c27b3b435f P d819ce52bb964e15b7d22471126caf8b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:45:05.593465 2587 tablet_replica.cc:330] T db1ea691ed9d483dada508c27b3b435f P 2192a7dc109e4cabaa75ce3c13fb3ee4: stopping tablet replica
I20260808 14:45:05.593358 1753 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57786:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:45:05.593550 1753 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:45:05.593580 2587 raft_consensus.cc:2229] T db1ea691ed9d483dada508c27b3b435f P 2192a7dc109e4cabaa75ce3c13fb3ee4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:45:05.593633 2587 raft_consensus.cc:2258] T db1ea691ed9d483dada508c27b3b435f P 2192a7dc109e4cabaa75ce3c13fb3ee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:45:05.594120 2587 ts_tablet_manager.cc:1905] T db1ea691ed9d483dada508c27b3b435f P 2192a7dc109e4cabaa75ce3c13fb3ee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:45:05.594269 2584 ts_tablet_manager.cc:1905] T db1ea691ed9d483dada508c27b3b435f P d819ce52bb964e15b7d22471126caf8b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:45:05.594897 2400 tablet_service.cc:1467] Processing CreateTablet for tablet d0b0de9ae3714793a8a600fcdeb64e1a (DEFAULT_TABLE table=test-table [id=be6a34cd527b4dcbbb55f716a3256f96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:45:05.594899 2194 tablet_service.cc:1467] Processing CreateTablet for tablet d0b0de9ae3714793a8a600fcdeb64e1a (DEFAULT_TABLE table=test-table [id=be6a34cd527b4dcbbb55f716a3256f96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:45:05.595033 2194 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d0b0de9ae3714793a8a600fcdeb64e1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:45:05.595060 1981 tablet_service.cc:1467] Processing CreateTablet for tablet d0b0de9ae3714793a8a600fcdeb64e1a (DEFAULT_TABLE table=test-table [id=be6a34cd527b4dcbbb55f716a3256f96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:45:05.595280 1981 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d0b0de9ae3714793a8a600fcdeb64e1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:45:05.596163 2587 ts_tablet_manager.cc:1918] T db1ea691ed9d483dada508c27b3b435f P 2192a7dc109e4cabaa75ce3c13fb3ee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:45:05.596280 2587 log.cc:1196] T db1ea691ed9d483dada508c27b3b435f P 2192a7dc109e4cabaa75ce3c13fb3ee4: Deleting WAL directory at /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/ts-0/wal/wals/db1ea691ed9d483dada508c27b3b435f
I20260808 14:45:05.596297 2519 tablet_bootstrap.cc:492] T d0b0de9ae3714793a8a600fcdeb64e1a P 2192a7dc109e4cabaa75ce3c13fb3ee4: Bootstrap starting.
I20260808 14:45:05.596349 2526 tablet_bootstrap.cc:492] T d0b0de9ae3714793a8a600fcdeb64e1a P 28b81356f6fb4e4d874a2fc241de62a1: Bootstrap starting.
I20260808 14:45:05.596546 2400 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d0b0de9ae3714793a8a600fcdeb64e1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:45:05.596753 2519 tablet_bootstrap.cc:654] T d0b0de9ae3714793a8a600fcdeb64e1a P 2192a7dc109e4cabaa75ce3c13fb3ee4: Neither blocks nor log segments found. Creating new log.
I20260808 14:45:05.596753 2526 tablet_bootstrap.cc:654] T d0b0de9ae3714793a8a600fcdeb64e1a P 28b81356f6fb4e4d874a2fc241de62a1: Neither blocks nor log segments found. Creating new log.
I20260808 14:45:05.597366 2587 ts_tablet_manager.cc:1939] T db1ea691ed9d483dada508c27b3b435f P 2192a7dc109e4cabaa75ce3c13fb3ee4: Deleting consensus metadata
I20260808 14:45:05.597796 2518 tablet_bootstrap.cc:492] T d0b0de9ae3714793a8a600fcdeb64e1a P d819ce52bb964e15b7d22471126caf8b: Bootstrap starting.
I20260808 14:45:05.597797 2584 ts_tablet_manager.cc:1918] T db1ea691ed9d483dada508c27b3b435f P d819ce52bb964e15b7d22471126caf8b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:45:05.597854 1731 catalog_manager.cc:4841] TS 2192a7dc109e4cabaa75ce3c13fb3ee4 (127.30.214.129:34173): tablet db1ea691ed9d483dada508c27b3b435f (table test-table [id=aa7ee4630b454caa9bf7f68db9bd65d0]) successfully deleted
I20260808 14:45:05.597898 2584 log.cc:1196] T db1ea691ed9d483dada508c27b3b435f P d819ce52bb964e15b7d22471126caf8b: Deleting WAL directory at /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/ts-2/wal/wals/db1ea691ed9d483dada508c27b3b435f
I20260808 14:45:05.598193 2584 ts_tablet_manager.cc:1939] T db1ea691ed9d483dada508c27b3b435f P d819ce52bb964e15b7d22471126caf8b: Deleting consensus metadata
I20260808 14:45:05.598243 2518 tablet_bootstrap.cc:654] T d0b0de9ae3714793a8a600fcdeb64e1a P d819ce52bb964e15b7d22471126caf8b: Neither blocks nor log segments found. Creating new log.
I20260808 14:45:05.598660 1731 catalog_manager.cc:4841] TS d819ce52bb964e15b7d22471126caf8b (127.30.214.131:44617): tablet db1ea691ed9d483dada508c27b3b435f (table test-table [id=aa7ee4630b454caa9bf7f68db9bd65d0]) successfully deleted
I20260808 14:45:05.599064 2518 tablet_bootstrap.cc:492] T d0b0de9ae3714793a8a600fcdeb64e1a P d819ce52bb964e15b7d22471126caf8b: No bootstrap required, opened a new log
I20260808 14:45:05.599118 2518 ts_tablet_manager.cc:1397] T d0b0de9ae3714793a8a600fcdeb64e1a P d819ce52bb964e15b7d22471126caf8b: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260808 14:45:05.599265 2518 raft_consensus.cc:348] T d0b0de9ae3714793a8a600fcdeb64e1a P d819ce52bb964e15b7d22471126caf8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34173 } } peers { permanent_uuid: "28b81356f6fb4e4d874a2fc241de62a1" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35535 } } peers { permanent_uuid: "d819ce52bb964e15b7d22471126caf8b" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44617 } }
I20260808 14:45:05.599326 2518 raft_consensus.cc:374] T d0b0de9ae3714793a8a600fcdeb64e1a P d819ce52bb964e15b7d22471126caf8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:45:05.599359 2518 raft_consensus.cc:729] T d0b0de9ae3714793a8a600fcdeb64e1a P d819ce52bb964e15b7d22471126caf8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d819ce52bb964e15b7d22471126caf8b, State: Initialized, Role: FOLLOWER
I20260808 14:45:05.599409 2518 consensus_queue.cc:260] T d0b0de9ae3714793a8a600fcdeb64e1a P d819ce52bb964e15b7d22471126caf8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34173 } } peers { permanent_uuid: "28b81356f6fb4e4d874a2fc241de62a1" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35535 } } peers { permanent_uuid: "d819ce52bb964e15b7d22471126caf8b" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44617 } }
I20260808 14:45:05.599509 2518 ts_tablet_manager.cc:1428] T d0b0de9ae3714793a8a600fcdeb64e1a P d819ce52bb964e15b7d22471126caf8b: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:05.601912 2526 tablet_bootstrap.cc:492] T d0b0de9ae3714793a8a600fcdeb64e1a P 28b81356f6fb4e4d874a2fc241de62a1: No bootstrap required, opened a new log
I20260808 14:45:05.601991 2526 ts_tablet_manager.cc:1397] T d0b0de9ae3714793a8a600fcdeb64e1a P 28b81356f6fb4e4d874a2fc241de62a1: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20260808 14:45:05.602025 2580 tablet_replica.cc:330] T db1ea691ed9d483dada508c27b3b435f P 28b81356f6fb4e4d874a2fc241de62a1: stopping tablet replica
I20260808 14:45:05.602109 2519 tablet_bootstrap.cc:492] T d0b0de9ae3714793a8a600fcdeb64e1a P 2192a7dc109e4cabaa75ce3c13fb3ee4: No bootstrap required, opened a new log
I20260808 14:45:05.602154 2519 ts_tablet_manager.cc:1397] T d0b0de9ae3714793a8a600fcdeb64e1a P 2192a7dc109e4cabaa75ce3c13fb3ee4: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20260808 14:45:05.602159 2580 raft_consensus.cc:2229] T db1ea691ed9d483dada508c27b3b435f P 28b81356f6fb4e4d874a2fc241de62a1 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:45:05.602154 2526 raft_consensus.cc:348] T d0b0de9ae3714793a8a600fcdeb64e1a P 28b81356f6fb4e4d874a2fc241de62a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34173 } } peers { permanent_uuid: "28b81356f6fb4e4d874a2fc241de62a1" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35535 } } peers { permanent_uuid: "d819ce52bb964e15b7d22471126caf8b" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44617 } }
I20260808 14:45:05.602249 2526 raft_consensus.cc:374] T d0b0de9ae3714793a8a600fcdeb64e1a P 28b81356f6fb4e4d874a2fc241de62a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:45:05.602268 2526 raft_consensus.cc:729] T d0b0de9ae3714793a8a600fcdeb64e1a P 28b81356f6fb4e4d874a2fc241de62a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28b81356f6fb4e4d874a2fc241de62a1, State: Initialized, Role: FOLLOWER
I20260808 14:45:05.602299 2580 raft_consensus.cc:2258] T db1ea691ed9d483dada508c27b3b435f P 28b81356f6fb4e4d874a2fc241de62a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:45:05.602312 2526 consensus_queue.cc:260] T d0b0de9ae3714793a8a600fcdeb64e1a P 28b81356f6fb4e4d874a2fc241de62a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34173 } } peers { permanent_uuid: "28b81356f6fb4e4d874a2fc241de62a1" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35535 } } peers { permanent_uuid: "d819ce52bb964e15b7d22471126caf8b" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44617 } }
I20260808 14:45:05.602294 2519 raft_consensus.cc:348] T d0b0de9ae3714793a8a600fcdeb64e1a P 2192a7dc109e4cabaa75ce3c13fb3ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34173 } } peers { permanent_uuid: "28b81356f6fb4e4d874a2fc241de62a1" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35535 } } peers { permanent_uuid: "d819ce52bb964e15b7d22471126caf8b" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44617 } }
I20260808 14:45:05.602360 2519 raft_consensus.cc:374] T d0b0de9ae3714793a8a600fcdeb64e1a P 2192a7dc109e4cabaa75ce3c13fb3ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:45:05.602377 2519 raft_consensus.cc:729] T d0b0de9ae3714793a8a600fcdeb64e1a P 2192a7dc109e4cabaa75ce3c13fb3ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2192a7dc109e4cabaa75ce3c13fb3ee4, State: Initialized, Role: FOLLOWER
I20260808 14:45:05.602393 2526 ts_tablet_manager.cc:1428] T d0b0de9ae3714793a8a600fcdeb64e1a P 28b81356f6fb4e4d874a2fc241de62a1: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 14:45:05.602420 2519 consensus_queue.cc:260] T d0b0de9ae3714793a8a600fcdeb64e1a P 2192a7dc109e4cabaa75ce3c13fb3ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34173 } } peers { permanent_uuid: "28b81356f6fb4e4d874a2fc241de62a1" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35535 } } peers { permanent_uuid: "d819ce52bb964e15b7d22471126caf8b" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44617 } }
I20260808 14:45:05.602514 2519 ts_tablet_manager.cc:1428] T d0b0de9ae3714793a8a600fcdeb64e1a P 2192a7dc109e4cabaa75ce3c13fb3ee4: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 14:45:05.602777 2580 ts_tablet_manager.cc:1905] T db1ea691ed9d483dada508c27b3b435f P 28b81356f6fb4e4d874a2fc241de62a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:45:05.604389 2580 ts_tablet_manager.cc:1918] T db1ea691ed9d483dada508c27b3b435f P 28b81356f6fb4e4d874a2fc241de62a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:45:05.604475 2580 log.cc:1196] T db1ea691ed9d483dada508c27b3b435f P 28b81356f6fb4e4d874a2fc241de62a1: Deleting WAL directory at /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/ts-1/wal/wals/db1ea691ed9d483dada508c27b3b435f
I20260808 14:45:05.604732 2580 ts_tablet_manager.cc:1939] T db1ea691ed9d483dada508c27b3b435f P 28b81356f6fb4e4d874a2fc241de62a1: Deleting consensus metadata
I20260808 14:45:05.605132 1728 catalog_manager.cc:4841] TS 28b81356f6fb4e4d874a2fc241de62a1 (127.30.214.130:35535): tablet db1ea691ed9d483dada508c27b3b435f (table test-table [id=aa7ee4630b454caa9bf7f68db9bd65d0]) successfully deleted
I20260808 14:45:05.702174 2527 raft_consensus.cc:482] T d0b0de9ae3714793a8a600fcdeb64e1a P d819ce52bb964e15b7d22471126caf8b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:45:05.702298 2527 raft_consensus.cc:504] T d0b0de9ae3714793a8a600fcdeb64e1a P d819ce52bb964e15b7d22471126caf8b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34173 } } peers { permanent_uuid: "28b81356f6fb4e4d874a2fc241de62a1" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35535 } } peers { permanent_uuid: "d819ce52bb964e15b7d22471126caf8b" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44617 } }
I20260808 14:45:05.702711 2527 leader_election.cc:288] T d0b0de9ae3714793a8a600fcdeb64e1a P d819ce52bb964e15b7d22471126caf8b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2192a7dc109e4cabaa75ce3c13fb3ee4 (127.30.214.129:34173), 28b81356f6fb4e4d874a2fc241de62a1 (127.30.214.130:35535)
I20260808 14:45:05.705687 2514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:05.703148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:59953 (local address 127.30.214.130:35535)
0808 14:45:05.703194 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:05.703196 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:05.703265 (+ 69us) server_negotiation.cc:407] Connection header received
0808 14:45:05.703322 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:05.703323 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:05.703333 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:05.703386 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:45:05.703531 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:05.703997 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:05.704933 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:05.705297 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:05.705360 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:05.705370 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:05.705571 (+ 201us) server_negotiation.cc:299] Negotiation successful
0808 14:45:05.705616 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 14:45:05.706171 2595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:05.702915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.130:35535 (local address 127.30.214.131:59953)
0808 14:45:05.703222 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:05.703230 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:05.703272 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:05.703389 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:05.703390 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:05.703392 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:45:05.703470 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:05.703472 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:05.704076 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:05.704077 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:05.704840 (+ 763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:05.704842 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:05.705368 (+ 526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:05.705369 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:05.705474 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:05.705478 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:45:05.706024 (+ 546us) client_negotiation.cc:240] Negotiation successful
0808 14:45:05.706081 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":298,"mutex_wait_us":3,"thread_start_us":58,"threads_started":1}
I20260808 14:45:05.706565 2222 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0b0de9ae3714793a8a600fcdeb64e1a" candidate_uuid: "d819ce52bb964e15b7d22471126caf8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28b81356f6fb4e4d874a2fc241de62a1" is_pre_election: true
I20260808 14:45:05.706703 2596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:05.702915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.129:34173 (local address 127.30.214.131:37099)
0808 14:45:05.703080 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:05.703092 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:05.703156 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:05.703350 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:05.703352 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:05.703355 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:45:05.703414 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:05.703416 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:05.704365 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:05.704366 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:05.705682 (+ 1316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:05.705685 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:05.706462 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:05.706463 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:05.706536 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:05.706540 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:45:05.706590 (+ 50us) client_negotiation.cc:240] Negotiation successful
0808 14:45:05.706631 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":60,"threads_started":1}
I20260808 14:45:05.706722 2517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:05.703106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:37099 (local address 127.30.214.129:34173)
0808 14:45:05.703154 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:05.703156 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:05.703170 (+ 14us) server_negotiation.cc:407] Connection header received
0808 14:45:05.703206 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:05.703207 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:05.703216 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:05.703291 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:45:05.703490 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:05.704262 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:05.705790 (+ 1528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:05.706349 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:05.706395 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:05.706404 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:05.706616 (+ 212us) server_negotiation.cc:299] Negotiation successful
0808 14:45:05.706662 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 14:45:05.706717 2222 raft_consensus.cc:2454] T d0b0de9ae3714793a8a600fcdeb64e1a P 28b81356f6fb4e4d874a2fc241de62a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d819ce52bb964e15b7d22471126caf8b in term 0.
I20260808 14:45:05.706934 2324 leader_election.cc:302] T d0b0de9ae3714793a8a600fcdeb64e1a P d819ce52bb964e15b7d22471126caf8b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28b81356f6fb4e4d874a2fc241de62a1, d819ce52bb964e15b7d22471126caf8b; no voters:
I20260808 14:45:05.706993 2011 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0b0de9ae3714793a8a600fcdeb64e1a" candidate_uuid: "d819ce52bb964e15b7d22471126caf8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4" is_pre_election: true
I20260808 14:45:05.707067 2011 raft_consensus.cc:2454] T d0b0de9ae3714793a8a600fcdeb64e1a P 2192a7dc109e4cabaa75ce3c13fb3ee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d819ce52bb964e15b7d22471126caf8b in term 0.
I20260808 14:45:05.707079 2527 raft_consensus.cc:2781] T d0b0de9ae3714793a8a600fcdeb64e1a P d819ce52bb964e15b7d22471126caf8b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:45:05.707111 2527 raft_consensus.cc:482] T d0b0de9ae3714793a8a600fcdeb64e1a P d819ce52bb964e15b7d22471126caf8b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:45:05.707134 2527 raft_consensus.cc:3037] T d0b0de9ae3714793a8a600fcdeb64e1a P d819ce52bb964e15b7d22471126caf8b [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:05.708040 2527 raft_consensus.cc:504] T d0b0de9ae3714793a8a600fcdeb64e1a P d819ce52bb964e15b7d22471126caf8b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34173 } } peers { permanent_uuid: "28b81356f6fb4e4d874a2fc241de62a1" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35535 } } peers { permanent_uuid: "d819ce52bb964e15b7d22471126caf8b" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44617 } }
I20260808 14:45:05.708197 2527 leader_election.cc:288] T d0b0de9ae3714793a8a600fcdeb64e1a P d819ce52bb964e15b7d22471126caf8b [CANDIDATE]: Term 1 election: Requested vote from peers 2192a7dc109e4cabaa75ce3c13fb3ee4 (127.30.214.129:34173), 28b81356f6fb4e4d874a2fc241de62a1 (127.30.214.130:35535)
I20260808 14:45:05.708362 2011 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0b0de9ae3714793a8a600fcdeb64e1a" candidate_uuid: "d819ce52bb964e15b7d22471126caf8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4"
I20260808 14:45:05.708396 2222 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0b0de9ae3714793a8a600fcdeb64e1a" candidate_uuid: "d819ce52bb964e15b7d22471126caf8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28b81356f6fb4e4d874a2fc241de62a1"
I20260808 14:45:05.708458 2222 raft_consensus.cc:3037] T d0b0de9ae3714793a8a600fcdeb64e1a P 28b81356f6fb4e4d874a2fc241de62a1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:05.708457 2011 raft_consensus.cc:3037] T d0b0de9ae3714793a8a600fcdeb64e1a P 2192a7dc109e4cabaa75ce3c13fb3ee4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:05.709215 2222 raft_consensus.cc:2454] T d0b0de9ae3714793a8a600fcdeb64e1a P 28b81356f6fb4e4d874a2fc241de62a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d819ce52bb964e15b7d22471126caf8b in term 1.
I20260808 14:45:05.709215 2011 raft_consensus.cc:2454] T d0b0de9ae3714793a8a600fcdeb64e1a P 2192a7dc109e4cabaa75ce3c13fb3ee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d819ce52bb964e15b7d22471126caf8b in term 1.
I20260808 14:45:05.709388 2326 leader_election.cc:302] T d0b0de9ae3714793a8a600fcdeb64e1a P d819ce52bb964e15b7d22471126caf8b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2192a7dc109e4cabaa75ce3c13fb3ee4, d819ce52bb964e15b7d22471126caf8b; no voters:
I20260808 14:45:05.709579 2527 raft_consensus.cc:2781] T d0b0de9ae3714793a8a600fcdeb64e1a P d819ce52bb964e15b7d22471126caf8b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:45:05.709730 2527 raft_consensus.cc:686] T d0b0de9ae3714793a8a600fcdeb64e1a P d819ce52bb964e15b7d22471126caf8b [term 1 LEADER]: Becoming Leader. State: Replica: d819ce52bb964e15b7d22471126caf8b, State: Running, Role: LEADER
I20260808 14:45:05.709797 2527 consensus_queue.cc:237] T d0b0de9ae3714793a8a600fcdeb64e1a P d819ce52bb964e15b7d22471126caf8b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34173 } } peers { permanent_uuid: "28b81356f6fb4e4d874a2fc241de62a1" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35535 } } peers { permanent_uuid: "d819ce52bb964e15b7d22471126caf8b" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44617 } }
I20260808 14:45:05.710506 1753 catalog_manager.cc:5495] T d0b0de9ae3714793a8a600fcdeb64e1a P d819ce52bb964e15b7d22471126caf8b reported cstate change: term changed from 0 to 1, leader changed from <none> to d819ce52bb964e15b7d22471126caf8b (127.30.214.131). New cstate: current_term: 1 leader_uuid: "d819ce52bb964e15b7d22471126caf8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28b81356f6fb4e4d874a2fc241de62a1" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d819ce52bb964e15b7d22471126caf8b" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44617 } health_report { overall_health: HEALTHY } } }
I20260808 14:45:05.717839 2515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:05.715100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38656 (local address 127.30.214.131:44617)
0808 14:45:05.715137 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:05.715139 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:05.715150 (+ 11us) server_negotiation.cc:407] Connection header received
0808 14:45:05.715234 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:05.715235 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:05.715252 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:05.715311 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:45:05.715425 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:05.715883 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:05.717004 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:05.717208 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:05.717272 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:05.717423 (+ 151us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:45:05.717601 (+ 178us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:45:05.717661 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:05.717715 (+ 54us) server_negotiation.cc:299] Negotiation successful
0808 14:45:05.717740 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 14:45:05.723572 2514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:05.720292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:40529 (local address 127.30.214.130:35535)
0808 14:45:05.720348 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:05.720350 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:05.720515 (+ 165us) server_negotiation.cc:407] Connection header received
0808 14:45:05.720569 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:05.720570 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:05.720581 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:05.720625 (+ 44us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:45:05.720760 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:05.721265 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:05.722547 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:05.722890 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:05.723037 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:05.723292 (+ 255us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:45:05.723343 (+ 51us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:45:05.723397 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:05.723467 (+ 70us) server_negotiation.cc:299] Negotiation successful
0808 14:45:05.723511 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 14:45:05.724014 2601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:05.720219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.130:35535 (local address 127.30.214.131:40529)
0808 14:45:05.720438 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:05.720449 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:05.720516 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:05.720629 (+ 113us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:05.720630 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:05.720632 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 14:45:05.720702 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:05.720703 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:05.721334 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:05.721335 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:05.722373 (+ 1038us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:05.722378 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:05.723031 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:05.723032 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:05.723116 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:05.723141 (+ 25us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 14:45:05.723411 (+ 270us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 14:45:05.723412 (+ 1us) client_negotiation.cc:769] Sending connection context
0808 14:45:05.723463 (+ 51us) client_negotiation.cc:240] Negotiation successful
0808 14:45:05.723517 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":87,"threads_started":1}
I20260808 14:45:05.726722 2222 raft_consensus.cc:1261] T d0b0de9ae3714793a8a600fcdeb64e1a P 28b81356f6fb4e4d874a2fc241de62a1 [term 1 FOLLOWER]: Refusing update from remote peer d819ce52bb964e15b7d22471126caf8b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:45:05.726756 2011 raft_consensus.cc:1261] T d0b0de9ae3714793a8a600fcdeb64e1a P 2192a7dc109e4cabaa75ce3c13fb3ee4 [term 1 FOLLOWER]: Refusing update from remote peer d819ce52bb964e15b7d22471126caf8b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:45:05.727031 2597 consensus_queue.cc:1035] T d0b0de9ae3714793a8a600fcdeb64e1a P d819ce52bb964e15b7d22471126caf8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:45:05.727170 2527 consensus_queue.cc:1035] T d0b0de9ae3714793a8a600fcdeb64e1a P d819ce52bb964e15b7d22471126caf8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "28b81356f6fb4e4d874a2fc241de62a1" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:45:05.735532 2574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:05.732820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.131:44617 (local address 127.30.214.130:48079)
0808 14:45:05.732868 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:05.732879 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:05.732915 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:05.733086 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:05.733087 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:05.733089 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 14:45:05.733137 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:05.733138 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:05.734050 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:05.734051 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:05.734673 (+ 622us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:05.734677 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:05.735201 (+ 524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:05.735202 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:05.735258 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:05.735265 (+ 7us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 14:45:05.735410 (+ 145us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 14:45:05.735411 (+ 1us) client_negotiation.cc:769] Sending connection context
0808 14:45:05.735439 (+ 28us) client_negotiation.cc:240] Negotiation successful
0808 14:45:05.735476 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25}
I20260808 14:45:05.735545 2515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:05.732883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.130:48079 (local address 127.30.214.131:44617)
0808 14:45:05.732922 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:05.732924 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:05.732935 (+ 11us) server_negotiation.cc:407] Connection header received
0808 14:45:05.732959 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:05.732960 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:05.732981 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:05.733037 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:45:05.733202 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:05.733972 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:05.734831 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:05.735137 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:05.735203 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:05.735328 (+ 125us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:45:05.735360 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:45:05.735409 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:05.735444 (+ 35us) server_negotiation.cc:299] Negotiation successful
0808 14:45:05.735466 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
W20260808 14:45:05.735957 2560 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260808 14:45:07.261456 1751 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57786:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:45:07.261690 1751 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57786:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:45:07.262867 1751 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 74f16d9037bd49b8bdfa995713fd362a: Sending DeleteTablet for 3 replicas of tablet d0b0de9ae3714793a8a600fcdeb64e1a
I20260808 14:45:07.263136 2194 tablet_service.cc:1514] Processing DeleteTablet for tablet d0b0de9ae3714793a8a600fcdeb64e1a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:45:07 UTC) from {username='kudu', principal='kudu/127.30.214.190@KRBTEST.COM'} at 127.0.0.1:36070
I20260808 14:45:07.263346 1981 tablet_service.cc:1514] Processing DeleteTablet for tablet d0b0de9ae3714793a8a600fcdeb64e1a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:45:07 UTC) from {username='kudu', principal='kudu/127.30.214.190@KRBTEST.COM'} at 127.0.0.1:34176
I20260808 14:45:07.264879 2400 tablet_service.cc:1514] Processing DeleteTablet for tablet d0b0de9ae3714793a8a600fcdeb64e1a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:45:07 UTC) from {username='kudu', principal='kudu/127.30.214.190@KRBTEST.COM'} at 127.0.0.1:38648
I20260808 14:45:07.266086 2649 tablet_replica.cc:330] T d0b0de9ae3714793a8a600fcdeb64e1a P d819ce52bb964e15b7d22471126caf8b: stopping tablet replica
I20260808 14:45:07.266151 2649 raft_consensus.cc:2229] T d0b0de9ae3714793a8a600fcdeb64e1a P d819ce52bb964e15b7d22471126caf8b [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:45:07.266250 2649 raft_consensus.cc:2258] T d0b0de9ae3714793a8a600fcdeb64e1a P d819ce52bb964e15b7d22471126caf8b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:45:07.266505 2649 ts_tablet_manager.cc:1905] T d0b0de9ae3714793a8a600fcdeb64e1a P d819ce52bb964e15b7d22471126caf8b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:45:07.267850 2646 tablet_replica.cc:330] T d0b0de9ae3714793a8a600fcdeb64e1a P 28b81356f6fb4e4d874a2fc241de62a1: stopping tablet replica
I20260808 14:45:07.267923 2649 ts_tablet_manager.cc:1918] T d0b0de9ae3714793a8a600fcdeb64e1a P d819ce52bb964e15b7d22471126caf8b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 14:45:07.267946 2646 raft_consensus.cc:2229] T d0b0de9ae3714793a8a600fcdeb64e1a P 28b81356f6fb4e4d874a2fc241de62a1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:45:07.267970 2649 log.cc:1196] T d0b0de9ae3714793a8a600fcdeb64e1a P d819ce52bb964e15b7d22471126caf8b: Deleting WAL directory at /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/ts-2/wal/wals/d0b0de9ae3714793a8a600fcdeb64e1a
I20260808 14:45:07.268033 2646 raft_consensus.cc:2258] T d0b0de9ae3714793a8a600fcdeb64e1a P 28b81356f6fb4e4d874a2fc241de62a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:45:07.268222 2649 ts_tablet_manager.cc:1939] T d0b0de9ae3714793a8a600fcdeb64e1a P d819ce52bb964e15b7d22471126caf8b: Deleting consensus metadata
I20260808 14:45:07.268323 2646 ts_tablet_manager.cc:1905] T d0b0de9ae3714793a8a600fcdeb64e1a P 28b81356f6fb4e4d874a2fc241de62a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:45:07.268581 1731 catalog_manager.cc:4841] TS d819ce52bb964e15b7d22471126caf8b (127.30.214.131:44617): tablet d0b0de9ae3714793a8a600fcdeb64e1a (table test-table [id=be6a34cd527b4dcbbb55f716a3256f96]) successfully deleted
I20260808 14:45:07.268759 2647 tablet_replica.cc:330] T d0b0de9ae3714793a8a600fcdeb64e1a P 2192a7dc109e4cabaa75ce3c13fb3ee4: stopping tablet replica
I20260808 14:45:07.268826 2647 raft_consensus.cc:2229] T d0b0de9ae3714793a8a600fcdeb64e1a P 2192a7dc109e4cabaa75ce3c13fb3ee4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:45:07.268906 2647 raft_consensus.cc:2258] T d0b0de9ae3714793a8a600fcdeb64e1a P 2192a7dc109e4cabaa75ce3c13fb3ee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:45:07.269150 2647 ts_tablet_manager.cc:1905] T d0b0de9ae3714793a8a600fcdeb64e1a P 2192a7dc109e4cabaa75ce3c13fb3ee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:45:07.270314 2646 ts_tablet_manager.cc:1918] T d0b0de9ae3714793a8a600fcdeb64e1a P 28b81356f6fb4e4d874a2fc241de62a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 14:45:07.270423 2646 log.cc:1196] T d0b0de9ae3714793a8a600fcdeb64e1a P 28b81356f6fb4e4d874a2fc241de62a1: Deleting WAL directory at /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/ts-1/wal/wals/d0b0de9ae3714793a8a600fcdeb64e1a
I20260808 14:45:07.270661 2646 ts_tablet_manager.cc:1939] T d0b0de9ae3714793a8a600fcdeb64e1a P 28b81356f6fb4e4d874a2fc241de62a1: Deleting consensus metadata
I20260808 14:45:07.271106 2647 ts_tablet_manager.cc:1918] T d0b0de9ae3714793a8a600fcdeb64e1a P 2192a7dc109e4cabaa75ce3c13fb3ee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 14:45:07.271173 2647 log.cc:1196] T d0b0de9ae3714793a8a600fcdeb64e1a P 2192a7dc109e4cabaa75ce3c13fb3ee4: Deleting WAL directory at /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/ts-0/wal/wals/d0b0de9ae3714793a8a600fcdeb64e1a
I20260808 14:45:07.271382 2647 ts_tablet_manager.cc:1939] T d0b0de9ae3714793a8a600fcdeb64e1a P 2192a7dc109e4cabaa75ce3c13fb3ee4: Deleting consensus metadata
I20260808 14:45:07.271718 1728 catalog_manager.cc:4841] TS 28b81356f6fb4e4d874a2fc241de62a1 (127.30.214.130:35535): tablet d0b0de9ae3714793a8a600fcdeb64e1a (table test-table [id=be6a34cd527b4dcbbb55f716a3256f96]) successfully deleted
I20260808 14:45:07.272020 1731 catalog_manager.cc:4841] TS 2192a7dc109e4cabaa75ce3c13fb3ee4 (127.30.214.129:34173): tablet d0b0de9ae3714793a8a600fcdeb64e1a (table test-table [id=be6a34cd527b4dcbbb55f716a3256f96]) successfully deleted
Aug 08 14:45:07 dist-test-slave-42z9 krb5kdc[1685](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200307, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 14:45:07 dist-test-slave-42z9 krb5kdc[1685](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200307, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:45:07.293509 2657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:07.280913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57806 (local address 127.30.214.190:41303)
0808 14:45:07.281062 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:07.281064 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:07.281076 (+ 12us) server_negotiation.cc:407] Connection header received
0808 14:45:07.281106 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:07.281107 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:07.281118 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:07.281192 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:07.281797 (+ 605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:07.282309 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:07.282996 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:07.283197 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:07.283241 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:07.290948 (+ 7707us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:07.290950 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:07.290950 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:07.290959 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:07.292340 (+ 1381us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:07.292687 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:07.292688 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:07.292688 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:07.292737 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:07.292879 (+ 142us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:07.292880 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:07.292880 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:07.293010 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:07.293113 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:07.293249 (+ 136us) server_negotiation.cc:299] Negotiation successful
0808 14:45:07.293345 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":84,"threads_started":1}
I20260808 14:45:07.294842 1751 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57806:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:45:07.295002 1751 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:45:07.296283 2194 tablet_service.cc:1467] Processing CreateTablet for tablet 69f096d0718c46ae9203c5b258c5bd90 (DEFAULT_TABLE table=test-table [id=d49111e8f9cf44c49933aded5a7fe009]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:45:07.296283 1981 tablet_service.cc:1467] Processing CreateTablet for tablet 69f096d0718c46ae9203c5b258c5bd90 (DEFAULT_TABLE table=test-table [id=d49111e8f9cf44c49933aded5a7fe009]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:45:07.296308 2400 tablet_service.cc:1467] Processing CreateTablet for tablet 69f096d0718c46ae9203c5b258c5bd90 (DEFAULT_TABLE table=test-table [id=d49111e8f9cf44c49933aded5a7fe009]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:45:07.296435 2194 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69f096d0718c46ae9203c5b258c5bd90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:45:07.296444 2400 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69f096d0718c46ae9203c5b258c5bd90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:45:07.296435 1981 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69f096d0718c46ae9203c5b258c5bd90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:45:07.298026 2660 tablet_bootstrap.cc:492] T 69f096d0718c46ae9203c5b258c5bd90 P 28b81356f6fb4e4d874a2fc241de62a1: Bootstrap starting.
I20260808 14:45:07.298242 2658 tablet_bootstrap.cc:492] T 69f096d0718c46ae9203c5b258c5bd90 P d819ce52bb964e15b7d22471126caf8b: Bootstrap starting.
I20260808 14:45:07.298408 2660 tablet_bootstrap.cc:654] T 69f096d0718c46ae9203c5b258c5bd90 P 28b81356f6fb4e4d874a2fc241de62a1: Neither blocks nor log segments found. Creating new log.
I20260808 14:45:07.298588 2658 tablet_bootstrap.cc:654] T 69f096d0718c46ae9203c5b258c5bd90 P d819ce52bb964e15b7d22471126caf8b: Neither blocks nor log segments found. Creating new log.
I20260808 14:45:07.298712 2659 tablet_bootstrap.cc:492] T 69f096d0718c46ae9203c5b258c5bd90 P 2192a7dc109e4cabaa75ce3c13fb3ee4: Bootstrap starting.
I20260808 14:45:07.299116 2659 tablet_bootstrap.cc:654] T 69f096d0718c46ae9203c5b258c5bd90 P 2192a7dc109e4cabaa75ce3c13fb3ee4: Neither blocks nor log segments found. Creating new log.
I20260808 14:45:07.299151 2660 tablet_bootstrap.cc:492] T 69f096d0718c46ae9203c5b258c5bd90 P 28b81356f6fb4e4d874a2fc241de62a1: No bootstrap required, opened a new log
I20260808 14:45:07.299199 2660 ts_tablet_manager.cc:1397] T 69f096d0718c46ae9203c5b258c5bd90 P 28b81356f6fb4e4d874a2fc241de62a1: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 14:45:07.299322 2660 raft_consensus.cc:348] T 69f096d0718c46ae9203c5b258c5bd90 P 28b81356f6fb4e4d874a2fc241de62a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34173 } } peers { permanent_uuid: "28b81356f6fb4e4d874a2fc241de62a1" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35535 } } peers { permanent_uuid: "d819ce52bb964e15b7d22471126caf8b" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44617 } }
I20260808 14:45:07.299399 2660 raft_consensus.cc:374] T 69f096d0718c46ae9203c5b258c5bd90 P 28b81356f6fb4e4d874a2fc241de62a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:45:07.299419 2660 raft_consensus.cc:729] T 69f096d0718c46ae9203c5b258c5bd90 P 28b81356f6fb4e4d874a2fc241de62a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28b81356f6fb4e4d874a2fc241de62a1, State: Initialized, Role: FOLLOWER
I20260808 14:45:07.299487 2660 consensus_queue.cc:260] T 69f096d0718c46ae9203c5b258c5bd90 P 28b81356f6fb4e4d874a2fc241de62a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34173 } } peers { permanent_uuid: "28b81356f6fb4e4d874a2fc241de62a1" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35535 } } peers { permanent_uuid: "d819ce52bb964e15b7d22471126caf8b" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44617 } }
I20260808 14:45:07.299678 2659 tablet_bootstrap.cc:492] T 69f096d0718c46ae9203c5b258c5bd90 P 2192a7dc109e4cabaa75ce3c13fb3ee4: No bootstrap required, opened a new log
I20260808 14:45:07.299708 2660 ts_tablet_manager.cc:1428] T 69f096d0718c46ae9203c5b258c5bd90 P 28b81356f6fb4e4d874a2fc241de62a1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:07.299732 2659 ts_tablet_manager.cc:1397] T 69f096d0718c46ae9203c5b258c5bd90 P 2192a7dc109e4cabaa75ce3c13fb3ee4: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 14:45:07.299871 2659 raft_consensus.cc:348] T 69f096d0718c46ae9203c5b258c5bd90 P 2192a7dc109e4cabaa75ce3c13fb3ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34173 } } peers { permanent_uuid: "28b81356f6fb4e4d874a2fc241de62a1" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35535 } } peers { permanent_uuid: "d819ce52bb964e15b7d22471126caf8b" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44617 } }
I20260808 14:45:07.299937 2659 raft_consensus.cc:374] T 69f096d0718c46ae9203c5b258c5bd90 P 2192a7dc109e4cabaa75ce3c13fb3ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:45:07.299955 2659 raft_consensus.cc:729] T 69f096d0718c46ae9203c5b258c5bd90 P 2192a7dc109e4cabaa75ce3c13fb3ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2192a7dc109e4cabaa75ce3c13fb3ee4, State: Initialized, Role: FOLLOWER
I20260808 14:45:07.299942 2658 tablet_bootstrap.cc:492] T 69f096d0718c46ae9203c5b258c5bd90 P d819ce52bb964e15b7d22471126caf8b: No bootstrap required, opened a new log
I20260808 14:45:07.299999 2658 ts_tablet_manager.cc:1397] T 69f096d0718c46ae9203c5b258c5bd90 P d819ce52bb964e15b7d22471126caf8b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:45:07.300020 2659 consensus_queue.cc:260] T 69f096d0718c46ae9203c5b258c5bd90 P 2192a7dc109e4cabaa75ce3c13fb3ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34173 } } peers { permanent_uuid: "28b81356f6fb4e4d874a2fc241de62a1" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35535 } } peers { permanent_uuid: "d819ce52bb964e15b7d22471126caf8b" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44617 } }
I20260808 14:45:07.300196 2659 ts_tablet_manager.cc:1428] T 69f096d0718c46ae9203c5b258c5bd90 P 2192a7dc109e4cabaa75ce3c13fb3ee4: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 14:45:07.300207 2658 raft_consensus.cc:348] T 69f096d0718c46ae9203c5b258c5bd90 P d819ce52bb964e15b7d22471126caf8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34173 } } peers { permanent_uuid: "28b81356f6fb4e4d874a2fc241de62a1" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35535 } } peers { permanent_uuid: "d819ce52bb964e15b7d22471126caf8b" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44617 } }
I20260808 14:45:07.300283 2658 raft_consensus.cc:374] T 69f096d0718c46ae9203c5b258c5bd90 P d819ce52bb964e15b7d22471126caf8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:45:07.300302 2658 raft_consensus.cc:729] T 69f096d0718c46ae9203c5b258c5bd90 P d819ce52bb964e15b7d22471126caf8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d819ce52bb964e15b7d22471126caf8b, State: Initialized, Role: FOLLOWER
I20260808 14:45:07.300346 2658 consensus_queue.cc:260] T 69f096d0718c46ae9203c5b258c5bd90 P d819ce52bb964e15b7d22471126caf8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34173 } } peers { permanent_uuid: "28b81356f6fb4e4d874a2fc241de62a1" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35535 } } peers { permanent_uuid: "d819ce52bb964e15b7d22471126caf8b" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44617 } }
I20260808 14:45:07.300452 2658 ts_tablet_manager.cc:1428] T 69f096d0718c46ae9203c5b258c5bd90 P d819ce52bb964e15b7d22471126caf8b: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:07.509972 2664 raft_consensus.cc:482] T 69f096d0718c46ae9203c5b258c5bd90 P 2192a7dc109e4cabaa75ce3c13fb3ee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:45:07.510134 2664 raft_consensus.cc:504] T 69f096d0718c46ae9203c5b258c5bd90 P 2192a7dc109e4cabaa75ce3c13fb3ee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34173 } } peers { permanent_uuid: "28b81356f6fb4e4d874a2fc241de62a1" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35535 } } peers { permanent_uuid: "d819ce52bb964e15b7d22471126caf8b" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44617 } }
I20260808 14:45:07.510604 2664 leader_election.cc:288] T 69f096d0718c46ae9203c5b258c5bd90 P 2192a7dc109e4cabaa75ce3c13fb3ee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28b81356f6fb4e4d874a2fc241de62a1 (127.30.214.130:35535), d819ce52bb964e15b7d22471126caf8b (127.30.214.131:44617)
I20260808 14:45:07.515170 2669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:07.510954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.129:35565 (local address 127.30.214.130:35535)
0808 14:45:07.511262 (+ 308us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:07.511264 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:07.511276 (+ 12us) server_negotiation.cc:407] Connection header received
0808 14:45:07.511314 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:07.511315 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:07.511329 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:07.511429 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:45:07.511721 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:07.512518 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:07.514189 (+ 1671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:07.514737 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:07.514803 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:07.514812 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:07.515046 (+ 234us) server_negotiation.cc:299] Negotiation successful
0808 14:45:07.515087 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":266,"thread_start_us":132,"threads_started":1}
I20260808 14:45:07.515170 2670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:07.511035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.129:33701 (local address 127.30.214.131:44617)
0808 14:45:07.511253 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:07.511255 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:07.511275 (+ 20us) server_negotiation.cc:407] Connection header received
0808 14:45:07.511313 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:07.511315 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:07.511329 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:07.511430 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:45:07.511722 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:07.512535 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:07.514119 (+ 1584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:07.514714 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:07.514803 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:07.514812 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:07.515042 (+ 230us) server_negotiation.cc:299] Negotiation successful
0808 14:45:07.515087 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":181,"thread_start_us":137,"threads_started":1}
I20260808 14:45:07.515187 2666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:07.510880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.131:44617 (local address 127.30.214.129:33701)
0808 14:45:07.511163 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:07.511178 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:07.511246 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:07.511457 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:07.511458 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:07.511461 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:45:07.511572 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:07.511575 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:07.512632 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:07.512633 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:07.514015 (+ 1382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:07.514019 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:07.514862 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:07.514863 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:07.514957 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:07.514962 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 14:45:07.515031 (+ 69us) client_negotiation.cc:240] Negotiation successful
0808 14:45:07.515072 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":252,"mutex_wait_us":26,"thread_start_us":213,"threads_started":1}
I20260808 14:45:07.515187 2668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:07.510884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.130:35535 (local address 127.30.214.129:35565)
0808 14:45:07.511169 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:07.511178 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:07.511246 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:07.511457 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:07.511458 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:07.511462 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:45:07.511577 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:07.511578 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:07.512632 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:07.512633 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:07.514102 (+ 1469us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:07.514105 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:07.514862 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:07.514863 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:07.514957 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:07.514961 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:45:07.515025 (+ 64us) client_negotiation.cc:240] Negotiation successful
0808 14:45:07.515068 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":268,"mutex_wait_us":37,"thread_start_us":181,"threads_started":1}
I20260808 14:45:07.515558 2428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69f096d0718c46ae9203c5b258c5bd90" candidate_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d819ce52bb964e15b7d22471126caf8b" is_pre_election: true
I20260808 14:45:07.515576 2222 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69f096d0718c46ae9203c5b258c5bd90" candidate_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28b81356f6fb4e4d874a2fc241de62a1" is_pre_election: true
I20260808 14:45:07.515666 2428 raft_consensus.cc:2454] T 69f096d0718c46ae9203c5b258c5bd90 P d819ce52bb964e15b7d22471126caf8b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2192a7dc109e4cabaa75ce3c13fb3ee4 in term 0.
I20260808 14:45:07.515667 2222 raft_consensus.cc:2454] T 69f096d0718c46ae9203c5b258c5bd90 P 28b81356f6fb4e4d874a2fc241de62a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2192a7dc109e4cabaa75ce3c13fb3ee4 in term 0.
I20260808 14:45:07.515878 1907 leader_election.cc:302] T 69f096d0718c46ae9203c5b258c5bd90 P 2192a7dc109e4cabaa75ce3c13fb3ee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2192a7dc109e4cabaa75ce3c13fb3ee4, d819ce52bb964e15b7d22471126caf8b; no voters:
I20260808 14:45:07.516024 2664 raft_consensus.cc:2781] T 69f096d0718c46ae9203c5b258c5bd90 P 2192a7dc109e4cabaa75ce3c13fb3ee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:45:07.516075 2664 raft_consensus.cc:482] T 69f096d0718c46ae9203c5b258c5bd90 P 2192a7dc109e4cabaa75ce3c13fb3ee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:45:07.516089 2664 raft_consensus.cc:3037] T 69f096d0718c46ae9203c5b258c5bd90 P 2192a7dc109e4cabaa75ce3c13fb3ee4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:07.516780 2664 raft_consensus.cc:504] T 69f096d0718c46ae9203c5b258c5bd90 P 2192a7dc109e4cabaa75ce3c13fb3ee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34173 } } peers { permanent_uuid: "28b81356f6fb4e4d874a2fc241de62a1" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35535 } } peers { permanent_uuid: "d819ce52bb964e15b7d22471126caf8b" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44617 } }
I20260808 14:45:07.516923 2664 leader_election.cc:288] T 69f096d0718c46ae9203c5b258c5bd90 P 2192a7dc109e4cabaa75ce3c13fb3ee4 [CANDIDATE]: Term 1 election: Requested vote from peers 28b81356f6fb4e4d874a2fc241de62a1 (127.30.214.130:35535), d819ce52bb964e15b7d22471126caf8b (127.30.214.131:44617)
I20260808 14:45:07.517104 2222 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69f096d0718c46ae9203c5b258c5bd90" candidate_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28b81356f6fb4e4d874a2fc241de62a1"
I20260808 14:45:07.517176 2222 raft_consensus.cc:3037] T 69f096d0718c46ae9203c5b258c5bd90 P 28b81356f6fb4e4d874a2fc241de62a1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:07.517828 2222 raft_consensus.cc:2454] T 69f096d0718c46ae9203c5b258c5bd90 P 28b81356f6fb4e4d874a2fc241de62a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2192a7dc109e4cabaa75ce3c13fb3ee4 in term 1.
I20260808 14:45:07.517935 2428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69f096d0718c46ae9203c5b258c5bd90" candidate_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d819ce52bb964e15b7d22471126caf8b"
I20260808 14:45:07.517997 1904 leader_election.cc:302] T 69f096d0718c46ae9203c5b258c5bd90 P 2192a7dc109e4cabaa75ce3c13fb3ee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2192a7dc109e4cabaa75ce3c13fb3ee4, 28b81356f6fb4e4d874a2fc241de62a1; no voters:
I20260808 14:45:07.518018 2428 raft_consensus.cc:3037] T 69f096d0718c46ae9203c5b258c5bd90 P d819ce52bb964e15b7d22471126caf8b [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:07.518113 2664 raft_consensus.cc:2781] T 69f096d0718c46ae9203c5b258c5bd90 P 2192a7dc109e4cabaa75ce3c13fb3ee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:45:07.518271 2664 raft_consensus.cc:686] T 69f096d0718c46ae9203c5b258c5bd90 P 2192a7dc109e4cabaa75ce3c13fb3ee4 [term 1 LEADER]: Becoming Leader. State: Replica: 2192a7dc109e4cabaa75ce3c13fb3ee4, State: Running, Role: LEADER
I20260808 14:45:07.518337 2664 consensus_queue.cc:237] T 69f096d0718c46ae9203c5b258c5bd90 P 2192a7dc109e4cabaa75ce3c13fb3ee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34173 } } peers { permanent_uuid: "28b81356f6fb4e4d874a2fc241de62a1" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35535 } } peers { permanent_uuid: "d819ce52bb964e15b7d22471126caf8b" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44617 } }
I20260808 14:45:07.518744 2428 raft_consensus.cc:2454] T 69f096d0718c46ae9203c5b258c5bd90 P d819ce52bb964e15b7d22471126caf8b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2192a7dc109e4cabaa75ce3c13fb3ee4 in term 1.
I20260808 14:45:07.519059 1751 catalog_manager.cc:5495] T 69f096d0718c46ae9203c5b258c5bd90 P 2192a7dc109e4cabaa75ce3c13fb3ee4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2192a7dc109e4cabaa75ce3c13fb3ee4 (127.30.214.129). New cstate: current_term: 1 leader_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34173 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "28b81356f6fb4e4d874a2fc241de62a1" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d819ce52bb964e15b7d22471126caf8b" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44617 } health_report { overall_health: UNKNOWN } } }
I20260808 14:45:07.529488 2675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:07.526970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34186 (local address 127.30.214.129:34173)
0808 14:45:07.527151 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:07.527153 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:07.527160 (+ 7us) server_negotiation.cc:407] Connection header received
0808 14:45:07.527196 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:07.527197 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:07.527217 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:07.527292 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:45:07.527464 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:07.527966 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:07.528662 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:07.528856 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:07.528900 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:07.529094 (+ 194us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:45:07.529226 (+ 132us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:45:07.529286 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:07.529330 (+ 44us) server_negotiation.cc:299] Negotiation successful
0808 14:45:07.529353 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":122,"threads_started":1}
I20260808 14:45:07.534716 2669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:07.532620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.129:43183 (local address 127.30.214.130:35535)
0808 14:45:07.532673 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:07.532675 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:07.532684 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:45:07.532706 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:07.532707 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:07.532716 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:07.532762 (+ 46us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:45:07.532878 (+ 116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:07.533355 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:07.534128 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:07.534321 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:07.534385 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:07.534536 (+ 151us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:45:07.534563 (+ 27us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:45:07.534596 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:07.534642 (+ 46us) server_negotiation.cc:299] Negotiation successful
0808 14:45:07.534659 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 14:45:07.534749 2679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:07.532415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.130:35535 (local address 127.30.214.129:43183)
0808 14:45:07.532588 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:07.532599 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:07.532649 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:07.532773 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:07.532773 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:07.532775 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 14:45:07.532833 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:07.532834 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:07.533410 (+ 576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:07.533410 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:07.534026 (+ 616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:07.534028 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:07.534405 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:07.534406 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:07.534454 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:07.534470 (+ 16us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 14:45:07.534607 (+ 137us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 14:45:07.534609 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 14:45:07.534638 (+ 29us) client_negotiation.cc:240] Negotiation successful
0808 14:45:07.534676 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":73,"threads_started":1}
I20260808 14:45:07.536815 2428 raft_consensus.cc:1261] T 69f096d0718c46ae9203c5b258c5bd90 P d819ce52bb964e15b7d22471126caf8b [term 1 FOLLOWER]: Refusing update from remote peer 2192a7dc109e4cabaa75ce3c13fb3ee4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:45:07.536839 2222 raft_consensus.cc:1261] T 69f096d0718c46ae9203c5b258c5bd90 P 28b81356f6fb4e4d874a2fc241de62a1 [term 1 FOLLOWER]: Refusing update from remote peer 2192a7dc109e4cabaa75ce3c13fb3ee4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:45:07.537102 2664 consensus_queue.cc:1035] T 69f096d0718c46ae9203c5b258c5bd90 P 2192a7dc109e4cabaa75ce3c13fb3ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "28b81356f6fb4e4d874a2fc241de62a1" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:45:07.537249 2671 consensus_queue.cc:1035] T 69f096d0718c46ae9203c5b258c5bd90 P 2192a7dc109e4cabaa75ce3c13fb3ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d819ce52bb964e15b7d22471126caf8b" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:45:07.544409 2675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:07.542290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.130:38341 (local address 127.30.214.129:34173)
0808 14:45:07.542346 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:07.542348 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:07.542357 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:45:07.542379 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:07.542379 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:07.542388 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:07.542442 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:45:07.542549 (+ 107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:07.543046 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:07.543819 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:07.544034 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:07.544100 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:07.544237 (+ 137us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:45:07.544265 (+ 28us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:45:07.544295 (+ 30us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:07.544331 (+ 36us) server_negotiation.cc:299] Negotiation successful
0808 14:45:07.544352 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 14:45:07.544430 2683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:07.542111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.129:34173 (local address 127.30.214.130:38341)
0808 14:45:07.542267 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:07.542278 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:07.542327 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:07.542450 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:07.542450 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:07.542452 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 14:45:07.542504 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:07.542505 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:07.543101 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:07.543101 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:07.543740 (+ 639us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:07.543742 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:07.544104 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:07.544106 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:07.544164 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:07.544170 (+ 6us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 14:45:07.544298 (+ 128us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 14:45:07.544299 (+ 1us) client_negotiation.cc:769] Sending connection context
0808 14:45:07.544329 (+ 30us) client_negotiation.cc:240] Negotiation successful
0808 14:45:07.544369 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":94,"threads_started":1}
I20260808 14:45:07.550540 1751 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57806:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:45:07.550652 1751 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57806:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:45:07.551295 1751 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 74f16d9037bd49b8bdfa995713fd362a: Sending DeleteTablet for 3 replicas of tablet 69f096d0718c46ae9203c5b258c5bd90
I20260808 14:45:07.551537 2194 tablet_service.cc:1514] Processing DeleteTablet for tablet 69f096d0718c46ae9203c5b258c5bd90 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:45:07 UTC) from {username='kudu', principal='kudu/127.30.214.190@KRBTEST.COM'} at 127.0.0.1:36070
I20260808 14:45:07.551613 2400 tablet_service.cc:1514] Processing DeleteTablet for tablet 69f096d0718c46ae9203c5b258c5bd90 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:45:07 UTC) from {username='kudu', principal='kudu/127.30.214.190@KRBTEST.COM'} at 127.0.0.1:38648
I20260808 14:45:07.551723 2646 tablet_replica.cc:330] T 69f096d0718c46ae9203c5b258c5bd90 P 28b81356f6fb4e4d874a2fc241de62a1: stopping tablet replica
I20260808 14:45:07.551796 2646 raft_consensus.cc:2229] T 69f096d0718c46ae9203c5b258c5bd90 P 28b81356f6fb4e4d874a2fc241de62a1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:45:07.551846 2646 raft_consensus.cc:2258] T 69f096d0718c46ae9203c5b258c5bd90 P 28b81356f6fb4e4d874a2fc241de62a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:45:07.551789 1751 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57806:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:45:07.551920 1751 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:45:07.551923 2649 tablet_replica.cc:330] T 69f096d0718c46ae9203c5b258c5bd90 P d819ce52bb964e15b7d22471126caf8b: stopping tablet replica
I20260808 14:45:07.551975 2649 raft_consensus.cc:2229] T 69f096d0718c46ae9203c5b258c5bd90 P d819ce52bb964e15b7d22471126caf8b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:45:07.552013 2649 raft_consensus.cc:2258] T 69f096d0718c46ae9203c5b258c5bd90 P d819ce52bb964e15b7d22471126caf8b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:45:07.552230 1981 tablet_service.cc:1514] Processing DeleteTablet for tablet 69f096d0718c46ae9203c5b258c5bd90 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:45:07 UTC) from {username='kudu', principal='kudu/127.30.214.190@KRBTEST.COM'} at 127.0.0.1:34176
I20260808 14:45:07.552318 2647 tablet_replica.cc:330] T 69f096d0718c46ae9203c5b258c5bd90 P 2192a7dc109e4cabaa75ce3c13fb3ee4: stopping tablet replica
I20260808 14:45:07.552366 2647 raft_consensus.cc:2229] T 69f096d0718c46ae9203c5b258c5bd90 P 2192a7dc109e4cabaa75ce3c13fb3ee4 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:45:07.552373 2649 ts_tablet_manager.cc:1905] T 69f096d0718c46ae9203c5b258c5bd90 P d819ce52bb964e15b7d22471126caf8b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:45:07.552455 2647 raft_consensus.cc:2258] T 69f096d0718c46ae9203c5b258c5bd90 P 2192a7dc109e4cabaa75ce3c13fb3ee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:45:07.553037 2646 ts_tablet_manager.cc:1905] T 69f096d0718c46ae9203c5b258c5bd90 P 28b81356f6fb4e4d874a2fc241de62a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:45:07.553721 2194 tablet_service.cc:1467] Processing CreateTablet for tablet 63703963ee9547bab82a0a6f382c05c0 (DEFAULT_TABLE table=test-table [id=4caa945fa184473da9f5b1792646dc2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:45:07.553834 2194 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63703963ee9547bab82a0a6f382c05c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:45:07.553980 2649 ts_tablet_manager.cc:1918] T 69f096d0718c46ae9203c5b258c5bd90 P d819ce52bb964e15b7d22471126caf8b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:45:07.554031 2649 log.cc:1196] T 69f096d0718c46ae9203c5b258c5bd90 P d819ce52bb964e15b7d22471126caf8b: Deleting WAL directory at /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/ts-2/wal/wals/69f096d0718c46ae9203c5b258c5bd90
I20260808 14:45:07.554237 2649 ts_tablet_manager.cc:1939] T 69f096d0718c46ae9203c5b258c5bd90 P d819ce52bb964e15b7d22471126caf8b: Deleting consensus metadata
I20260808 14:45:07.554673 2646 ts_tablet_manager.cc:1918] T 69f096d0718c46ae9203c5b258c5bd90 P 28b81356f6fb4e4d874a2fc241de62a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:45:07.554711 2646 log.cc:1196] T 69f096d0718c46ae9203c5b258c5bd90 P 28b81356f6fb4e4d874a2fc241de62a1: Deleting WAL directory at /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/ts-1/wal/wals/69f096d0718c46ae9203c5b258c5bd90
I20260808 14:45:07.554843 2646 ts_tablet_manager.cc:1939] T 69f096d0718c46ae9203c5b258c5bd90 P 28b81356f6fb4e4d874a2fc241de62a1: Deleting consensus metadata
I20260808 14:45:07.555058 2400 tablet_service.cc:1467] Processing CreateTablet for tablet 63703963ee9547bab82a0a6f382c05c0 (DEFAULT_TABLE table=test-table [id=4caa945fa184473da9f5b1792646dc2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:45:07.555073 1981 tablet_service.cc:1467] Processing CreateTablet for tablet 63703963ee9547bab82a0a6f382c05c0 (DEFAULT_TABLE table=test-table [id=4caa945fa184473da9f5b1792646dc2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:45:07.555154 2400 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63703963ee9547bab82a0a6f382c05c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:45:07.555150 2660 tablet_bootstrap.cc:492] T 63703963ee9547bab82a0a6f382c05c0 P 28b81356f6fb4e4d874a2fc241de62a1: Bootstrap starting.
I20260808 14:45:07.555181 1981 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63703963ee9547bab82a0a6f382c05c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:45:07.555470 2660 tablet_bootstrap.cc:654] T 63703963ee9547bab82a0a6f382c05c0 P 28b81356f6fb4e4d874a2fc241de62a1: Neither blocks nor log segments found. Creating new log.
I20260808 14:45:07.556283 2658 tablet_bootstrap.cc:492] T 63703963ee9547bab82a0a6f382c05c0 P d819ce52bb964e15b7d22471126caf8b: Bootstrap starting.
I20260808 14:45:07.556367 2659 tablet_bootstrap.cc:492] T 63703963ee9547bab82a0a6f382c05c0 P 2192a7dc109e4cabaa75ce3c13fb3ee4: Bootstrap starting.
I20260808 14:45:07.556604 2658 tablet_bootstrap.cc:654] T 63703963ee9547bab82a0a6f382c05c0 P d819ce52bb964e15b7d22471126caf8b: Neither blocks nor log segments found. Creating new log.
I20260808 14:45:07.556712 2659 tablet_bootstrap.cc:654] T 63703963ee9547bab82a0a6f382c05c0 P 2192a7dc109e4cabaa75ce3c13fb3ee4: Neither blocks nor log segments found. Creating new log.
I20260808 14:45:07.557200 2658 tablet_bootstrap.cc:492] T 63703963ee9547bab82a0a6f382c05c0 P d819ce52bb964e15b7d22471126caf8b: No bootstrap required, opened a new log
I20260808 14:45:07.557221 2647 ts_tablet_manager.cc:1905] T 69f096d0718c46ae9203c5b258c5bd90 P 2192a7dc109e4cabaa75ce3c13fb3ee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:45:07.557252 2658 ts_tablet_manager.cc:1397] T 63703963ee9547bab82a0a6f382c05c0 P d819ce52bb964e15b7d22471126caf8b: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 14:45:07.557358 2658 raft_consensus.cc:348] T 63703963ee9547bab82a0a6f382c05c0 P d819ce52bb964e15b7d22471126caf8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34173 } } peers { permanent_uuid: "28b81356f6fb4e4d874a2fc241de62a1" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35535 } } peers { permanent_uuid: "d819ce52bb964e15b7d22471126caf8b" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44617 } }
I20260808 14:45:07.557425 2658 raft_consensus.cc:374] T 63703963ee9547bab82a0a6f382c05c0 P d819ce52bb964e15b7d22471126caf8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:45:07.557466 2658 raft_consensus.cc:729] T 63703963ee9547bab82a0a6f382c05c0 P d819ce52bb964e15b7d22471126caf8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d819ce52bb964e15b7d22471126caf8b, State: Initialized, Role: FOLLOWER
I20260808 14:45:07.557508 2658 consensus_queue.cc:260] T 63703963ee9547bab82a0a6f382c05c0 P d819ce52bb964e15b7d22471126caf8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34173 } } peers { permanent_uuid: "28b81356f6fb4e4d874a2fc241de62a1" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35535 } } peers { permanent_uuid: "d819ce52bb964e15b7d22471126caf8b" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44617 } }
I20260808 14:45:07.557605 2658 ts_tablet_manager.cc:1428] T 63703963ee9547bab82a0a6f382c05c0 P d819ce52bb964e15b7d22471126caf8b: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:07.558447 2647 ts_tablet_manager.cc:1918] T 69f096d0718c46ae9203c5b258c5bd90 P 2192a7dc109e4cabaa75ce3c13fb3ee4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:45:07.558508 2647 log.cc:1196] T 69f096d0718c46ae9203c5b258c5bd90 P 2192a7dc109e4cabaa75ce3c13fb3ee4: Deleting WAL directory at /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/ts-0/wal/wals/69f096d0718c46ae9203c5b258c5bd90
I20260808 14:45:07.558691 2647 ts_tablet_manager.cc:1939] T 69f096d0718c46ae9203c5b258c5bd90 P 2192a7dc109e4cabaa75ce3c13fb3ee4: Deleting consensus metadata
I20260808 14:45:07.559098 2659 tablet_bootstrap.cc:492] T 63703963ee9547bab82a0a6f382c05c0 P 2192a7dc109e4cabaa75ce3c13fb3ee4: No bootstrap required, opened a new log
I20260808 14:45:07.559149 2659 ts_tablet_manager.cc:1397] T 63703963ee9547bab82a0a6f382c05c0 P 2192a7dc109e4cabaa75ce3c13fb3ee4: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260808 14:45:07.559304 2659 raft_consensus.cc:348] T 63703963ee9547bab82a0a6f382c05c0 P 2192a7dc109e4cabaa75ce3c13fb3ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34173 } } peers { permanent_uuid: "28b81356f6fb4e4d874a2fc241de62a1" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35535 } } peers { permanent_uuid: "d819ce52bb964e15b7d22471126caf8b" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44617 } }
I20260808 14:45:07.559391 2659 raft_consensus.cc:374] T 63703963ee9547bab82a0a6f382c05c0 P 2192a7dc109e4cabaa75ce3c13fb3ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:45:07.559412 2659 raft_consensus.cc:729] T 63703963ee9547bab82a0a6f382c05c0 P 2192a7dc109e4cabaa75ce3c13fb3ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2192a7dc109e4cabaa75ce3c13fb3ee4, State: Initialized, Role: FOLLOWER
I20260808 14:45:07.559454 2659 consensus_queue.cc:260] T 63703963ee9547bab82a0a6f382c05c0 P 2192a7dc109e4cabaa75ce3c13fb3ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34173 } } peers { permanent_uuid: "28b81356f6fb4e4d874a2fc241de62a1" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35535 } } peers { permanent_uuid: "d819ce52bb964e15b7d22471126caf8b" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44617 } }
I20260808 14:45:07.559571 2659 ts_tablet_manager.cc:1428] T 63703963ee9547bab82a0a6f382c05c0 P 2192a7dc109e4cabaa75ce3c13fb3ee4: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 14:45:07.559857 1731 catalog_manager.cc:4841] TS 2192a7dc109e4cabaa75ce3c13fb3ee4 (127.30.214.129:34173): tablet 69f096d0718c46ae9203c5b258c5bd90 (table test-table [id=d49111e8f9cf44c49933aded5a7fe009]) successfully deleted
I20260808 14:45:07.560026 1728 catalog_manager.cc:4841] TS 28b81356f6fb4e4d874a2fc241de62a1 (127.30.214.130:35535): tablet 69f096d0718c46ae9203c5b258c5bd90 (table test-table [id=d49111e8f9cf44c49933aded5a7fe009]) successfully deleted
I20260808 14:45:07.560222 1731 catalog_manager.cc:4841] TS d819ce52bb964e15b7d22471126caf8b (127.30.214.131:44617): tablet 69f096d0718c46ae9203c5b258c5bd90 (table test-table [id=d49111e8f9cf44c49933aded5a7fe009]) successfully deleted
I20260808 14:45:07.560626 2660 tablet_bootstrap.cc:492] T 63703963ee9547bab82a0a6f382c05c0 P 28b81356f6fb4e4d874a2fc241de62a1: No bootstrap required, opened a new log
I20260808 14:45:07.560688 2660 ts_tablet_manager.cc:1397] T 63703963ee9547bab82a0a6f382c05c0 P 28b81356f6fb4e4d874a2fc241de62a1: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20260808 14:45:07.560828 2660 raft_consensus.cc:348] T 63703963ee9547bab82a0a6f382c05c0 P 28b81356f6fb4e4d874a2fc241de62a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34173 } } peers { permanent_uuid: "28b81356f6fb4e4d874a2fc241de62a1" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35535 } } peers { permanent_uuid: "d819ce52bb964e15b7d22471126caf8b" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44617 } }
I20260808 14:45:07.560938 2660 raft_consensus.cc:374] T 63703963ee9547bab82a0a6f382c05c0 P 28b81356f6fb4e4d874a2fc241de62a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:45:07.560971 2660 raft_consensus.cc:729] T 63703963ee9547bab82a0a6f382c05c0 P 28b81356f6fb4e4d874a2fc241de62a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28b81356f6fb4e4d874a2fc241de62a1, State: Initialized, Role: FOLLOWER
I20260808 14:45:07.561018 2660 consensus_queue.cc:260] T 63703963ee9547bab82a0a6f382c05c0 P 28b81356f6fb4e4d874a2fc241de62a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34173 } } peers { permanent_uuid: "28b81356f6fb4e4d874a2fc241de62a1" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35535 } } peers { permanent_uuid: "d819ce52bb964e15b7d22471126caf8b" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44617 } }
I20260808 14:45:07.561120 2660 ts_tablet_manager.cc:1428] T 63703963ee9547bab82a0a6f382c05c0 P 28b81356f6fb4e4d874a2fc241de62a1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:07.635838 2527 raft_consensus.cc:482] T 63703963ee9547bab82a0a6f382c05c0 P d819ce52bb964e15b7d22471126caf8b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:45:07.635955 2527 raft_consensus.cc:504] T 63703963ee9547bab82a0a6f382c05c0 P d819ce52bb964e15b7d22471126caf8b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34173 } } peers { permanent_uuid: "28b81356f6fb4e4d874a2fc241de62a1" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35535 } } peers { permanent_uuid: "d819ce52bb964e15b7d22471126caf8b" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44617 } }
I20260808 14:45:07.636133 2527 leader_election.cc:288] T 63703963ee9547bab82a0a6f382c05c0 P d819ce52bb964e15b7d22471126caf8b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2192a7dc109e4cabaa75ce3c13fb3ee4 (127.30.214.129:34173), 28b81356f6fb4e4d874a2fc241de62a1 (127.30.214.130:35535)
I20260808 14:45:07.636361 2222 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63703963ee9547bab82a0a6f382c05c0" candidate_uuid: "d819ce52bb964e15b7d22471126caf8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28b81356f6fb4e4d874a2fc241de62a1" is_pre_election: true
I20260808 14:45:07.636375 2011 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63703963ee9547bab82a0a6f382c05c0" candidate_uuid: "d819ce52bb964e15b7d22471126caf8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4" is_pre_election: true
I20260808 14:45:07.636472 2222 raft_consensus.cc:2454] T 63703963ee9547bab82a0a6f382c05c0 P 28b81356f6fb4e4d874a2fc241de62a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d819ce52bb964e15b7d22471126caf8b in term 0.
I20260808 14:45:07.636500 2011 raft_consensus.cc:2454] T 63703963ee9547bab82a0a6f382c05c0 P 2192a7dc109e4cabaa75ce3c13fb3ee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d819ce52bb964e15b7d22471126caf8b in term 0.
I20260808 14:45:07.636633 2324 leader_election.cc:302] T 63703963ee9547bab82a0a6f382c05c0 P d819ce52bb964e15b7d22471126caf8b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28b81356f6fb4e4d874a2fc241de62a1, d819ce52bb964e15b7d22471126caf8b; no voters:
I20260808 14:45:07.636729 2527 raft_consensus.cc:2781] T 63703963ee9547bab82a0a6f382c05c0 P d819ce52bb964e15b7d22471126caf8b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:45:07.636775 2527 raft_consensus.cc:482] T 63703963ee9547bab82a0a6f382c05c0 P d819ce52bb964e15b7d22471126caf8b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:45:07.636794 2527 raft_consensus.cc:3037] T 63703963ee9547bab82a0a6f382c05c0 P d819ce52bb964e15b7d22471126caf8b [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:07.637532 2527 raft_consensus.cc:504] T 63703963ee9547bab82a0a6f382c05c0 P d819ce52bb964e15b7d22471126caf8b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34173 } } peers { permanent_uuid: "28b81356f6fb4e4d874a2fc241de62a1" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35535 } } peers { permanent_uuid: "d819ce52bb964e15b7d22471126caf8b" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44617 } }
I20260808 14:45:07.637663 2527 leader_election.cc:288] T 63703963ee9547bab82a0a6f382c05c0 P d819ce52bb964e15b7d22471126caf8b [CANDIDATE]: Term 1 election: Requested vote from peers 2192a7dc109e4cabaa75ce3c13fb3ee4 (127.30.214.129:34173), 28b81356f6fb4e4d874a2fc241de62a1 (127.30.214.130:35535)
I20260808 14:45:07.637835 2222 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63703963ee9547bab82a0a6f382c05c0" candidate_uuid: "d819ce52bb964e15b7d22471126caf8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28b81356f6fb4e4d874a2fc241de62a1"
I20260808 14:45:07.637861 2011 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63703963ee9547bab82a0a6f382c05c0" candidate_uuid: "d819ce52bb964e15b7d22471126caf8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4"
I20260808 14:45:07.637915 2222 raft_consensus.cc:3037] T 63703963ee9547bab82a0a6f382c05c0 P 28b81356f6fb4e4d874a2fc241de62a1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:07.637944 2011 raft_consensus.cc:3037] T 63703963ee9547bab82a0a6f382c05c0 P 2192a7dc109e4cabaa75ce3c13fb3ee4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:07.638578 2222 raft_consensus.cc:2454] T 63703963ee9547bab82a0a6f382c05c0 P 28b81356f6fb4e4d874a2fc241de62a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d819ce52bb964e15b7d22471126caf8b in term 1.
I20260808 14:45:07.638749 2324 leader_election.cc:302] T 63703963ee9547bab82a0a6f382c05c0 P d819ce52bb964e15b7d22471126caf8b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28b81356f6fb4e4d874a2fc241de62a1, d819ce52bb964e15b7d22471126caf8b; no voters:
I20260808 14:45:07.638772 2011 raft_consensus.cc:2454] T 63703963ee9547bab82a0a6f382c05c0 P 2192a7dc109e4cabaa75ce3c13fb3ee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d819ce52bb964e15b7d22471126caf8b in term 1.
I20260808 14:45:07.638837 2527 raft_consensus.cc:2781] T 63703963ee9547bab82a0a6f382c05c0 P d819ce52bb964e15b7d22471126caf8b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:45:07.638891 2527 raft_consensus.cc:686] T 63703963ee9547bab82a0a6f382c05c0 P d819ce52bb964e15b7d22471126caf8b [term 1 LEADER]: Becoming Leader. State: Replica: d819ce52bb964e15b7d22471126caf8b, State: Running, Role: LEADER
I20260808 14:45:07.638942 2527 consensus_queue.cc:237] T 63703963ee9547bab82a0a6f382c05c0 P d819ce52bb964e15b7d22471126caf8b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34173 } } peers { permanent_uuid: "28b81356f6fb4e4d874a2fc241de62a1" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35535 } } peers { permanent_uuid: "d819ce52bb964e15b7d22471126caf8b" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44617 } }
I20260808 14:45:07.639598 1752 catalog_manager.cc:5495] T 63703963ee9547bab82a0a6f382c05c0 P d819ce52bb964e15b7d22471126caf8b reported cstate change: term changed from 0 to 1, leader changed from <none> to d819ce52bb964e15b7d22471126caf8b (127.30.214.131). New cstate: current_term: 1 leader_uuid: "d819ce52bb964e15b7d22471126caf8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28b81356f6fb4e4d874a2fc241de62a1" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d819ce52bb964e15b7d22471126caf8b" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44617 } health_report { overall_health: HEALTHY } } }
I20260808 14:45:07.656522 2670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:07.654192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38664 (local address 127.30.214.131:44617)
0808 14:45:07.654233 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:07.654235 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:07.654244 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:45:07.654312 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:07.654313 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:07.654322 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:07.654365 (+ 43us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:45:07.654487 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:07.654962 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:07.655949 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:07.656128 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:07.656171 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:07.656322 (+ 151us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:45:07.656348 (+ 26us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:45:07.656381 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:07.656434 (+ 53us) server_negotiation.cc:299] Negotiation successful
0808 14:45:07.656454 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 14:45:07.658774 2011 raft_consensus.cc:1261] T 63703963ee9547bab82a0a6f382c05c0 P 2192a7dc109e4cabaa75ce3c13fb3ee4 [term 1 FOLLOWER]: Refusing update from remote peer d819ce52bb964e15b7d22471126caf8b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:45:07.658808 2222 raft_consensus.cc:1261] T 63703963ee9547bab82a0a6f382c05c0 P 28b81356f6fb4e4d874a2fc241de62a1 [term 1 FOLLOWER]: Refusing update from remote peer d819ce52bb964e15b7d22471126caf8b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:45:07.658998 2527 consensus_queue.cc:1035] T 63703963ee9547bab82a0a6f382c05c0 P d819ce52bb964e15b7d22471126caf8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2192a7dc109e4cabaa75ce3c13fb3ee4" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:45:07.659139 2527 consensus_queue.cc:1035] T 63703963ee9547bab82a0a6f382c05c0 P d819ce52bb964e15b7d22471126caf8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "28b81356f6fb4e4d874a2fc241de62a1" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 14:45:07.663882 2616 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260808 14:45:09.181927 1752 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57806:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:45:09.182042 1752 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57806:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:45:09.182906 1752 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 74f16d9037bd49b8bdfa995713fd362a: Sending DeleteTablet for 3 replicas of tablet 63703963ee9547bab82a0a6f382c05c0
I20260808 14:45:09.183173 1981 tablet_service.cc:1514] Processing DeleteTablet for tablet 63703963ee9547bab82a0a6f382c05c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:45:09 UTC) from {username='kudu', principal='kudu/127.30.214.190@KRBTEST.COM'} at 127.0.0.1:34176
I20260808 14:45:09.183194 2400 tablet_service.cc:1514] Processing DeleteTablet for tablet 63703963ee9547bab82a0a6f382c05c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:45:09 UTC) from {username='kudu', principal='kudu/127.30.214.190@KRBTEST.COM'} at 127.0.0.1:38648
I20260808 14:45:09.183218 2194 tablet_service.cc:1514] Processing DeleteTablet for tablet 63703963ee9547bab82a0a6f382c05c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:45:09 UTC) from {username='kudu', principal='kudu/127.30.214.190@KRBTEST.COM'} at 127.0.0.1:36070
I20260808 14:45:09.183377 2726 tablet_replica.cc:330] T 63703963ee9547bab82a0a6f382c05c0 P d819ce52bb964e15b7d22471126caf8b: stopping tablet replica
I20260808 14:45:09.183382 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 1873
I20260808 14:45:09.185804 2728 tablet_replica.cc:330] T 63703963ee9547bab82a0a6f382c05c0 P 28b81356f6fb4e4d874a2fc241de62a1: stopping tablet replica
I20260808 14:45:09.185802 2726 raft_consensus.cc:2229] T 63703963ee9547bab82a0a6f382c05c0 P d819ce52bb964e15b7d22471126caf8b [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:45:09.185904 2726 raft_consensus.cc:2258] T 63703963ee9547bab82a0a6f382c05c0 P d819ce52bb964e15b7d22471126caf8b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:45:09.188506 2728 raft_consensus.cc:2229] T 63703963ee9547bab82a0a6f382c05c0 P 28b81356f6fb4e4d874a2fc241de62a1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:45:09.188660 2728 raft_consensus.cc:2258] T 63703963ee9547bab82a0a6f382c05c0 P 28b81356f6fb4e4d874a2fc241de62a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:45:09.188797 2726 ts_tablet_manager.cc:1905] T 63703963ee9547bab82a0a6f382c05c0 P d819ce52bb964e15b7d22471126caf8b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:45:09.190339 2726 ts_tablet_manager.cc:1918] T 63703963ee9547bab82a0a6f382c05c0 P d819ce52bb964e15b7d22471126caf8b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 14:45:09.190409 2726 log.cc:1196] T 63703963ee9547bab82a0a6f382c05c0 P d819ce52bb964e15b7d22471126caf8b: Deleting WAL directory at /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/ts-2/wal/wals/63703963ee9547bab82a0a6f382c05c0
I20260808 14:45:09.190591 2726 ts_tablet_manager.cc:1939] T 63703963ee9547bab82a0a6f382c05c0 P d819ce52bb964e15b7d22471126caf8b: Deleting consensus metadata
I20260808 14:45:09.191038 2728 ts_tablet_manager.cc:1905] T 63703963ee9547bab82a0a6f382c05c0 P 28b81356f6fb4e4d874a2fc241de62a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:45:09.191234 1731 catalog_manager.cc:4841] TS d819ce52bb964e15b7d22471126caf8b (127.30.214.131:44617): tablet 63703963ee9547bab82a0a6f382c05c0 (table test-table [id=4caa945fa184473da9f5b1792646dc2d]) successfully deleted
I20260808 14:45:09.192418 2728 ts_tablet_manager.cc:1918] T 63703963ee9547bab82a0a6f382c05c0 P 28b81356f6fb4e4d874a2fc241de62a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 14:45:09.192483 2728 log.cc:1196] T 63703963ee9547bab82a0a6f382c05c0 P 28b81356f6fb4e4d874a2fc241de62a1: Deleting WAL directory at /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786200295877777-31578-0/minicluster-data/ts-1/wal/wals/63703963ee9547bab82a0a6f382c05c0
I20260808 14:45:09.192667 2728 ts_tablet_manager.cc:1939] T 63703963ee9547bab82a0a6f382c05c0 P 28b81356f6fb4e4d874a2fc241de62a1: Deleting consensus metadata
I20260808 14:45:09.193022 1728 catalog_manager.cc:4841] TS 28b81356f6fb4e4d874a2fc241de62a1 (127.30.214.130:35535): tablet 63703963ee9547bab82a0a6f382c05c0 (table test-table [id=4caa945fa184473da9f5b1792646dc2d]) successfully deleted
W20260808 14:45:09.211006 1731 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.30.214.129:34173 (error 108)
I20260808 14:45:09.211366 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 2099
I20260808 14:45:09.217739 2734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:09.211508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.129:34173 (local address 127.0.0.1:34190)
0808 14:45:09.217589 (+ 6081us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:09.217682 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.129:34173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":6035,"thread_start_us":74,"threads_started":1}
W20260808 14:45:09.217870 1731 catalog_manager.cc:4584] TS 2192a7dc109e4cabaa75ce3c13fb3ee4 (127.30.214.129:34173): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 63703963ee9547bab82a0a6f382c05c0: Network error: Client connection negotiation failed: client connection to 127.30.214.129:34173: connect: Connection refused (error 111)
I20260808 14:45:09.227622 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 2302
I20260808 14:45:09.240700 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 1705
2026-08-08T14:45:09Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6006 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:45:09 dist-test-slave-42z9 krb5kdc[2744](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:45:09 dist-test-slave-42z9 krb5kdc[2744](info): set up 2 sockets
Aug 08 14:45:09 dist-test-slave-42z9 krb5kdc[2744](info): commencing operation
krb5kdc: starting...
W20260808 14:45:10.389907 31578 mini_kdc.cc:121] Time spent starting KDC: real 1.122s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Aug 08 14:45:10 dist-test-slave-42z9 krb5kdc[2744](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200310, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:45:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:45:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.214.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab.
Entry for principal kudu/127.30.214.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab.
I20260808 14:45:10.524552 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:33535
--webserver_interface=127.30.214.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab
--principal=kudu/127.30.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:39167
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.214.190:33535
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:45:10.609398 2767 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:45:10.609690 2767 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:45:10.609715 2767 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:45:10.610947 2767 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:45:10.610998 2767 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:45:10.611011 2767 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:45:10.611023 2767 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:45:10.611034 2767 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:45:10.612679 2767 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:39167
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.214.190:33535
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab
--principal=kudu/127.30.214.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:33535
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2767
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:45:10.612959 2767 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:45:10.613196 2767 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:45:10.618180 2778 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:10.618187 2777 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:10.618325 2767 server_base.cc:1034] running on GCE node
W20260808 14:45:10.618206 2780 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:10.618682 2767 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:45:10.618974 2767 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:45:10.620111 2767 hybrid_clock.cc:648] HybridClock initialized: now 1786200310620093 us; error 36 us; skew 500 ppm
Aug 08 14:45:10 dist-test-slave-42z9 krb5kdc[2744](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200310, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:45:10.622665 2767 init.cc:377] Logged in from keytab as kudu/127.30.214.190@KRBTEST.COM (short username kudu)
I20260808 14:45:10.623135 2767 webserver.cc:460] Webserver started at http://127.30.214.190:44781/ using document root <none> and password file <none>
I20260808 14:45:10.623358 2767 fs_manager.cc:359] Metadata directory not provided
I20260808 14:45:10.623407 2767 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:45:10.623541 2767 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:45:10.624634 2767 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/minicluster-data/master-0/data/instance:
uuid: "66dcd39ef6ea4dd986e06e0512e3f295"
format_stamp: "Formatted at 2026-08-08 14:45:10 on dist-test-slave-42z9"
server_key: "795ab694af9703d60715c9bf77a91161"
server_key_iv: "d93677cc7d80a80f8eb849a45f4bb1fd"
server_key_version: "encryptionkey@0"
I20260808 14:45:10.624984 2767 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/minicluster-data/master-0/wal/instance:
uuid: "66dcd39ef6ea4dd986e06e0512e3f295"
format_stamp: "Formatted at 2026-08-08 14:45:10 on dist-test-slave-42z9"
server_key: "795ab694af9703d60715c9bf77a91161"
server_key_iv: "d93677cc7d80a80f8eb849a45f4bb1fd"
server_key_version: "encryptionkey@0"
I20260808 14:45:10.626408 2767 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 14:45:10.627097 2793 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:10.627271 2767 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:10.627362 2767 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/minicluster-data/master-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/minicluster-data/master-0/wal
uuid: "66dcd39ef6ea4dd986e06e0512e3f295"
format_stamp: "Formatted at 2026-08-08 14:45:10 on dist-test-slave-42z9"
server_key: "795ab694af9703d60715c9bf77a91161"
server_key_iv: "d93677cc7d80a80f8eb849a45f4bb1fd"
server_key_version: "encryptionkey@0"
I20260808 14:45:10.627429 2767 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:45:10.636646 2767 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:45:10.638537 2767 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:45:10.638681 2767 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:45:10.642720 2767 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.190:33535
I20260808 14:45:10.642756 2870 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.190:33535 every 8 connection(s)
I20260808 14:45:10.643117 2767 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
I20260808 14:45:10.643997 2871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:45:10.646396 2871 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 66dcd39ef6ea4dd986e06e0512e3f295: Bootstrap starting.
I20260808 14:45:10.647001 2871 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 66dcd39ef6ea4dd986e06e0512e3f295: Neither blocks nor log segments found. Creating new log.
I20260808 14:45:10.647277 2871 log.cc:824] T 00000000000000000000000000000000 P 66dcd39ef6ea4dd986e06e0512e3f295: Log is configured to *not* fsync() on all Append() calls
I20260808 14:45:10.648253 2871 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 66dcd39ef6ea4dd986e06e0512e3f295: No bootstrap required, opened a new log
I20260808 14:45:10.649953 2871 raft_consensus.cc:348] T 00000000000000000000000000000000 P 66dcd39ef6ea4dd986e06e0512e3f295 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66dcd39ef6ea4dd986e06e0512e3f295" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 33535 } }
I20260808 14:45:10.650108 2871 raft_consensus.cc:374] T 00000000000000000000000000000000 P 66dcd39ef6ea4dd986e06e0512e3f295 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:45:10.650130 2871 raft_consensus.cc:729] T 00000000000000000000000000000000 P 66dcd39ef6ea4dd986e06e0512e3f295 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66dcd39ef6ea4dd986e06e0512e3f295, State: Initialized, Role: FOLLOWER
I20260808 14:45:10.650275 2871 consensus_queue.cc:260] T 00000000000000000000000000000000 P 66dcd39ef6ea4dd986e06e0512e3f295 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66dcd39ef6ea4dd986e06e0512e3f295" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 33535 } }
I20260808 14:45:10.650336 2871 raft_consensus.cc:388] T 00000000000000000000000000000000 P 66dcd39ef6ea4dd986e06e0512e3f295 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:45:10.650357 2871 raft_consensus.cc:482] T 00000000000000000000000000000000 P 66dcd39ef6ea4dd986e06e0512e3f295 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:45:10.650401 2871 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 66dcd39ef6ea4dd986e06e0512e3f295 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:10.650652 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 2767
I20260808 14:45:10.650739 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/minicluster-data/master-0/wal/instance
I20260808 14:45:10.650908 31578 external_mini_cluster.cc:1428] Setting key 53709cbe85bd29fc2d3fe3955d833b4b
I20260808 14:45:10.651014 2871 raft_consensus.cc:504] T 00000000000000000000000000000000 P 66dcd39ef6ea4dd986e06e0512e3f295 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66dcd39ef6ea4dd986e06e0512e3f295" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 33535 } }
I20260808 14:45:10.651119 2871 leader_election.cc:302] T 00000000000000000000000000000000 P 66dcd39ef6ea4dd986e06e0512e3f295 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 66dcd39ef6ea4dd986e06e0512e3f295; no voters:
I20260808 14:45:10.651296 2871 leader_election.cc:288] T 00000000000000000000000000000000 P 66dcd39ef6ea4dd986e06e0512e3f295 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:45:10.651568 2871 sys_catalog.cc:564] T 00000000000000000000000000000000 P 66dcd39ef6ea4dd986e06e0512e3f295 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:45:10.651686 2876 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 66dcd39ef6ea4dd986e06e0512e3f295 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:45:10.651846 2876 raft_consensus.cc:686] T 00000000000000000000000000000000 P 66dcd39ef6ea4dd986e06e0512e3f295 [term 1 LEADER]: Becoming Leader. State: Replica: 66dcd39ef6ea4dd986e06e0512e3f295, State: Running, Role: LEADER
I20260808 14:45:10.651993 2876 consensus_queue.cc:237] T 00000000000000000000000000000000 P 66dcd39ef6ea4dd986e06e0512e3f295 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66dcd39ef6ea4dd986e06e0512e3f295" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 33535 } }
I20260808 14:45:10.652423 2874 sys_catalog.cc:455] T 00000000000000000000000000000000 P 66dcd39ef6ea4dd986e06e0512e3f295 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "66dcd39ef6ea4dd986e06e0512e3f295" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66dcd39ef6ea4dd986e06e0512e3f295" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 33535 } } }
I20260808 14:45:10.652508 2874 sys_catalog.cc:458] T 00000000000000000000000000000000 P 66dcd39ef6ea4dd986e06e0512e3f295 [sys.catalog]: This master's current role is: LEADER
I20260808 14:45:10.652757 2878 sys_catalog.cc:455] T 00000000000000000000000000000000 P 66dcd39ef6ea4dd986e06e0512e3f295 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 66dcd39ef6ea4dd986e06e0512e3f295. Latest consensus state: current_term: 1 leader_uuid: "66dcd39ef6ea4dd986e06e0512e3f295" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66dcd39ef6ea4dd986e06e0512e3f295" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 33535 } } }
I20260808 14:45:10.652885 2878 sys_catalog.cc:458] T 00000000000000000000000000000000 P 66dcd39ef6ea4dd986e06e0512e3f295 [sys.catalog]: This master's current role is: LEADER
W20260808 14:45:10.653388 2897 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 66dcd39ef6ea4dd986e06e0512e3f295: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:45:10.653462 2897 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:45:10.653517 2890 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:45:10.653663 2890 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:45:10.655260 2890 catalog_manager.cc:1347] Generated new cluster ID: fe19a3413ffb4ea69d7771f11778a45d
I20260808 14:45:10.655318 2890 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 14:45:10 dist-test-slave-42z9 krb5kdc[2744](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200310, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:45:10.661085 2877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:10.651391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53804 (local address 127.30.214.190:33535)
0808 14:45:10.651647 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:10.651657 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:10.651688 (+ 31us) server_negotiation.cc:407] Connection header received
0808 14:45:10.651807 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:10.651814 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:10.651874 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:10.652002 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:10.652817 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:10.653990 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:10.654995 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:10.655543 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:10.655606 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:10.658016 (+ 2410us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:10.658021 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:10.658022 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:10.658036 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:10.659607 (+ 1571us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:10.659940 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:10.659943 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:10.659943 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:10.660042 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:10.660221 (+ 179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:10.660222 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:10.660222 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:10.660486 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:10.660638 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:10.660736 (+ 98us) server_negotiation.cc:299] Negotiation successful
0808 14:45:10.660886 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":208,"thread_start_us":112,"threads_started":1}
I20260808 14:45:10.668540 2890 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:45:10.669087 2890 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:45:10.671957 2890 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 66dcd39ef6ea4dd986e06e0512e3f295: Generated new TSK 0
I20260808 14:45:10.672174 2890 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.214.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab.
Entry for principal kudu/127.30.214.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab.
I20260808 14:45:10.709662 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.129:0
--local_ip_for_outbound_sockets=127.30.214.129
--webserver_interface=127.30.214.129
--webserver_port=0
--tserver_master_addrs=127.30.214.190:33535
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab
--principal=kudu/127.30.214.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:39167
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:45:10.798404 2906 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:45:10.798640 2906 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:45:10.798676 2906 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:45:10.800136 2906 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:45:10.800217 2906 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:45:10.800262 2906 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.129
I20260808 14:45:10.802019 2906 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:39167
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab
--principal=kudu/127.30.214.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.214.129
--webserver_port=0
--tserver_master_addrs=127.30.214.190:33535
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2906
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.129
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:45:10.802302 2906 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:45:10.802537 2906 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:45:10.808187 2917 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:10.808185 2906 server_base.cc:1034] running on GCE node
W20260808 14:45:10.808168 2911 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:10.808209 2914 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:10.808759 2906 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:45:10.809056 2906 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:45:10.810235 2906 hybrid_clock.cc:648] HybridClock initialized: now 1786200310810221 us; error 32 us; skew 500 ppm
Aug 08 14:45:10 dist-test-slave-42z9 krb5kdc[2744](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200310, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:45:10.812811 2906 init.cc:377] Logged in from keytab as kudu/127.30.214.129@KRBTEST.COM (short username kudu)
I20260808 14:45:10.813278 2906 webserver.cc:460] Webserver started at http://127.30.214.129:46217/ using document root <none> and password file <none>
I20260808 14:45:10.813531 2906 fs_manager.cc:359] Metadata directory not provided
I20260808 14:45:10.813588 2906 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:45:10.813728 2906 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:45:10.814841 2906 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-0/data/instance:
uuid: "385cb38b14f740d780e9b686e5fac775"
format_stamp: "Formatted at 2026-08-08 14:45:10 on dist-test-slave-42z9"
server_key: "4a4be64a30caf2eb77cbcc19a3b2acd6"
server_key_iv: "163cb8b5cdab74efc8b1ec870b181634"
server_key_version: "encryptionkey@0"
I20260808 14:45:10.815194 2906 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-0/wal/instance:
uuid: "385cb38b14f740d780e9b686e5fac775"
format_stamp: "Formatted at 2026-08-08 14:45:10 on dist-test-slave-42z9"
server_key: "4a4be64a30caf2eb77cbcc19a3b2acd6"
server_key_iv: "163cb8b5cdab74efc8b1ec870b181634"
server_key_version: "encryptionkey@0"
I20260808 14:45:10.816854 2906 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:45:10.817974 2925 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:10.818348 2906 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 14:45:10.818468 2906 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-0/wal
uuid: "385cb38b14f740d780e9b686e5fac775"
format_stamp: "Formatted at 2026-08-08 14:45:10 on dist-test-slave-42z9"
server_key: "4a4be64a30caf2eb77cbcc19a3b2acd6"
server_key_iv: "163cb8b5cdab74efc8b1ec870b181634"
server_key_version: "encryptionkey@0"
I20260808 14:45:10.818558 2906 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:45:10.853580 2906 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:45:10.855693 2906 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:45:10.855839 2906 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:45:10.856070 2906 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:45:10.856381 2906 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:45:10.856415 2906 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:10.856444 2906 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:45:10.856462 2906 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:10.862236 2906 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.129:45119
I20260808 14:45:10.862296 3100 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.129:45119 every 8 connection(s)
I20260808 14:45:10.862624 2906 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
I20260808 14:45:10.866847 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 2906
I20260808 14:45:10.866952 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-0/wal/instance
I20260808 14:45:10.867168 31578 external_mini_cluster.cc:1428] Setting key 6061cc601ae0d8c15de1e633899886fc
Aug 08 14:45:10 dist-test-slave-42z9 krb5kdc[2744](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200310, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.129@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:45:10.873339 2877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:10.863346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.129:56073 (local address 127.30.214.190:33535)
0808 14:45:10.863406 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:10.863408 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:10.863598 (+ 190us) server_negotiation.cc:407] Connection header received
0808 14:45:10.864113 (+ 515us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:10.864114 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:10.864126 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:10.864187 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:10.865139 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:10.865673 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:10.866647 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:10.866932 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:10.867025 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:10.869719 (+ 2694us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:10.869724 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:10.869724 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:10.869747 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:10.871779 (+ 2032us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:10.872293 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:10.872295 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:10.872295 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:10.872357 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:10.872622 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:10.872622 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:10.872622 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:10.872727 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:10.872775 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:10.873148 (+ 373us) server_negotiation.cc:299] Negotiation successful
0808 14:45:10.873241 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 14:45:10.873595 3106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:10.863307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:33535 (local address 127.30.214.129:56073)
0808 14:45:10.863470 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:10.863514 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:10.863991 (+ 477us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:10.864244 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:10.864247 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:10.864828 (+ 581us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:10.865032 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:10.865037 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:10.865760 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:10.865761 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:10.866569 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:10.866572 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:10.867114 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:10.867116 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:10.867276 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:10.867858 (+ 582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:10.867867 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:10.869534 (+ 1667us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:10.871881 (+ 2347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:10.871891 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:10.871894 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:10.872212 (+ 318us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:10.872422 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:10.872423 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:10.872423 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:10.872565 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:10.872777 (+ 212us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:10.872783 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:10.873000 (+ 217us) client_negotiation.cc:769] Sending connection context
0808 14:45:10.873126 (+ 126us) client_negotiation.cc:240] Negotiation successful
0808 14:45:10.873318 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":72,"threads_started":1}
I20260808 14:45:10.874262 3101 heartbeater.cc:347] Connected to a master server at 127.30.214.190:33535
I20260808 14:45:10.874382 3101 heartbeater.cc:464] Registering TS with master...
I20260808 14:45:10.874601 3101 heartbeater.cc:511] Master 127.30.214.190:33535 requested a full tablet report, sending...
I20260808 14:45:10.875139 2817 ts_manager.cc:194] Registered new tserver with Master: 385cb38b14f740d780e9b686e5fac775 (127.30.214.129:45119)
I20260808 14:45:10.875777 2817 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.214.129@KRBTEST.COM'} at 127.30.214.129:56073
WARNING: no policy specified for kudu/127.30.214.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab.
Entry for principal kudu/127.30.214.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab.
I20260808 14:45:10.895823 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.130:0
--local_ip_for_outbound_sockets=127.30.214.130
--webserver_interface=127.30.214.130
--webserver_port=0
--tserver_master_addrs=127.30.214.190:33535
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab
--principal=kudu/127.30.214.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:39167
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:45:10.978976 3110 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:45:10.979199 3110 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:45:10.979224 3110 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:45:10.980450 3110 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:45:10.980501 3110 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:45:10.980528 3110 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.130
I20260808 14:45:10.982117 3110 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:39167
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab
--principal=kudu/127.30.214.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.214.130
--webserver_port=0
--tserver_master_addrs=127.30.214.190:33535
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3110
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.130
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:45:10.982383 3110 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:45:10.982617 3110 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 14:45:10.987689 3110 server_base.cc:1034] running on GCE node
W20260808 14:45:10.987628 3122 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:10.987632 3118 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:10.987632 3120 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:10.988085 3110 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:45:10.988323 3110 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:45:10.989496 3110 hybrid_clock.cc:648] HybridClock initialized: now 1786200310989479 us; error 33 us; skew 500 ppm
Aug 08 14:45:10 dist-test-slave-42z9 krb5kdc[2744](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200310, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:45:10.992247 3110 init.cc:377] Logged in from keytab as kudu/127.30.214.130@KRBTEST.COM (short username kudu)
I20260808 14:45:10.992720 3110 webserver.cc:460] Webserver started at http://127.30.214.130:39071/ using document root <none> and password file <none>
I20260808 14:45:10.992924 3110 fs_manager.cc:359] Metadata directory not provided
I20260808 14:45:10.992967 3110 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:45:10.993070 3110 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:45:10.994166 3110 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-1/data/instance:
uuid: "6b229100e00f42fd92ee2d7d723da536"
format_stamp: "Formatted at 2026-08-08 14:45:10 on dist-test-slave-42z9"
server_key: "0cd4e86967e648698b2109f6653377d8"
server_key_iv: "3d043d975f94450aa99ba109216daffa"
server_key_version: "encryptionkey@0"
I20260808 14:45:10.994473 3110 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-1/wal/instance:
uuid: "6b229100e00f42fd92ee2d7d723da536"
format_stamp: "Formatted at 2026-08-08 14:45:10 on dist-test-slave-42z9"
server_key: "0cd4e86967e648698b2109f6653377d8"
server_key_iv: "3d043d975f94450aa99ba109216daffa"
server_key_version: "encryptionkey@0"
I20260808 14:45:10.995761 3110 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:45:10.996510 3132 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:10.996713 3110 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:45:10.996798 3110 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-1/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-1/wal
uuid: "6b229100e00f42fd92ee2d7d723da536"
format_stamp: "Formatted at 2026-08-08 14:45:10 on dist-test-slave-42z9"
server_key: "0cd4e86967e648698b2109f6653377d8"
server_key_iv: "3d043d975f94450aa99ba109216daffa"
server_key_version: "encryptionkey@0"
I20260808 14:45:10.996865 3110 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:45:11.010459 3110 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:45:11.012957 3110 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:45:11.013088 3110 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:45:11.013286 3110 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:45:11.013677 3110 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:45:11.013715 3110 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:11.013737 3110 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:45:11.013749 3110 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:11.019542 3110 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.130:34855
I20260808 14:45:11.019641 3296 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.130:34855 every 8 connection(s)
I20260808 14:45:11.019917 3110 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
I20260808 14:45:11.021723 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 3110
I20260808 14:45:11.021818 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-1/wal/instance
I20260808 14:45:11.021984 31578 external_mini_cluster.cc:1428] Setting key 26fec2434dcc6243a10b23dc4f195df2
Aug 08 14:45:11 dist-test-slave-42z9 krb5kdc[2744](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200310, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.130@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:45:11.029685 2877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:11.020639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.130:59539 (local address 127.30.214.190:33535)
0808 14:45:11.020717 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:11.020719 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:11.020901 (+ 182us) server_negotiation.cc:407] Connection header received
0808 14:45:11.021411 (+ 510us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:11.021412 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:11.021426 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:11.021507 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:11.022644 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:11.023145 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:11.024152 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:11.024346 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:11.024408 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:11.026816 (+ 2408us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:11.026818 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:11.026818 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:11.026825 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:11.028279 (+ 1454us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:11.028696 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:11.028698 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:11.028698 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:11.028759 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:11.029000 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:11.029001 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:11.029001 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:11.029117 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:11.029173 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:11.029497 (+ 324us) server_negotiation.cc:299] Negotiation successful
0808 14:45:11.029593 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 14:45:11.029868 3299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:11.020611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:33535 (local address 127.30.214.130:59539)
0808 14:45:11.020781 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:11.020821 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:11.021308 (+ 487us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:11.021606 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:11.021610 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:11.022256 (+ 646us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:11.022558 (+ 302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:11.022565 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:11.023235 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:11.023236 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:11.024062 (+ 826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:11.024065 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:11.024432 (+ 367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:11.024433 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:11.024554 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:11.025096 (+ 542us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:11.025105 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:11.026707 (+ 1602us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:11.028376 (+ 1669us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:11.028386 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:11.028388 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:11.028624 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:11.028818 (+ 194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:11.028818 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:11.028819 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:11.028931 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:11.029187 (+ 256us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:11.029194 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:11.029339 (+ 145us) client_negotiation.cc:769] Sending connection context
0808 14:45:11.029432 (+ 93us) client_negotiation.cc:240] Negotiation successful
0808 14:45:11.029628 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":90,"threads_started":1}
I20260808 14:45:11.030642 3297 heartbeater.cc:347] Connected to a master server at 127.30.214.190:33535
WARNING: no policy specified for kudu/127.30.214.131@KRBTEST.COM; defaulting to no policy
I20260808 14:45:11.030776 3297 heartbeater.cc:464] Registering TS with master...
I20260808 14:45:11.030994 3297 heartbeater.cc:511] Master 127.30.214.190:33535 requested a full tablet report, sending...
I20260808 14:45:11.031396 2817 ts_manager.cc:194] Registered new tserver with Master: 6b229100e00f42fd92ee2d7d723da536 (127.30.214.130:34855)
I20260808 14:45:11.031787 2817 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.214.130@KRBTEST.COM'} at 127.30.214.130:59539
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab.
Entry for principal kudu/127.30.214.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab.
I20260808 14:45:11.048712 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.131:0
--local_ip_for_outbound_sockets=127.30.214.131
--webserver_interface=127.30.214.131
--webserver_port=0
--tserver_master_addrs=127.30.214.190:33535
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab
--principal=kudu/127.30.214.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:39167
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:45:11.135521 3303 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:45:11.135749 3303 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:45:11.135776 3303 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:45:11.137095 3303 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:45:11.137148 3303 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:45:11.137178 3303 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.131
I20260808 14:45:11.138881 3303 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:39167
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab
--principal=kudu/127.30.214.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.214.131
--webserver_port=0
--tserver_master_addrs=127.30.214.190:33535
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3303
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.131
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:45:11.139124 3303 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:45:11.139333 3303 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:45:11.144706 3315 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:11.144693 3313 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:11.144693 3312 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:11.144960 3303 server_base.cc:1034] running on GCE node
I20260808 14:45:11.145181 3303 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:45:11.145473 3303 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:45:11.146627 3303 hybrid_clock.cc:648] HybridClock initialized: now 1786200311146618 us; error 30 us; skew 500 ppm
Aug 08 14:45:11 dist-test-slave-42z9 krb5kdc[2744](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200311, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:45:11.149225 3303 init.cc:377] Logged in from keytab as kudu/127.30.214.131@KRBTEST.COM (short username kudu)
I20260808 14:45:11.149731 3303 webserver.cc:460] Webserver started at http://127.30.214.131:33587/ using document root <none> and password file <none>
I20260808 14:45:11.149961 3303 fs_manager.cc:359] Metadata directory not provided
I20260808 14:45:11.150022 3303 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:45:11.150164 3303 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:45:11.151216 3303 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-2/data/instance:
uuid: "30033e17aae64f528e0ba7bcc938633f"
format_stamp: "Formatted at 2026-08-08 14:45:11 on dist-test-slave-42z9"
server_key: "4df2adc41cc1f83c26f382a6d61f010a"
server_key_iv: "bb49ca739a8d1d6f67170799bf561349"
server_key_version: "encryptionkey@0"
I20260808 14:45:11.151589 3303 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-2/wal/instance:
uuid: "30033e17aae64f528e0ba7bcc938633f"
format_stamp: "Formatted at 2026-08-08 14:45:11 on dist-test-slave-42z9"
server_key: "4df2adc41cc1f83c26f382a6d61f010a"
server_key_iv: "bb49ca739a8d1d6f67170799bf561349"
server_key_version: "encryptionkey@0"
I20260808 14:45:11.153137 3303 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:45:11.154492 3327 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:11.154753 3303 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 14:45:11.154862 3303 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-2/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-2/wal
uuid: "30033e17aae64f528e0ba7bcc938633f"
format_stamp: "Formatted at 2026-08-08 14:45:11 on dist-test-slave-42z9"
server_key: "4df2adc41cc1f83c26f382a6d61f010a"
server_key_iv: "bb49ca739a8d1d6f67170799bf561349"
server_key_version: "encryptionkey@0"
I20260808 14:45:11.154945 3303 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:45:11.166461 3303 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:45:11.168637 3303 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:45:11.168781 3303 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:45:11.169016 3303 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:45:11.169328 3303 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:45:11.169363 3303 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:11.169392 3303 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:45:11.169416 3303 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:11.175562 3303 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.131:43483
I20260808 14:45:11.175609 3485 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.131:43483 every 8 connection(s)
I20260808 14:45:11.175952 3303 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
Aug 08 14:45:11 dist-test-slave-42z9 krb5kdc[2744](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200311, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.131@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:45:11.185052 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 3303
I20260808 14:45:11.185160 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-2/wal/instance
I20260808 14:45:11.185348 31578 external_mini_cluster.cc:1428] Setting key 67d887ee36ebd2160cd9a88cfc352b20
I20260808 14:45:11.185619 3488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:11.176657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:33535 (local address 127.30.214.131:37123)
0808 14:45:11.176848 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:11.176889 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:11.177404 (+ 515us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:11.177670 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:11.177674 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:11.178281 (+ 607us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:11.178487 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:11.178492 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:11.179183 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:11.179184 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:11.180030 (+ 846us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:11.180033 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:11.180401 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:11.180402 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:11.180542 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:11.181037 (+ 495us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:11.181045 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:11.182497 (+ 1452us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:11.184142 (+ 1645us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:11.184149 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:11.184151 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:11.184407 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:11.184568 (+ 161us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:11.184569 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:11.184569 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:11.184665 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:11.184848 (+ 183us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:11.184869 (+ 21us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:11.185047 (+ 178us) client_negotiation.cc:769] Sending connection context
0808 14:45:11.185173 (+ 126us) client_negotiation.cc:240] Negotiation successful
0808 14:45:11.185356 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":101,"threads_started":1}
I20260808 14:45:11.185704 2877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:11.176706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:37123 (local address 127.30.214.190:33535)
0808 14:45:11.176773 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:11.176775 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:11.176975 (+ 200us) server_negotiation.cc:407] Connection header received
0808 14:45:11.177530 (+ 555us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:11.177531 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:11.177545 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:11.177598 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:11.178589 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:11.179091 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:11.180125 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:11.180325 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:11.180381 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:11.182607 (+ 2226us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:11.182608 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:11.182608 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:11.182616 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:11.184042 (+ 1426us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:11.184470 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:11.184470 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:11.184471 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:11.184521 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:11.184706 (+ 185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:11.184707 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:11.184707 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:11.184808 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:11.184851 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:11.185305 (+ 454us) server_negotiation.cc:299] Negotiation successful
0808 14:45:11.185487 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 14:45:11.186259 3486 heartbeater.cc:347] Connected to a master server at 127.30.214.190:33535
I20260808 14:45:11.186419 3486 heartbeater.cc:464] Registering TS with master...
I20260808 14:45:11.186713 3486 heartbeater.cc:511] Master 127.30.214.190:33535 requested a full tablet report, sending...
I20260808 14:45:11.187285 2816 ts_manager.cc:194] Registered new tserver with Master: 30033e17aae64f528e0ba7bcc938633f (127.30.214.131:43483)
I20260808 14:45:11.187673 2816 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.214.131@KRBTEST.COM'} at 127.30.214.131:37123
I20260808 14:45:11.197860 31578 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 14:45:11.212649 2877 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:45:11.211342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53816 (local address 127.30.214.190:33535)
0808 14:45:11.211410 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:11.211412 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:11.211519 (+ 107us) server_negotiation.cc:407] Connection header received
0808 14:45:11.211605 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:11.211606 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:11.211616 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:11.211680 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:11.212560 (+ 880us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53816: BlockingRecv error: recv got EOF from 127.0.0.1:53816 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 14:45:11.213639 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 2906
I20260808 14:45:11.230952 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 3110
I20260808 14:45:11.240799 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 3303
I20260808 14:45:11.254062 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 2767
2026-08-08T14:45:11Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2014 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200295877777-31578-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:45:11 dist-test-slave-42z9 krb5kdc[3502](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:45:11 dist-test-slave-42z9 krb5kdc[3502](info): set up 2 sockets
Aug 08 14:45:11 dist-test-slave-42z9 krb5kdc[3502](info): commencing operation
krb5kdc: starting...
W20260808 14:45:12.401875 31578 mini_kdc.cc:121] Time spent starting KDC: real 1.120s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Aug 08 14:45:12 dist-test-slave-42z9 krb5kdc[3502](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200312, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:45:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:45:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.214.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab.
Entry for principal kudu/127.30.214.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab.
I20260808 14:45:12.524501 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200295877777-31578-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200295877777-31578-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200295877777-31578-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:39743
--webserver_interface=127.30.214.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab
--principal=kudu/127.30.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:40909
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.214.190:39743
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:45:12.608279 3519 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:45:12.608521 3519 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:45:12.608556 3519 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:45:12.609840 3519 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:45:12.609901 3519 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:45:12.609922 3519 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:45:12.609938 3519 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:45:12.609954 3519 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:45:12.611632 3519 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:40909
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200295877777-31578-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200295877777-31578-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.214.190:39743
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab
--principal=kudu/127.30.214.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:39743
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3519
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200295877777-31578-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:45:12.611917 3519 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:45:12.612151 3519 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:45:12.617108 3534 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:12.617126 3529 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:12.617120 3527 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:12.617414 3519 server_base.cc:1034] running on GCE node
I20260808 14:45:12.617722 3519 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:45:12.618014 3519 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:45:12.619160 3519 hybrid_clock.cc:648] HybridClock initialized: now 1786200312619144 us; error 31 us; skew 500 ppm
Aug 08 14:45:12 dist-test-slave-42z9 krb5kdc[3502](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200312, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:45:12.624441 3519 init.cc:377] Logged in from keytab as kudu/127.30.214.190@KRBTEST.COM (short username kudu)
I20260808 14:45:12.624912 3519 webserver.cc:460] Webserver started at http://127.30.214.190:33011/ using document root <none> and password file <none>
I20260808 14:45:12.625149 3519 fs_manager.cc:359] Metadata directory not provided
I20260808 14:45:12.625200 3519 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:45:12.625335 3519 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:45:12.626463 3519 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200295877777-31578-0/minicluster-data/master-0/data/instance:
uuid: "6326b66000994cb3a0395a1a09a2fefe"
format_stamp: "Formatted at 2026-08-08 14:45:12 on dist-test-slave-42z9"
server_key: "4367b533d44436f6193f015d3163a143"
server_key_iv: "90d7353b7e9bcdd103fa1f703a3171f4"
server_key_version: "encryptionkey@0"
I20260808 14:45:12.626816 3519 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200295877777-31578-0/minicluster-data/master-0/wal/instance:
uuid: "6326b66000994cb3a0395a1a09a2fefe"
format_stamp: "Formatted at 2026-08-08 14:45:12 on dist-test-slave-42z9"
server_key: "4367b533d44436f6193f015d3163a143"
server_key_iv: "90d7353b7e9bcdd103fa1f703a3171f4"
server_key_version: "encryptionkey@0"
I20260808 14:45:12.628137 3519 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:45:12.628822 3544 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:12.628971 3519 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:45:12.629062 3519 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200295877777-31578-0/minicluster-data/master-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200295877777-31578-0/minicluster-data/master-0/wal
uuid: "6326b66000994cb3a0395a1a09a2fefe"
format_stamp: "Formatted at 2026-08-08 14:45:12 on dist-test-slave-42z9"
server_key: "4367b533d44436f6193f015d3163a143"
server_key_iv: "90d7353b7e9bcdd103fa1f703a3171f4"
server_key_version: "encryptionkey@0"
I20260808 14:45:12.629140 3519 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200295877777-31578-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200295877777-31578-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200295877777-31578-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:45:12.647027 3519 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:45:12.649251 3519 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:45:12.649407 3519 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:45:12.653339 3519 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.190:39743
I20260808 14:45:12.653389 3628 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.190:39743 every 8 connection(s)
I20260808 14:45:12.653978 3519 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
I20260808 14:45:12.654670 3629 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:45:12.656975 3629 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6326b66000994cb3a0395a1a09a2fefe: Bootstrap starting.
I20260808 14:45:12.657612 3629 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6326b66000994cb3a0395a1a09a2fefe: Neither blocks nor log segments found. Creating new log.
I20260808 14:45:12.657860 3629 log.cc:824] T 00000000000000000000000000000000 P 6326b66000994cb3a0395a1a09a2fefe: Log is configured to *not* fsync() on all Append() calls
I20260808 14:45:12.658545 3629 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6326b66000994cb3a0395a1a09a2fefe: No bootstrap required, opened a new log
I20260808 14:45:12.660156 3629 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6326b66000994cb3a0395a1a09a2fefe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6326b66000994cb3a0395a1a09a2fefe" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 39743 } }
I20260808 14:45:12.660310 3629 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6326b66000994cb3a0395a1a09a2fefe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:45:12.660333 3629 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6326b66000994cb3a0395a1a09a2fefe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6326b66000994cb3a0395a1a09a2fefe, State: Initialized, Role: FOLLOWER
I20260808 14:45:12.660495 3629 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6326b66000994cb3a0395a1a09a2fefe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6326b66000994cb3a0395a1a09a2fefe" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 39743 } }
I20260808 14:45:12.660580 3629 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6326b66000994cb3a0395a1a09a2fefe [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:45:12.660619 3629 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6326b66000994cb3a0395a1a09a2fefe [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:45:12.660624 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 3519
I20260808 14:45:12.660667 3629 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6326b66000994cb3a0395a1a09a2fefe [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:12.660714 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786200295877777-31578-0/minicluster-data/master-0/wal/instance
I20260808 14:45:12.660895 31578 external_mini_cluster.cc:1428] Setting key 694d9f19fe6e1cdc33152b771b498b69
I20260808 14:45:12.661871 3629 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6326b66000994cb3a0395a1a09a2fefe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6326b66000994cb3a0395a1a09a2fefe" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 39743 } }
I20260808 14:45:12.662004 3629 leader_election.cc:302] T 00000000000000000000000000000000 P 6326b66000994cb3a0395a1a09a2fefe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6326b66000994cb3a0395a1a09a2fefe; no voters:
I20260808 14:45:12.662176 3629 leader_election.cc:288] T 00000000000000000000000000000000 P 6326b66000994cb3a0395a1a09a2fefe [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:45:12.662206 3635 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6326b66000994cb3a0395a1a09a2fefe [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:45:12.662354 3635 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6326b66000994cb3a0395a1a09a2fefe [term 1 LEADER]: Becoming Leader. State: Replica: 6326b66000994cb3a0395a1a09a2fefe, State: Running, Role: LEADER
I20260808 14:45:12.662454 3629 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6326b66000994cb3a0395a1a09a2fefe [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:45:12.662451 3635 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6326b66000994cb3a0395a1a09a2fefe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6326b66000994cb3a0395a1a09a2fefe" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 39743 } }
I20260808 14:45:12.663107 3636 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6326b66000994cb3a0395a1a09a2fefe [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6326b66000994cb3a0395a1a09a2fefe. Latest consensus state: current_term: 1 leader_uuid: "6326b66000994cb3a0395a1a09a2fefe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6326b66000994cb3a0395a1a09a2fefe" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 39743 } } }
I20260808 14:45:12.663208 3636 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6326b66000994cb3a0395a1a09a2fefe [sys.catalog]: This master's current role is: LEADER
I20260808 14:45:12.663345 3637 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6326b66000994cb3a0395a1a09a2fefe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6326b66000994cb3a0395a1a09a2fefe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6326b66000994cb3a0395a1a09a2fefe" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 39743 } } }
I20260808 14:45:12.663406 3637 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6326b66000994cb3a0395a1a09a2fefe [sys.catalog]: This master's current role is: LEADER
I20260808 14:45:12.663691 3645 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:45:12.664455 3645 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:45:12.666112 3645 catalog_manager.cc:1347] Generated new cluster ID: fafc68c3b1444448adebd514092dd17c
I20260808 14:45:12.666173 3645 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 14:45:12 dist-test-slave-42z9 krb5kdc[3502](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200312, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:45:12.672988 3634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:12.661397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48688 (local address 127.30.214.190:39743)
0808 14:45:12.661605 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:12.661615 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:12.661642 (+ 27us) server_negotiation.cc:407] Connection header received
0808 14:45:12.661744 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:12.661750 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:12.661794 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:12.661909 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:12.662797 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:12.664403 (+ 1606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:12.665520 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:12.666143 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:12.666268 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:12.669173 (+ 2905us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:12.669178 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:12.669178 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:12.669193 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:12.671202 (+ 2009us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:12.671637 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:12.671640 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:12.671641 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:12.671772 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:12.671988 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:12.671989 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:12.671989 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:12.672296 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:12.672460 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:12.672597 (+ 137us) server_negotiation.cc:299] Negotiation successful
0808 14:45:12.672747 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":151,"thread_start_us":122,"threads_started":1}
I20260808 14:45:12.674046 31578 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:45:12.679785 3645 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:45:12.680538 3645 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:45:12.687738 3645 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6326b66000994cb3a0395a1a09a2fefe: Generated new TSK 0
I20260808 14:45:12.687958 3645 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:45:12.693150 3634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:12.688458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48694 (local address 127.30.214.190:39743)
0808 14:45:12.688513 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:12.688515 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:12.688607 (+ 92us) server_negotiation.cc:407] Connection header received
0808 14:45:12.688657 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:12.688658 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:12.688670 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:12.688743 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:12.689126 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:12.689953 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:12.691059 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:12.691407 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:12.691504 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:12.692450 (+ 946us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:12.692451 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:12.692452 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:45:12.692746 (+ 294us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:12.692773 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:45:12.692782 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:12.692862 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:12.693019 (+ 157us) server_negotiation.cc:299] Negotiation successful
0808 14:45:12.693056 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 14:45:12.695885 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 3519
2026-08-08T14:45:12Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1440 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:45:12 dist-test-slave-42z9 krb5kdc[3666](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:45:12 dist-test-slave-42z9 krb5kdc[3666](info): set up 2 sockets
Aug 08 14:45:12 dist-test-slave-42z9 krb5kdc[3666](info): commencing operation
krb5kdc: starting...
W20260808 14:45:13.848665 31578 mini_kdc.cc:121] Time spent starting KDC: real 1.126s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Aug 08 14:45:13 dist-test-slave-42z9 krb5kdc[3666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200313, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:45:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:45:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.214.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab.
Entry for principal kudu/127.30.214.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab.
I20260808 14:45:13.970175 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:44185
--webserver_interface=127.30.214.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab
--principal=kudu/127.30.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:38257
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.214.190:44185
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:45:14.052872 3686 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:45:14.053097 3686 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:45:14.053128 3686 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:45:14.054319 3686 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:45:14.054370 3686 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:45:14.054388 3686 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:45:14.054405 3686 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:45:14.054420 3686 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:45:14.055960 3686 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:38257
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.214.190:44185
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab
--principal=kudu/127.30.214.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:44185
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3686
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:45:14.056223 3686 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:45:14.056442 3686 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:45:14.061154 3694 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:14.061162 3693 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:14.061163 3696 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:14.061414 3686 server_base.cc:1034] running on GCE node
I20260808 14:45:14.061656 3686 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:45:14.061924 3686 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:45:14.063103 3686 hybrid_clock.cc:648] HybridClock initialized: now 1786200314063087 us; error 29 us; skew 500 ppm
Aug 08 14:45:14 dist-test-slave-42z9 krb5kdc[3666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200314, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:45:14.065624 3686 init.cc:377] Logged in from keytab as kudu/127.30.214.190@KRBTEST.COM (short username kudu)
I20260808 14:45:14.066061 3686 webserver.cc:460] Webserver started at http://127.30.214.190:33323/ using document root <none> and password file <none>
I20260808 14:45:14.066269 3686 fs_manager.cc:359] Metadata directory not provided
I20260808 14:45:14.066316 3686 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:45:14.066442 3686 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:45:14.067488 3686 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/minicluster-data/master-0/data/instance:
uuid: "983e15645eaf4c3cbc34f1eacd7f5b10"
format_stamp: "Formatted at 2026-08-08 14:45:14 on dist-test-slave-42z9"
server_key: "730b7f22d3be7506c1ac9e19a73a3075"
server_key_iv: "79ed83fcaf737d346373be7d2ea022b7"
server_key_version: "encryptionkey@0"
I20260808 14:45:14.067832 3686 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/minicluster-data/master-0/wal/instance:
uuid: "983e15645eaf4c3cbc34f1eacd7f5b10"
format_stamp: "Formatted at 2026-08-08 14:45:14 on dist-test-slave-42z9"
server_key: "730b7f22d3be7506c1ac9e19a73a3075"
server_key_iv: "79ed83fcaf737d346373be7d2ea022b7"
server_key_version: "encryptionkey@0"
I20260808 14:45:14.069108 3686 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:45:14.069808 3706 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:14.069963 3686 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:14.070046 3686 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/minicluster-data/master-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/minicluster-data/master-0/wal
uuid: "983e15645eaf4c3cbc34f1eacd7f5b10"
format_stamp: "Formatted at 2026-08-08 14:45:14 on dist-test-slave-42z9"
server_key: "730b7f22d3be7506c1ac9e19a73a3075"
server_key_iv: "79ed83fcaf737d346373be7d2ea022b7"
server_key_version: "encryptionkey@0"
I20260808 14:45:14.070111 3686 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:45:14.088588 3686 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:45:14.090337 3686 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:45:14.090477 3686 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:45:14.094341 3686 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.190:44185
I20260808 14:45:14.094408 3785 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.190:44185 every 8 connection(s)
I20260808 14:45:14.094738 3686 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
I20260808 14:45:14.095603 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 3686
I20260808 14:45:14.095706 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/minicluster-data/master-0/wal/instance
I20260808 14:45:14.095870 31578 external_mini_cluster.cc:1428] Setting key 59215508f9945f2ceb86b4338d101a5f
I20260808 14:45:14.095932 3786 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:45:14.099375 3786 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 983e15645eaf4c3cbc34f1eacd7f5b10: Bootstrap starting.
I20260808 14:45:14.100107 3786 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 983e15645eaf4c3cbc34f1eacd7f5b10: Neither blocks nor log segments found. Creating new log.
I20260808 14:45:14.100383 3786 log.cc:824] T 00000000000000000000000000000000 P 983e15645eaf4c3cbc34f1eacd7f5b10: Log is configured to *not* fsync() on all Append() calls
I20260808 14:45:14.101065 3786 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 983e15645eaf4c3cbc34f1eacd7f5b10: No bootstrap required, opened a new log
Aug 08 14:45:14 dist-test-slave-42z9 krb5kdc[3666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200313, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:45:14.103253 3786 raft_consensus.cc:348] T 00000000000000000000000000000000 P 983e15645eaf4c3cbc34f1eacd7f5b10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "983e15645eaf4c3cbc34f1eacd7f5b10" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 44185 } }
I20260808 14:45:14.103415 3786 raft_consensus.cc:374] T 00000000000000000000000000000000 P 983e15645eaf4c3cbc34f1eacd7f5b10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:45:14.103441 3786 raft_consensus.cc:729] T 00000000000000000000000000000000 P 983e15645eaf4c3cbc34f1eacd7f5b10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 983e15645eaf4c3cbc34f1eacd7f5b10, State: Initialized, Role: FOLLOWER
I20260808 14:45:14.103567 3786 consensus_queue.cc:260] T 00000000000000000000000000000000 P 983e15645eaf4c3cbc34f1eacd7f5b10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "983e15645eaf4c3cbc34f1eacd7f5b10" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 44185 } }
I20260808 14:45:14.103662 3786 raft_consensus.cc:388] T 00000000000000000000000000000000 P 983e15645eaf4c3cbc34f1eacd7f5b10 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:45:14.103703 3786 raft_consensus.cc:482] T 00000000000000000000000000000000 P 983e15645eaf4c3cbc34f1eacd7f5b10 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:45:14.103753 3786 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 983e15645eaf4c3cbc34f1eacd7f5b10 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:14.104461 3786 raft_consensus.cc:504] T 00000000000000000000000000000000 P 983e15645eaf4c3cbc34f1eacd7f5b10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "983e15645eaf4c3cbc34f1eacd7f5b10" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 44185 } }
I20260808 14:45:14.104584 3786 leader_election.cc:302] T 00000000000000000000000000000000 P 983e15645eaf4c3cbc34f1eacd7f5b10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 983e15645eaf4c3cbc34f1eacd7f5b10; no voters:
I20260808 14:45:14.104768 3786 leader_election.cc:288] T 00000000000000000000000000000000 P 983e15645eaf4c3cbc34f1eacd7f5b10 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:45:14.104841 3794 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 983e15645eaf4c3cbc34f1eacd7f5b10 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:45:14.105041 3786 sys_catalog.cc:564] T 00000000000000000000000000000000 P 983e15645eaf4c3cbc34f1eacd7f5b10 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:45:14.105044 3794 raft_consensus.cc:686] T 00000000000000000000000000000000 P 983e15645eaf4c3cbc34f1eacd7f5b10 [term 1 LEADER]: Becoming Leader. State: Replica: 983e15645eaf4c3cbc34f1eacd7f5b10, State: Running, Role: LEADER
I20260808 14:45:14.105496 3794 consensus_queue.cc:237] T 00000000000000000000000000000000 P 983e15645eaf4c3cbc34f1eacd7f5b10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "983e15645eaf4c3cbc34f1eacd7f5b10" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 44185 } }
I20260808 14:45:14.105928 3797 sys_catalog.cc:455] T 00000000000000000000000000000000 P 983e15645eaf4c3cbc34f1eacd7f5b10 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 983e15645eaf4c3cbc34f1eacd7f5b10. Latest consensus state: current_term: 1 leader_uuid: "983e15645eaf4c3cbc34f1eacd7f5b10" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "983e15645eaf4c3cbc34f1eacd7f5b10" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 44185 } } }
I20260808 14:45:14.106010 3797 sys_catalog.cc:458] T 00000000000000000000000000000000 P 983e15645eaf4c3cbc34f1eacd7f5b10 [sys.catalog]: This master's current role is: LEADER
I20260808 14:45:14.106092 3796 sys_catalog.cc:455] T 00000000000000000000000000000000 P 983e15645eaf4c3cbc34f1eacd7f5b10 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "983e15645eaf4c3cbc34f1eacd7f5b10" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "983e15645eaf4c3cbc34f1eacd7f5b10" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 44185 } } }
I20260808 14:45:14.106140 3796 sys_catalog.cc:458] T 00000000000000000000000000000000 P 983e15645eaf4c3cbc34f1eacd7f5b10 [sys.catalog]: This master's current role is: LEADER
W20260808 14:45:14.107061 3812 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 983e15645eaf4c3cbc34f1eacd7f5b10: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260808 14:45:14.107090 3791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:14.096366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44782 (local address 127.30.214.190:44185)
0808 14:45:14.096523 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:14.096530 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:14.096554 (+ 24us) server_negotiation.cc:407] Connection header received
0808 14:45:14.097043 (+ 489us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:14.097049 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:14.097097 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:14.097205 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:14.098015 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:14.098906 (+ 891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:14.099964 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:14.100373 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:14.100456 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:14.103000 (+ 2544us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:14.103005 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:14.103006 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:14.103018 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:14.104968 (+ 1950us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:14.105387 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:14.105390 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:14.105391 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:14.105538 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:14.105791 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:14.105792 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:14.105792 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:14.106126 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:14.106731 (+ 605us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:14.106798 (+ 67us) server_negotiation.cc:299] Negotiation successful
0808 14:45:14.106934 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":66,"threads_started":1}
W20260808 14:45:14.107126 3812 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:45:14.107169 3806 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:45:14.107319 3806 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:45:14.108881 3806 catalog_manager.cc:1347] Generated new cluster ID: f02b0b1c48ca47029f5dadc3361b723c
I20260808 14:45:14.108929 3806 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:45:14.112771 3806 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:45:14.113277 3806 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:45:14.116500 3806 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 983e15645eaf4c3cbc34f1eacd7f5b10: Generated new TSK 0
I20260808 14:45:14.116667 3806 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.214.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab.
Entry for principal kudu/127.30.214.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab.
I20260808 14:45:14.146453 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.129:0
--local_ip_for_outbound_sockets=127.30.214.129
--webserver_interface=127.30.214.129
--webserver_port=0
--tserver_master_addrs=127.30.214.190:44185
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab
--principal=kudu/127.30.214.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:38257
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:45:14.229655 3826 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:45:14.229874 3826 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:45:14.229910 3826 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:45:14.231112 3826 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:45:14.231156 3826 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:45:14.231192 3826 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.129
I20260808 14:45:14.232679 3826 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:38257
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab
--principal=kudu/127.30.214.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.214.129
--webserver_port=0
--tserver_master_addrs=127.30.214.190:44185
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3826
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.129
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:45:14.232915 3826 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:45:14.233130 3826 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:45:14.238255 3838 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:14.238286 3826 server_base.cc:1034] running on GCE node
W20260808 14:45:14.238260 3831 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:14.238271 3836 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:14.238663 3826 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:45:14.238878 3826 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:45:14.240026 3826 hybrid_clock.cc:648] HybridClock initialized: now 1786200314240015 us; error 30 us; skew 500 ppm
Aug 08 14:45:14 dist-test-slave-42z9 krb5kdc[3666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200314, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:45:14.242533 3826 init.cc:377] Logged in from keytab as kudu/127.30.214.129@KRBTEST.COM (short username kudu)
I20260808 14:45:14.242982 3826 webserver.cc:460] Webserver started at http://127.30.214.129:35313/ using document root <none> and password file <none>
I20260808 14:45:14.243198 3826 fs_manager.cc:359] Metadata directory not provided
I20260808 14:45:14.243249 3826 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:45:14.243376 3826 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:45:14.244446 3826 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-0/data/instance:
uuid: "108debcc8a134e339bd2b05a6645afe2"
format_stamp: "Formatted at 2026-08-08 14:45:14 on dist-test-slave-42z9"
server_key: "8c0bc91c12fc1890e90aea007d02d504"
server_key_iv: "17874c616ccf77aa28a3927a86f254e4"
server_key_version: "encryptionkey@0"
I20260808 14:45:14.244794 3826 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-0/wal/instance:
uuid: "108debcc8a134e339bd2b05a6645afe2"
format_stamp: "Formatted at 2026-08-08 14:45:14 on dist-test-slave-42z9"
server_key: "8c0bc91c12fc1890e90aea007d02d504"
server_key_iv: "17874c616ccf77aa28a3927a86f254e4"
server_key_version: "encryptionkey@0"
I20260808 14:45:14.246146 3826 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 14:45:14.246925 3848 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:14.247112 3826 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:45:14.247206 3826 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-0/wal
uuid: "108debcc8a134e339bd2b05a6645afe2"
format_stamp: "Formatted at 2026-08-08 14:45:14 on dist-test-slave-42z9"
server_key: "8c0bc91c12fc1890e90aea007d02d504"
server_key_iv: "17874c616ccf77aa28a3927a86f254e4"
server_key_version: "encryptionkey@0"
I20260808 14:45:14.247269 3826 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:45:14.272231 3826 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:45:14.274307 3826 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:45:14.274471 3826 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:45:14.274703 3826 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:45:14.275017 3826 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:45:14.275053 3826 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:14.275084 3826 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:45:14.275107 3826 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:14.280639 3826 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.129:42225
I20260808 14:45:14.280691 4031 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.129:42225 every 8 connection(s)
I20260808 14:45:14.281013 3826 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
I20260808 14:45:14.282564 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 3826
I20260808 14:45:14.282666 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-0/wal/instance
I20260808 14:45:14.282825 31578 external_mini_cluster.cc:1428] Setting key a621e33638d632bac320c02a5728ff2e
Aug 08 14:45:14 dist-test-slave-42z9 krb5kdc[3666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200314, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.129@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:45:14.291741 3791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:14.281780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.129:55055 (local address 127.30.214.190:44185)
0808 14:45:14.281840 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:14.281842 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:14.282044 (+ 202us) server_negotiation.cc:407] Connection header received
0808 14:45:14.282582 (+ 538us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:14.282584 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:14.282597 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:14.282649 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:14.283683 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:14.284187 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:14.285291 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:14.285557 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:14.285615 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:14.288064 (+ 2449us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:14.288066 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:14.288066 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:14.288074 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:14.290083 (+ 2009us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:14.290612 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:14.290612 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:14.290613 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:14.290665 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:14.291042 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:14.291044 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:14.291044 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:14.291189 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:14.291254 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:14.291587 (+ 333us) server_negotiation.cc:299] Negotiation successful
0808 14:45:14.291669 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 14:45:14.292022 4041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:14.281753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:44185 (local address 127.30.214.129:55055)
0808 14:45:14.281913 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:14.281952 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:14.282476 (+ 524us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:14.282720 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:14.282724 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:14.283354 (+ 630us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:14.283592 (+ 238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:14.283598 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:14.284279 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:14.284279 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:14.285193 (+ 914us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:14.285197 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:14.285650 (+ 453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:14.285651 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:14.285796 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:14.286322 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:14.286332 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:14.287958 (+ 1626us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:14.290197 (+ 2239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:14.290206 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:14.290208 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:14.290529 (+ 321us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:14.290724 (+ 195us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:14.290725 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:14.290725 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:14.290870 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:14.291264 (+ 394us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:14.291271 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:14.291448 (+ 177us) client_negotiation.cc:769] Sending connection context
0808 14:45:14.291571 (+ 123us) client_negotiation.cc:240] Negotiation successful
0808 14:45:14.291759 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":72,"threads_started":1}
WARNING: no policy specified for kudu/127.30.214.130@KRBTEST.COM; defaulting to no policy
I20260808 14:45:14.292591 4034 heartbeater.cc:347] Connected to a master server at 127.30.214.190:44185
I20260808 14:45:14.292681 4034 heartbeater.cc:464] Registering TS with master...
I20260808 14:45:14.292837 4034 heartbeater.cc:511] Master 127.30.214.190:44185 requested a full tablet report, sending...
I20260808 14:45:14.293351 3730 ts_manager.cc:194] Registered new tserver with Master: 108debcc8a134e339bd2b05a6645afe2 (127.30.214.129:42225)
I20260808 14:45:14.294018 3730 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.214.129@KRBTEST.COM'} at 127.30.214.129:55055
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab.
Entry for principal kudu/127.30.214.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab.
I20260808 14:45:14.309686 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.130:0
--local_ip_for_outbound_sockets=127.30.214.130
--webserver_interface=127.30.214.130
--webserver_port=0
--tserver_master_addrs=127.30.214.190:44185
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab
--principal=kudu/127.30.214.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:38257
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:45:14.391732 4046 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:45:14.391963 4046 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:45:14.391988 4046 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:45:14.393136 4046 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:45:14.393174 4046 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:45:14.393199 4046 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.130
I20260808 14:45:14.394680 4046 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:38257
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab
--principal=kudu/127.30.214.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.214.130
--webserver_port=0
--tserver_master_addrs=127.30.214.190:44185
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4046
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.130
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:45:14.394881 4046 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:45:14.395081 4046 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:45:14.400105 4052 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:14.400151 4053 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:14.400105 4055 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:14.400137 4046 server_base.cc:1034] running on GCE node
I20260808 14:45:14.400533 4046 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:45:14.400767 4046 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:45:14.401902 4046 hybrid_clock.cc:648] HybridClock initialized: now 1786200314401890 us; error 30 us; skew 500 ppm
Aug 08 14:45:14 dist-test-slave-42z9 krb5kdc[3666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200314, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:45:14.404244 4046 init.cc:377] Logged in from keytab as kudu/127.30.214.130@KRBTEST.COM (short username kudu)
I20260808 14:45:14.404690 4046 webserver.cc:460] Webserver started at http://127.30.214.130:41721/ using document root <none> and password file <none>
I20260808 14:45:14.404891 4046 fs_manager.cc:359] Metadata directory not provided
I20260808 14:45:14.404937 4046 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:45:14.405061 4046 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:45:14.406208 4046 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-1/data/instance:
uuid: "1194b5bff6984153ac9d2587bd9edc7e"
format_stamp: "Formatted at 2026-08-08 14:45:14 on dist-test-slave-42z9"
server_key: "fe4fb9f2e500029db90359e86ed33a9e"
server_key_iv: "a0580ebbcb89343061a2bf1299ed1b22"
server_key_version: "encryptionkey@0"
I20260808 14:45:14.406564 4046 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-1/wal/instance:
uuid: "1194b5bff6984153ac9d2587bd9edc7e"
format_stamp: "Formatted at 2026-08-08 14:45:14 on dist-test-slave-42z9"
server_key: "fe4fb9f2e500029db90359e86ed33a9e"
server_key_iv: "a0580ebbcb89343061a2bf1299ed1b22"
server_key_version: "encryptionkey@0"
I20260808 14:45:14.407824 4046 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 14:45:14.408481 4065 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:14.408645 4046 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:45:14.408730 4046 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-1/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-1/wal
uuid: "1194b5bff6984153ac9d2587bd9edc7e"
format_stamp: "Formatted at 2026-08-08 14:45:14 on dist-test-slave-42z9"
server_key: "fe4fb9f2e500029db90359e86ed33a9e"
server_key_iv: "a0580ebbcb89343061a2bf1299ed1b22"
server_key_version: "encryptionkey@0"
I20260808 14:45:14.408800 4046 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:45:14.428555 4046 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:45:14.430418 4046 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:45:14.430570 4046 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:45:14.430794 4046 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:45:14.431105 4046 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:45:14.431140 4046 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:14.431171 4046 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:45:14.431195 4046 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:14.437886 4046 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.130:45211
I20260808 14:45:14.437950 4234 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.130:45211 every 8 connection(s)
I20260808 14:45:14.438247 4046 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
Aug 08 14:45:14 dist-test-slave-42z9 krb5kdc[3666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200314, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.130@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:45:14.445292 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 4046
I20260808 14:45:14.445398 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-1/wal/instance
I20260808 14:45:14.445626 31578 external_mini_cluster.cc:1428] Setting key d46593d8cf2a28b7932973c244f910b4
I20260808 14:45:14.447230 3791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:14.438952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.130:47585 (local address 127.30.214.190:44185)
0808 14:45:14.438998 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:14.439000 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:14.439234 (+ 234us) server_negotiation.cc:407] Connection header received
0808 14:45:14.439772 (+ 538us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:14.439773 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:14.439786 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:14.439838 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:14.440788 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:14.441289 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:14.442295 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:14.442483 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:14.442548 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:14.444637 (+ 2089us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:14.444639 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:14.444639 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:14.444647 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:14.445952 (+ 1305us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:14.446320 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:14.446321 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:14.446322 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:14.446382 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:14.446636 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:14.446637 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:14.446637 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:14.446738 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:14.446784 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:14.447093 (+ 309us) server_negotiation.cc:299] Negotiation successful
0808 14:45:14.447165 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 14:45:14.447467 4241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:14.438936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:44185 (local address 127.30.214.130:47585)
0808 14:45:14.439110 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:14.439154 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:14.439673 (+ 519us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:14.439907 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:14.439911 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:14.440496 (+ 585us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:14.440695 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:14.440699 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:14.441371 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:14.441372 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:14.442214 (+ 842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:14.442217 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:14.442556 (+ 339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:14.442557 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:14.442688 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:14.443152 (+ 464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:14.443161 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:14.444546 (+ 1385us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:14.446033 (+ 1487us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:14.446041 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:14.446043 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:14.446260 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:14.446438 (+ 178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:14.446439 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:14.446439 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:14.446578 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:14.446787 (+ 209us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:14.446793 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:14.446957 (+ 164us) client_negotiation.cc:769] Sending connection context
0808 14:45:14.447073 (+ 116us) client_negotiation.cc:240] Negotiation successful
0808 14:45:14.447243 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":91,"threads_started":1}
I20260808 14:45:14.447885 4235 heartbeater.cc:347] Connected to a master server at 127.30.214.190:44185
I20260808 14:45:14.447983 4235 heartbeater.cc:464] Registering TS with master...
I20260808 14:45:14.448196 4235 heartbeater.cc:511] Master 127.30.214.190:44185 requested a full tablet report, sending...
I20260808 14:45:14.448618 3730 ts_manager.cc:194] Registered new tserver with Master: 1194b5bff6984153ac9d2587bd9edc7e (127.30.214.130:45211)
I20260808 14:45:14.448987 3730 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.214.130@KRBTEST.COM'} at 127.30.214.130:47585
WARNING: no policy specified for kudu/127.30.214.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab.
Entry for principal kudu/127.30.214.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab.
I20260808 14:45:14.472131 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.131:0
--local_ip_for_outbound_sockets=127.30.214.131
--webserver_interface=127.30.214.131
--webserver_port=0
--tserver_master_addrs=127.30.214.190:44185
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab
--principal=kudu/127.30.214.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:38257
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:45:14.554112 4246 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:45:14.554329 4246 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:45:14.554353 4246 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:45:14.555517 4246 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:45:14.555564 4246 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:45:14.555591 4246 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.131
I20260808 14:45:14.557101 4246 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:38257
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab
--principal=kudu/127.30.214.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.214.131
--webserver_port=0
--tserver_master_addrs=127.30.214.190:44185
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4246
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.131
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:45:14.557348 4246 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:45:14.557592 4246 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:45:14.562505 4253 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:14.562539 4254 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:14.562559 4256 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:14.562695 4246 server_base.cc:1034] running on GCE node
I20260808 14:45:14.562906 4246 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:45:14.563156 4246 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:45:14.564307 4246 hybrid_clock.cc:648] HybridClock initialized: now 1786200314564288 us; error 36 us; skew 500 ppm
Aug 08 14:45:14 dist-test-slave-42z9 krb5kdc[3666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200314, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:45:14.566803 4246 init.cc:377] Logged in from keytab as kudu/127.30.214.131@KRBTEST.COM (short username kudu)
I20260808 14:45:14.567255 4246 webserver.cc:460] Webserver started at http://127.30.214.131:38023/ using document root <none> and password file <none>
I20260808 14:45:14.567526 4246 fs_manager.cc:359] Metadata directory not provided
I20260808 14:45:14.567579 4246 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:45:14.567708 4246 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:45:14.568742 4246 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-2/data/instance:
uuid: "db0b451b580b48be9e8015a6c64271d6"
format_stamp: "Formatted at 2026-08-08 14:45:14 on dist-test-slave-42z9"
server_key: "55fbb0f90f5b0f9b538157122db93d53"
server_key_iv: "48046b37d9d3f00ddf33f07d63a54599"
server_key_version: "encryptionkey@0"
I20260808 14:45:14.569073 4246 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-2/wal/instance:
uuid: "db0b451b580b48be9e8015a6c64271d6"
format_stamp: "Formatted at 2026-08-08 14:45:14 on dist-test-slave-42z9"
server_key: "55fbb0f90f5b0f9b538157122db93d53"
server_key_iv: "48046b37d9d3f00ddf33f07d63a54599"
server_key_version: "encryptionkey@0"
I20260808 14:45:14.570372 4246 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 14:45:14.571046 4267 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:14.571199 4246 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:14.571282 4246 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-2/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-2/wal
uuid: "db0b451b580b48be9e8015a6c64271d6"
format_stamp: "Formatted at 2026-08-08 14:45:14 on dist-test-slave-42z9"
server_key: "55fbb0f90f5b0f9b538157122db93d53"
server_key_iv: "48046b37d9d3f00ddf33f07d63a54599"
server_key_version: "encryptionkey@0"
I20260808 14:45:14.571342 4246 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:45:14.588531 4246 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:45:14.590327 4246 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:45:14.590481 4246 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:45:14.590698 4246 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:45:14.590989 4246 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:45:14.591022 4246 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:14.591051 4246 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:45:14.591076 4246 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:14.596827 4246 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.131:37277
I20260808 14:45:14.596889 4438 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.131:37277 every 8 connection(s)
I20260808 14:45:14.597193 4246 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
I20260808 14:45:14.597949 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 4246
I20260808 14:45:14.598052 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786200295877777-31578-0/minicluster-data/ts-2/wal/instance
I20260808 14:45:14.598253 31578 external_mini_cluster.cc:1428] Setting key 7fd19ad3257125b179ab7d3807931779
Aug 08 14:45:14 dist-test-slave-42z9 krb5kdc[3666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200314, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.131@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:45:14.606328 3791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:14.597920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:52115 (local address 127.30.214.190:44185)
0808 14:45:14.597987 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:14.597989 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:14.598249 (+ 260us) server_negotiation.cc:407] Connection header received
0808 14:45:14.598857 (+ 608us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:14.598859 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:14.598871 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:14.598914 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:14.599957 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:14.600462 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:14.601464 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:14.601658 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:14.601715 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:14.603781 (+ 2066us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:14.603783 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:14.603783 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:14.603792 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:14.604916 (+ 1124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:14.605311 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:14.605313 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:14.605313 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:14.605376 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:14.605636 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:14.605637 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:14.605637 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:14.605787 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:14.605852 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:14.606122 (+ 270us) server_negotiation.cc:299] Negotiation successful
0808 14:45:14.606234 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 14:45:14.606501 4441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:14.597888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:44185 (local address 127.30.214.131:52115)
0808 14:45:14.598114 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:14.598166 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:14.598762 (+ 596us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:14.598988 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:14.598993 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:14.599652 (+ 659us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:14.599859 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:14.599864 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:14.600549 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:14.600550 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:14.601357 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:14.601360 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:14.601731 (+ 371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:14.601732 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:14.601883 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:14.602349 (+ 466us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:14.602358 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:14.603690 (+ 1332us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:14.604988 (+ 1298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:14.604997 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:14.604999 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:14.605218 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:14.605430 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:14.605431 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:14.605431 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:14.605573 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:14.605840 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:14.605856 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:14.605999 (+ 143us) client_negotiation.cc:769] Sending connection context
0808 14:45:14.606089 (+ 90us) client_negotiation.cc:240] Negotiation successful
0808 14:45:14.606274 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":100,"threads_started":1}
I20260808 14:45:14.607656 4439 heartbeater.cc:347] Connected to a master server at 127.30.214.190:44185
I20260808 14:45:14.607753 4439 heartbeater.cc:464] Registering TS with master...
I20260808 14:45:14.607914 4439 heartbeater.cc:511] Master 127.30.214.190:44185 requested a full tablet report, sending...
I20260808 14:45:14.608258 3730 ts_manager.cc:194] Registered new tserver with Master: db0b451b580b48be9e8015a6c64271d6 (127.30.214.131:37277)
I20260808 14:45:14.608624 3730 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.214.131@KRBTEST.COM'} at 127.30.214.131:52115
I20260808 14:45:14.610000 31578 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 14:45:14 dist-test-slave-42z9 krb5kdc[3666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200314, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 08 14:45:14 dist-test-slave-42z9 krb5kdc[3666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200314, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:45:14.633157 3791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:14.626122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44788 (local address 127.30.214.190:44185)
0808 14:45:14.626188 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:14.626191 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:14.626265 (+ 74us) server_negotiation.cc:407] Connection header received
0808 14:45:14.626320 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:14.626320 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:14.626330 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:14.626380 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:14.627116 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:14.627608 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:14.628368 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:14.628561 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:14.628623 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:14.630921 (+ 2298us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:14.630922 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:14.630923 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:14.630930 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:14.632048 (+ 1118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:14.632386 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:14.632387 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:14.632387 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:14.632439 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:14.632607 (+ 168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:14.632608 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:14.632608 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:14.632774 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:14.632865 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:14.632981 (+ 116us) server_negotiation.cc:299] Negotiation successful
0808 14:45:14.633060 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
W20260808 14:45:14.633404 3730 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:44788
I20260808 14:45:14.633931 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 3826
I20260808 14:45:14.647706 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 4046
I20260808 14:45:14.654850 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 4246
I20260808 14:45:14.691577 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 3686
2026-08-08T14:45:14Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (1992 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:45:14 dist-test-slave-42z9 krb5kdc[4456](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:45:14 dist-test-slave-42z9 krb5kdc[4456](info): set up 2 sockets
Aug 08 14:45:14 dist-test-slave-42z9 krb5kdc[4456](info): commencing operation
krb5kdc: starting...
W20260808 14:45:15.827193 31578 mini_kdc.cc:121] Time spent starting KDC: real 1.113s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Aug 08 14:45:15 dist-test-slave-42z9 krb5kdc[4456](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200315, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:45:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:45:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.214.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab.
Entry for principal kudu/127.30.214.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab.
I20260808 14:45:15.946374 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:37821
--webserver_interface=127.30.214.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab
--principal=kudu/127.30.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:36641
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.214.190:37821
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:45:16.026284 4479 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:45:16.026499 4479 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:45:16.026520 4479 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:45:16.027653 4479 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:45:16.027694 4479 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:45:16.027706 4479 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:45:16.027719 4479 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:45:16.027729 4479 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:45:16.029239 4479 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:36641
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.214.190:37821
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab
--principal=kudu/127.30.214.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:37821
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4479
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:45:16.029520 4479 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:45:16.029738 4479 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:45:16.034616 4491 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:16.034608 4485 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:16.034777 4479 server_base.cc:1034] running on GCE node
W20260808 14:45:16.034622 4486 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:16.035055 4479 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:45:16.035352 4479 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:45:16.036521 4479 hybrid_clock.cc:648] HybridClock initialized: now 1786200316036498 us; error 33 us; skew 500 ppm
Aug 08 14:45:16 dist-test-slave-42z9 krb5kdc[4456](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200316, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:45:16.038996 4479 init.cc:377] Logged in from keytab as kudu/127.30.214.190@KRBTEST.COM (short username kudu)
I20260808 14:45:16.039479 4479 webserver.cc:460] Webserver started at http://127.30.214.190:38079/ using document root <none> and password file <none>
I20260808 14:45:16.039695 4479 fs_manager.cc:359] Metadata directory not provided
I20260808 14:45:16.039743 4479 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:45:16.039871 4479 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:45:16.040915 4479 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/minicluster-data/master-0/data/instance:
uuid: "5f7d7acd3f654d14a53417b97ad77c25"
format_stamp: "Formatted at 2026-08-08 14:45:16 on dist-test-slave-42z9"
server_key: "a7507c6e2158a78daa1160307d51fdf2"
server_key_iv: "e2e6614940899a3a97b8a5454c5c16c2"
server_key_version: "encryptionkey@0"
I20260808 14:45:16.041255 4479 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/minicluster-data/master-0/wal/instance:
uuid: "5f7d7acd3f654d14a53417b97ad77c25"
format_stamp: "Formatted at 2026-08-08 14:45:16 on dist-test-slave-42z9"
server_key: "a7507c6e2158a78daa1160307d51fdf2"
server_key_iv: "e2e6614940899a3a97b8a5454c5c16c2"
server_key_version: "encryptionkey@0"
I20260808 14:45:16.042557 4479 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:45:16.043231 4499 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:16.043385 4479 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:45:16.043478 4479 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/minicluster-data/master-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/minicluster-data/master-0/wal
uuid: "5f7d7acd3f654d14a53417b97ad77c25"
format_stamp: "Formatted at 2026-08-08 14:45:16 on dist-test-slave-42z9"
server_key: "a7507c6e2158a78daa1160307d51fdf2"
server_key_iv: "e2e6614940899a3a97b8a5454c5c16c2"
server_key_version: "encryptionkey@0"
I20260808 14:45:16.043543 4479 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:45:16.058632 4479 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:45:16.060767 4479 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:45:16.060922 4479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:45:16.065092 4479 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.190:37821
I20260808 14:45:16.065143 4569 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.190:37821 every 8 connection(s)
I20260808 14:45:16.065691 4479 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
I20260808 14:45:16.066359 4570 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:45:16.068652 4570 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f7d7acd3f654d14a53417b97ad77c25: Bootstrap starting.
I20260808 14:45:16.069252 4570 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5f7d7acd3f654d14a53417b97ad77c25: Neither blocks nor log segments found. Creating new log.
I20260808 14:45:16.069556 4570 log.cc:824] T 00000000000000000000000000000000 P 5f7d7acd3f654d14a53417b97ad77c25: Log is configured to *not* fsync() on all Append() calls
I20260808 14:45:16.070314 4570 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f7d7acd3f654d14a53417b97ad77c25: No bootstrap required, opened a new log
I20260808 14:45:16.071274 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 4479
I20260808 14:45:16.071382 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/minicluster-data/master-0/wal/instance
I20260808 14:45:16.071565 31578 external_mini_cluster.cc:1428] Setting key 8d7a56440b728da7803b4a1a577bd7d8
I20260808 14:45:16.072736 4570 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5f7d7acd3f654d14a53417b97ad77c25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f7d7acd3f654d14a53417b97ad77c25" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 37821 } }
I20260808 14:45:16.072872 4570 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5f7d7acd3f654d14a53417b97ad77c25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:45:16.072914 4570 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5f7d7acd3f654d14a53417b97ad77c25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f7d7acd3f654d14a53417b97ad77c25, State: Initialized, Role: FOLLOWER
I20260808 14:45:16.073055 4570 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5f7d7acd3f654d14a53417b97ad77c25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f7d7acd3f654d14a53417b97ad77c25" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 37821 } }
I20260808 14:45:16.073122 4570 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5f7d7acd3f654d14a53417b97ad77c25 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:45:16.073153 4570 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5f7d7acd3f654d14a53417b97ad77c25 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:45:16.073200 4570 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5f7d7acd3f654d14a53417b97ad77c25 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:16.073809 4570 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5f7d7acd3f654d14a53417b97ad77c25 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f7d7acd3f654d14a53417b97ad77c25" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 37821 } }
I20260808 14:45:16.073918 4570 leader_election.cc:302] T 00000000000000000000000000000000 P 5f7d7acd3f654d14a53417b97ad77c25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5f7d7acd3f654d14a53417b97ad77c25; no voters:
I20260808 14:45:16.074077 4570 leader_election.cc:288] T 00000000000000000000000000000000 P 5f7d7acd3f654d14a53417b97ad77c25 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:45:16.074120 4577 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5f7d7acd3f654d14a53417b97ad77c25 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:45:16.074276 4577 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5f7d7acd3f654d14a53417b97ad77c25 [term 1 LEADER]: Becoming Leader. State: Replica: 5f7d7acd3f654d14a53417b97ad77c25, State: Running, Role: LEADER
I20260808 14:45:16.074353 4570 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5f7d7acd3f654d14a53417b97ad77c25 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:45:16.074422 4577 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5f7d7acd3f654d14a53417b97ad77c25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f7d7acd3f654d14a53417b97ad77c25" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 37821 } }
I20260808 14:45:16.074772 4577 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f7d7acd3f654d14a53417b97ad77c25 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5f7d7acd3f654d14a53417b97ad77c25. Latest consensus state: current_term: 1 leader_uuid: "5f7d7acd3f654d14a53417b97ad77c25" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f7d7acd3f654d14a53417b97ad77c25" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 37821 } } }
I20260808 14:45:16.074838 4578 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f7d7acd3f654d14a53417b97ad77c25 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5f7d7acd3f654d14a53417b97ad77c25" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f7d7acd3f654d14a53417b97ad77c25" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 37821 } } }
I20260808 14:45:16.075100 4578 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f7d7acd3f654d14a53417b97ad77c25 [sys.catalog]: This master's current role is: LEADER
I20260808 14:45:16.074851 4577 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f7d7acd3f654d14a53417b97ad77c25 [sys.catalog]: This master's current role is: LEADER
I20260808 14:45:16.075342 4590 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:45:16.075910 4590 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 08 14:45:16 dist-test-slave-42z9 krb5kdc[4456](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200315, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:45:16.082783 4590 catalog_manager.cc:1347] Generated new cluster ID: 83a04cc9891143339aa60cdf5c00ea2c
I20260808 14:45:16.082823 4576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:16.072119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57796 (local address 127.30.214.190:37821)
0808 14:45:16.072318 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:16.072327 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:16.072354 (+ 27us) server_negotiation.cc:407] Connection header received
0808 14:45:16.072710 (+ 356us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:16.072716 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:16.072760 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:16.072881 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:16.073631 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:16.074857 (+ 1226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:16.075906 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:16.076492 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:16.076601 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:16.079090 (+ 2489us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:16.079095 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:16.079095 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:16.079108 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:16.081030 (+ 1922us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:16.081388 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:16.081398 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:16.081399 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:16.081543 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:16.081800 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:16.081801 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:16.081801 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:16.082158 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:16.082301 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:16.082467 (+ 166us) server_negotiation.cc:299] Negotiation successful
0808 14:45:16.082618 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":94,"threads_started":1}
I20260808 14:45:16.082844 4590 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:45:16.098769 4590 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:45:16.099319 4590 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:45:16.104545 4590 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5f7d7acd3f654d14a53417b97ad77c25: Generated new TSK 0
I20260808 14:45:16.104722 4590 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.214.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab.
Entry for principal kudu/127.30.214.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab.
I20260808 14:45:16.139802 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.129:0
--local_ip_for_outbound_sockets=127.30.214.129
--webserver_interface=127.30.214.129
--webserver_port=0
--tserver_master_addrs=127.30.214.190:37821
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab
--principal=kudu/127.30.214.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:36641
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:45:16.240317 4608 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:45:16.240528 4608 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:45:16.240551 4608 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:45:16.241757 4608 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:45:16.241802 4608 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:45:16.241830 4608 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.129
I20260808 14:45:16.243391 4608 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:36641
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab
--principal=kudu/127.30.214.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.214.129
--webserver_port=0
--tserver_master_addrs=127.30.214.190:37821
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4608
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.129
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:45:16.243614 4608 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:45:16.243836 4608 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:45:16.248992 4614 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:16.249109 4608 server_base.cc:1034] running on GCE node
W20260808 14:45:16.248975 4617 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:16.249185 4615 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:16.249418 4608 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:45:16.249708 4608 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:45:16.250854 4608 hybrid_clock.cc:648] HybridClock initialized: now 1786200316250840 us; error 30 us; skew 500 ppm
Aug 08 14:45:16 dist-test-slave-42z9 krb5kdc[4456](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200316, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:45:16.253360 4608 init.cc:377] Logged in from keytab as kudu/127.30.214.129@KRBTEST.COM (short username kudu)
I20260808 14:45:16.253810 4608 webserver.cc:460] Webserver started at http://127.30.214.129:38247/ using document root <none> and password file <none>
I20260808 14:45:16.254012 4608 fs_manager.cc:359] Metadata directory not provided
I20260808 14:45:16.254071 4608 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:45:16.254204 4608 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:45:16.255245 4608 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/minicluster-data/ts-0/data/instance:
uuid: "487e7c984f684bcc9d6695c31f1f6a2c"
format_stamp: "Formatted at 2026-08-08 14:45:16 on dist-test-slave-42z9"
server_key: "1dec77d9fbff44639940ba4051693673"
server_key_iv: "ff9b6e2ad14ef8f56ff779b2207e6e53"
server_key_version: "encryptionkey@0"
I20260808 14:45:16.255602 4608 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/minicluster-data/ts-0/wal/instance:
uuid: "487e7c984f684bcc9d6695c31f1f6a2c"
format_stamp: "Formatted at 2026-08-08 14:45:16 on dist-test-slave-42z9"
server_key: "1dec77d9fbff44639940ba4051693673"
server_key_iv: "ff9b6e2ad14ef8f56ff779b2207e6e53"
server_key_version: "encryptionkey@0"
I20260808 14:45:16.256878 4608 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 14:45:16.257604 4629 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:16.257754 4608 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:45:16.257841 4608 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/minicluster-data/ts-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/minicluster-data/ts-0/wal
uuid: "487e7c984f684bcc9d6695c31f1f6a2c"
format_stamp: "Formatted at 2026-08-08 14:45:16 on dist-test-slave-42z9"
server_key: "1dec77d9fbff44639940ba4051693673"
server_key_iv: "ff9b6e2ad14ef8f56ff779b2207e6e53"
server_key_version: "encryptionkey@0"
I20260808 14:45:16.257911 4608 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:45:16.269925 4608 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:45:16.272236 4608 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:45:16.272414 4608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:45:16.272640 4608 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:45:16.272960 4608 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:45:16.272994 4608 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:16.273023 4608 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:45:16.273041 4608 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:16.278723 4608 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.129:35035
I20260808 14:45:16.278770 4799 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.129:35035 every 8 connection(s)
I20260808 14:45:16.279084 4608 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
Aug 08 14:45:16 dist-test-slave-42z9 krb5kdc[4456](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200316, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.129@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:45:16.285943 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 4608
I20260808 14:45:16.286036 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/minicluster-data/ts-0/wal/instance
I20260808 14:45:16.286206 31578 external_mini_cluster.cc:1428] Setting key 37c65df3d1d56e49b36a906a7b431c59
I20260808 14:45:16.288226 4576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:16.279766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.129:40897 (local address 127.30.214.190:37821)
0808 14:45:16.279850 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:16.279852 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:16.280019 (+ 167us) server_negotiation.cc:407] Connection header received
0808 14:45:16.280928 (+ 909us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:16.280929 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:16.280943 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:16.280990 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:16.281607 (+ 617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:16.282113 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:16.283099 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:16.283313 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:16.283378 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:16.285557 (+ 2179us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:16.285559 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:16.285559 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:16.285570 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:16.287001 (+ 1431us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:16.287368 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:16.287369 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:16.287370 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:16.287435 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:16.287642 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:16.287643 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:16.287643 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:16.287767 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:16.287828 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:16.288049 (+ 221us) server_negotiation.cc:299] Negotiation successful
0808 14:45:16.288139 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 14:45:16.288316 4803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:16.279736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:37821 (local address 127.30.214.129:40897)
0808 14:45:16.279887 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:16.279923 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:16.280840 (+ 917us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:16.281055 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:16.281058 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:16.281312 (+ 254us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:16.281539 (+ 227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:16.281544 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:16.282195 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:16.282196 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:16.283005 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:16.283007 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:16.283428 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:16.283429 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:16.283549 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:16.284077 (+ 528us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:16.284086 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:16.285427 (+ 1341us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:16.287080 (+ 1653us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:16.287087 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:16.287089 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:16.287301 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:16.287498 (+ 197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:16.287499 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:16.287499 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:16.287592 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:16.287820 (+ 228us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:16.287823 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:16.287937 (+ 114us) client_negotiation.cc:769] Sending connection context
0808 14:45:16.288013 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 14:45:16.288138 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":82,"threads_started":1}
I20260808 14:45:16.288821 4800 heartbeater.cc:347] Connected to a master server at 127.30.214.190:37821
I20260808 14:45:16.288930 4800 heartbeater.cc:464] Registering TS with master...
I20260808 14:45:16.289124 4800 heartbeater.cc:511] Master 127.30.214.190:37821 requested a full tablet report, sending...
I20260808 14:45:16.289688 4523 ts_manager.cc:194] Registered new tserver with Master: 487e7c984f684bcc9d6695c31f1f6a2c (127.30.214.129:35035)
I20260808 14:45:16.290282 4523 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.214.129@KRBTEST.COM'} at 127.30.214.129:40897
WARNING: no policy specified for kudu/127.30.214.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab.
Entry for principal kudu/127.30.214.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab.
I20260808 14:45:16.312042 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.130:0
--local_ip_for_outbound_sockets=127.30.214.130
--webserver_interface=127.30.214.130
--webserver_port=0
--tserver_master_addrs=127.30.214.190:37821
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab
--principal=kudu/127.30.214.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:36641
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:45:16.394245 4808 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:45:16.394470 4808 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:45:16.394493 4808 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:45:16.395653 4808 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:45:16.395699 4808 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:45:16.395725 4808 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.130
I20260808 14:45:16.397306 4808 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:36641
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab
--principal=kudu/127.30.214.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.214.130
--webserver_port=0
--tserver_master_addrs=127.30.214.190:37821
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4808
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.130
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:45:16.397567 4808 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:45:16.397781 4808 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:45:16.402549 4823 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:16.402566 4814 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:16.402567 4817 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:16.402926 4808 server_base.cc:1034] running on GCE node
I20260808 14:45:16.403139 4808 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:45:16.403339 4808 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:45:16.404489 4808 hybrid_clock.cc:648] HybridClock initialized: now 1786200316404473 us; error 30 us; skew 500 ppm
Aug 08 14:45:16 dist-test-slave-42z9 krb5kdc[4456](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200316, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:45:16.407001 4808 init.cc:377] Logged in from keytab as kudu/127.30.214.130@KRBTEST.COM (short username kudu)
I20260808 14:45:16.407428 4808 webserver.cc:460] Webserver started at http://127.30.214.130:34209/ using document root <none> and password file <none>
I20260808 14:45:16.407649 4808 fs_manager.cc:359] Metadata directory not provided
I20260808 14:45:16.407699 4808 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:45:16.407828 4808 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:45:16.408857 4808 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/minicluster-data/ts-1/data/instance:
uuid: "74d251272b71494d9163d73d58841d0d"
format_stamp: "Formatted at 2026-08-08 14:45:16 on dist-test-slave-42z9"
server_key: "476fc10a6da094cfd9ad6e1c247c17f4"
server_key_iv: "a7062f9adad12b5dc698f8907da1b8a6"
server_key_version: "encryptionkey@0"
I20260808 14:45:16.409185 4808 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/minicluster-data/ts-1/wal/instance:
uuid: "74d251272b71494d9163d73d58841d0d"
format_stamp: "Formatted at 2026-08-08 14:45:16 on dist-test-slave-42z9"
server_key: "476fc10a6da094cfd9ad6e1c247c17f4"
server_key_iv: "a7062f9adad12b5dc698f8907da1b8a6"
server_key_version: "encryptionkey@0"
I20260808 14:45:16.410540 4808 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:45:16.411243 4837 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:16.411388 4808 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:45:16.411473 4808 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/minicluster-data/ts-1/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/minicluster-data/ts-1/wal
uuid: "74d251272b71494d9163d73d58841d0d"
format_stamp: "Formatted at 2026-08-08 14:45:16 on dist-test-slave-42z9"
server_key: "476fc10a6da094cfd9ad6e1c247c17f4"
server_key_iv: "a7062f9adad12b5dc698f8907da1b8a6"
server_key_version: "encryptionkey@0"
I20260808 14:45:16.411549 4808 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:45:16.419301 4808 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:45:16.421168 4808 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:45:16.421301 4808 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:45:16.421538 4808 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:45:16.421834 4808 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:45:16.421867 4808 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:16.421895 4808 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:45:16.421912 4808 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:16.427508 4808 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.130:39217
I20260808 14:45:16.427574 5009 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.130:39217 every 8 connection(s)
I20260808 14:45:16.427858 4808 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
Aug 08 14:45:16 dist-test-slave-42z9 krb5kdc[4456](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200316, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.130@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:45:16.436486 4576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:16.428530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.130:34491 (local address 127.30.214.190:37821)
0808 14:45:16.428594 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:16.428596 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:16.428778 (+ 182us) server_negotiation.cc:407] Connection header received
0808 14:45:16.429762 (+ 984us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:16.429763 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:16.429776 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:16.429828 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:16.430442 (+ 614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:16.430946 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:16.431911 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:16.432120 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:16.432177 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:16.434171 (+ 1994us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:16.434172 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:16.434172 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:16.434180 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:16.435241 (+ 1061us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:16.435612 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:16.435613 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:16.435613 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:16.435667 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:16.435877 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:16.435878 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:16.435878 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:16.435989 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:16.436056 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:16.436309 (+ 253us) server_negotiation.cc:299] Negotiation successful
0808 14:45:16.436396 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 14:45:16.436659 5012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:16.428496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:37821 (local address 127.30.214.130:34491)
0808 14:45:16.428668 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:16.428703 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:16.429651 (+ 948us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:16.429894 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:16.429898 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:16.430152 (+ 254us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:16.430344 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:16.430348 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:16.431038 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:16.431039 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:16.431818 (+ 779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:16.431821 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:16.432194 (+ 373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:16.432195 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:16.432311 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:16.432736 (+ 425us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:16.432744 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:16.434076 (+ 1332us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:16.435315 (+ 1239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:16.435322 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:16.435324 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:16.435543 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:16.435720 (+ 177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:16.435721 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:16.435721 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:16.435821 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:16.436053 (+ 232us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:16.436061 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:16.436192 (+ 131us) client_negotiation.cc:769] Sending connection context
0808 14:45:16.436280 (+ 88us) client_negotiation.cc:240] Negotiation successful
0808 14:45:16.436435 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":92,"threads_started":1}
I20260808 14:45:16.437076 5010 heartbeater.cc:347] Connected to a master server at 127.30.214.190:37821
I20260808 14:45:16.437176 5010 heartbeater.cc:464] Registering TS with master...
I20260808 14:45:16.437345 5010 heartbeater.cc:511] Master 127.30.214.190:37821 requested a full tablet report, sending...
I20260808 14:45:16.437573 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 4808
I20260808 14:45:16.437670 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/minicluster-data/ts-1/wal/instance
I20260808 14:45:16.437765 4523 ts_manager.cc:194] Registered new tserver with Master: 74d251272b71494d9163d73d58841d0d (127.30.214.130:39217)
I20260808 14:45:16.437846 31578 external_mini_cluster.cc:1428] Setting key 6d45eb20478abee5f38744360e563dde
I20260808 14:45:16.438330 4523 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.214.130@KRBTEST.COM'} at 127.30.214.130:34491
WARNING: no policy specified for kudu/127.30.214.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab.
Entry for principal kudu/127.30.214.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab.
I20260808 14:45:16.464419 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.131:0
--local_ip_for_outbound_sockets=127.30.214.131
--webserver_interface=127.30.214.131
--webserver_port=0
--tserver_master_addrs=127.30.214.190:37821
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab
--principal=kudu/127.30.214.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:36641
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:45:16.545109 5020 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:45:16.545320 5020 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:45:16.545342 5020 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:45:16.546556 5020 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:45:16.546600 5020 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:45:16.546626 5020 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.131
I20260808 14:45:16.548202 5020 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:36641
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab
--principal=kudu/127.30.214.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.214.131
--webserver_port=0
--tserver_master_addrs=127.30.214.190:37821
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5020
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.131
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:45:16.548408 5020 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:45:16.548590 5020 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:45:16.553375 5032 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:16.553386 5030 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:16.553398 5028 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:16.553640 5020 server_base.cc:1034] running on GCE node
I20260808 14:45:16.553880 5020 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:45:16.554121 5020 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:45:16.555305 5020 hybrid_clock.cc:648] HybridClock initialized: now 1786200316555286 us; error 36 us; skew 500 ppm
Aug 08 14:45:16 dist-test-slave-42z9 krb5kdc[4456](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200316, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:45:16.557859 5020 init.cc:377] Logged in from keytab as kudu/127.30.214.131@KRBTEST.COM (short username kudu)
I20260808 14:45:16.558305 5020 webserver.cc:460] Webserver started at http://127.30.214.131:42531/ using document root <none> and password file <none>
I20260808 14:45:16.558512 5020 fs_manager.cc:359] Metadata directory not provided
I20260808 14:45:16.558561 5020 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:45:16.558687 5020 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:45:16.559787 5020 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/minicluster-data/ts-2/data/instance:
uuid: "5613eb242e77498a8a0de623cbb0f3c1"
format_stamp: "Formatted at 2026-08-08 14:45:16 on dist-test-slave-42z9"
server_key: "90c7504034737b0567507e0fc84c0124"
server_key_iv: "a5ca876092c1fea5ca2f324b830c6b85"
server_key_version: "encryptionkey@0"
I20260808 14:45:16.560132 5020 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/minicluster-data/ts-2/wal/instance:
uuid: "5613eb242e77498a8a0de623cbb0f3c1"
format_stamp: "Formatted at 2026-08-08 14:45:16 on dist-test-slave-42z9"
server_key: "90c7504034737b0567507e0fc84c0124"
server_key_iv: "a5ca876092c1fea5ca2f324b830c6b85"
server_key_version: "encryptionkey@0"
I20260808 14:45:16.561553 5020 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:45:16.562326 5043 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:16.562493 5020 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:45:16.562579 5020 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/minicluster-data/ts-2/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/minicluster-data/ts-2/wal
uuid: "5613eb242e77498a8a0de623cbb0f3c1"
format_stamp: "Formatted at 2026-08-08 14:45:16 on dist-test-slave-42z9"
server_key: "90c7504034737b0567507e0fc84c0124"
server_key_iv: "a5ca876092c1fea5ca2f324b830c6b85"
server_key_version: "encryptionkey@0"
I20260808 14:45:16.562649 5020 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:45:16.578118 5020 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:45:16.580078 5020 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:45:16.580214 5020 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:45:16.580441 5020 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:45:16.580744 5020 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:45:16.580778 5020 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:16.580807 5020 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:45:16.580832 5020 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:16.586695 5020 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.131:42595
I20260808 14:45:16.586766 5214 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.131:42595 every 8 connection(s)
I20260808 14:45:16.587066 5020 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
I20260808 14:45:16.589682 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 5020
I20260808 14:45:16.589762 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786200295877777-31578-0/minicluster-data/ts-2/wal/instance
I20260808 14:45:16.589926 31578 external_mini_cluster.cc:1428] Setting key baed7a6a1e59512f4d7a5425e2662b0e
Aug 08 14:45:16 dist-test-slave-42z9 krb5kdc[4456](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200316, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.131@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:45:16.596463 4576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:16.587775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:39001 (local address 127.30.214.190:37821)
0808 14:45:16.587840 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:16.587841 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:16.588064 (+ 223us) server_negotiation.cc:407] Connection header received
0808 14:45:16.588965 (+ 901us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:16.588966 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:16.588977 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:16.589181 (+ 204us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:16.590003 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:16.590613 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:16.591692 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:16.591895 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:16.591961 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:16.594088 (+ 2127us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:16.594089 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:16.594090 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:16.594098 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:16.595162 (+ 1064us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:16.595552 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:16.595554 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:16.595554 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:16.595611 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:16.595834 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:16.595835 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:16.595835 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:16.595961 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:16.596019 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:16.596284 (+ 265us) server_negotiation.cc:299] Negotiation successful
0808 14:45:16.596371 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 14:45:16.596649 5217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:16.587736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:37821 (local address 127.30.214.131:39001)
0808 14:45:16.587909 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:16.587952 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:16.588864 (+ 912us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:16.589304 (+ 440us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:16.589308 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:16.589660 (+ 352us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:16.589899 (+ 239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:16.589904 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:16.590708 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:16.590709 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:16.591606 (+ 897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:16.591609 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:16.591967 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:16.591968 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:16.592104 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:16.592551 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:16.592559 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:16.593995 (+ 1436us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:16.595240 (+ 1245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:16.595248 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:16.595251 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:16.595483 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:16.595665 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:16.595666 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:16.595667 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:16.595777 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:16.596018 (+ 241us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:16.596025 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:16.596163 (+ 138us) client_negotiation.cc:769] Sending connection context
0808 14:45:16.596253 (+ 90us) client_negotiation.cc:240] Negotiation successful
0808 14:45:16.596415 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":86,"threads_started":1}
I20260808 14:45:16.597148 5215 heartbeater.cc:347] Connected to a master server at 127.30.214.190:37821
I20260808 14:45:16.597251 5215 heartbeater.cc:464] Registering TS with master...
I20260808 14:45:16.597409 5215 heartbeater.cc:511] Master 127.30.214.190:37821 requested a full tablet report, sending...
I20260808 14:45:16.597808 4523 ts_manager.cc:194] Registered new tserver with Master: 5613eb242e77498a8a0de623cbb0f3c1 (127.30.214.131:42595)
I20260808 14:45:16.598174 4523 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.214.131@KRBTEST.COM'} at 127.30.214.131:39001
I20260808 14:45:16.601912 31578 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 14:45:16 dist-test-slave-42z9 krb5kdc[4456](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200316, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 14:45:16 dist-test-slave-42z9 krb5kdc[4456](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200316, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.214.129@KRBTEST.COM
I20260808 14:45:16.625305 5222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:16.618147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39396 (local address 127.30.214.129:35035)
0808 14:45:16.618315 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:16.618320 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:16.618332 (+ 12us) server_negotiation.cc:407] Connection header received
0808 14:45:16.618359 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:16.618361 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:16.618375 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:16.618449 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:16.619016 (+ 567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:16.619740 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:16.620495 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:16.620809 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:16.620858 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:16.623090 (+ 2232us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:16.623100 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:16.623100 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:16.623107 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:16.624386 (+ 1279us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:16.624676 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:16.624678 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:16.624679 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:16.624729 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:16.624854 (+ 125us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:16.624854 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:16.624854 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:16.624987 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:16.625084 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:16.625149 (+ 65us) server_negotiation.cc:299] Negotiation successful
0808 14:45:16.625210 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":93,"threads_started":1}
Aug 08 14:45:16 dist-test-slave-42z9 krb5kdc[4456](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200316, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:45:16.633121 4576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:16.626642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57802 (local address 127.30.214.190:37821)
0808 14:45:16.626711 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:16.626712 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:16.626722 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:45:16.626745 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:16.626746 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:16.626755 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:16.626799 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:16.627227 (+ 428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:16.627708 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:16.628408 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:16.628609 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:16.628672 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:16.630841 (+ 2169us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:16.630843 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:16.630843 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:16.630850 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:16.632030 (+ 1180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:16.632362 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:16.632363 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:16.632364 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:16.632415 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:16.632587 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:16.632588 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:16.632588 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:16.632737 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:16.632824 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:16.632941 (+ 117us) server_negotiation.cc:299] Negotiation successful
0808 14:45:16.633029 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
W20260808 14:45:16.633338 4523 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57802
I20260808 14:45:16.633682 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 4608
I20260808 14:45:16.654927 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 4808
I20260808 14:45:16.664279 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 5020
I20260808 14:45:16.677610 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 4479
2026-08-08T14:45:16Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (1985 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:45:16 dist-test-slave-42z9 krb5kdc[5233](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:45:16 dist-test-slave-42z9 krb5kdc[5233](info): set up 2 sockets
Aug 08 14:45:16 dist-test-slave-42z9 krb5kdc[5233](info): commencing operation
krb5kdc: starting...
W20260808 14:45:17.808496 31578 mini_kdc.cc:121] Time spent starting KDC: real 1.108s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Aug 08 14:45:17 dist-test-slave-42z9 krb5kdc[5233](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200317, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:45:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:45:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.214.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab.
Entry for principal kudu/127.30.214.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab.
I20260808 14:45:17.930315 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:45341
--webserver_interface=127.30.214.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab
--principal=kudu/127.30.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:43353
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.214.190:45341
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:45:18.013361 5251 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:45:18.013628 5251 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:45:18.013651 5251 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:45:18.014818 5251 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:45:18.014854 5251 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:45:18.014868 5251 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:45:18.014879 5251 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:45:18.014889 5251 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:45:18.016419 5251 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:43353
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.214.190:45341
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab
--principal=kudu/127.30.214.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:45341
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5251
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:45:18.016650 5251 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:45:18.016837 5251 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:45:18.021632 5264 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:18.021739 5251 server_base.cc:1034] running on GCE node
W20260808 14:45:18.021584 5260 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:18.021590 5261 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:18.022148 5251 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:45:18.022459 5251 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:45:18.023636 5251 hybrid_clock.cc:648] HybridClock initialized: now 1786200318023618 us; error 37 us; skew 500 ppm
Aug 08 14:45:18 dist-test-slave-42z9 krb5kdc[5233](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200318, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:45:18.030655 5251 init.cc:377] Logged in from keytab as kudu/127.30.214.190@KRBTEST.COM (short username kudu)
I20260808 14:45:18.031179 5251 fs_manager.cc:359] Metadata directory not provided
I20260808 14:45:18.031257 5251 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:45:18.031401 5251 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:45:18.032496 5251 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/minicluster-data/master-0/data/instance:
uuid: "25939f1398844117ab5c15f61d3d96a5"
format_stamp: "Formatted at 2026-08-08 14:45:18 on dist-test-slave-42z9"
server_key: "9db68ba6c7f2e925e62aea62809d2fae"
server_key_iv: "157cb2c087b29312d5918fa41439e1f2"
server_key_version: "encryptionkey@0"
I20260808 14:45:18.032851 5251 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/minicluster-data/master-0/wal/instance:
uuid: "25939f1398844117ab5c15f61d3d96a5"
format_stamp: "Formatted at 2026-08-08 14:45:18 on dist-test-slave-42z9"
server_key: "9db68ba6c7f2e925e62aea62809d2fae"
server_key_iv: "157cb2c087b29312d5918fa41439e1f2"
server_key_version: "encryptionkey@0"
I20260808 14:45:18.034344 5251 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.002s
I20260808 14:45:18.035214 5273 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:18.035408 5251 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:45:18.035518 5251 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/minicluster-data/master-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/minicluster-data/master-0/wal
uuid: "25939f1398844117ab5c15f61d3d96a5"
format_stamp: "Formatted at 2026-08-08 14:45:18 on dist-test-slave-42z9"
server_key: "9db68ba6c7f2e925e62aea62809d2fae"
server_key_iv: "157cb2c087b29312d5918fa41439e1f2"
server_key_version: "encryptionkey@0"
I20260808 14:45:18.035590 5251 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:45:18.065886 5251 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:45:18.068167 5251 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:45:18.068323 5251 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:45:18.072516 5251 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.190:45341
I20260808 14:45:18.072548 5352 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.190:45341 every 8 connection(s)
I20260808 14:45:18.072857 5251 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
I20260808 14:45:18.074050 5353 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:45:18.076210 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 5251
I20260808 14:45:18.076327 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/minicluster-data/master-0/wal/instance
I20260808 14:45:18.076514 31578 external_mini_cluster.cc:1428] Setting key b79ca18cedd8c30fcc00c048aab70584
I20260808 14:45:18.076682 5353 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25939f1398844117ab5c15f61d3d96a5: Bootstrap starting.
I20260808 14:45:18.077435 5353 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 25939f1398844117ab5c15f61d3d96a5: Neither blocks nor log segments found. Creating new log.
I20260808 14:45:18.077785 5353 log.cc:824] T 00000000000000000000000000000000 P 25939f1398844117ab5c15f61d3d96a5: Log is configured to *not* fsync() on all Append() calls
I20260808 14:45:18.078471 5353 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25939f1398844117ab5c15f61d3d96a5: No bootstrap required, opened a new log
I20260808 14:45:18.080729 5353 raft_consensus.cc:348] T 00000000000000000000000000000000 P 25939f1398844117ab5c15f61d3d96a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25939f1398844117ab5c15f61d3d96a5" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 45341 } }
I20260808 14:45:18.080926 5353 raft_consensus.cc:374] T 00000000000000000000000000000000 P 25939f1398844117ab5c15f61d3d96a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:45:18.080958 5353 raft_consensus.cc:729] T 00000000000000000000000000000000 P 25939f1398844117ab5c15f61d3d96a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25939f1398844117ab5c15f61d3d96a5, State: Initialized, Role: FOLLOWER
I20260808 14:45:18.081095 5353 consensus_queue.cc:260] T 00000000000000000000000000000000 P 25939f1398844117ab5c15f61d3d96a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25939f1398844117ab5c15f61d3d96a5" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 45341 } }
I20260808 14:45:18.081168 5353 raft_consensus.cc:388] T 00000000000000000000000000000000 P 25939f1398844117ab5c15f61d3d96a5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:45:18.081204 5353 raft_consensus.cc:482] T 00000000000000000000000000000000 P 25939f1398844117ab5c15f61d3d96a5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:45:18.081248 5353 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 25939f1398844117ab5c15f61d3d96a5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:18.082037 5353 raft_consensus.cc:504] T 00000000000000000000000000000000 P 25939f1398844117ab5c15f61d3d96a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25939f1398844117ab5c15f61d3d96a5" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 45341 } }
I20260808 14:45:18.082167 5353 leader_election.cc:302] T 00000000000000000000000000000000 P 25939f1398844117ab5c15f61d3d96a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 25939f1398844117ab5c15f61d3d96a5; no voters:
I20260808 14:45:18.082345 5353 leader_election.cc:288] T 00000000000000000000000000000000 P 25939f1398844117ab5c15f61d3d96a5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:45:18.082427 5359 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 25939f1398844117ab5c15f61d3d96a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:45:18.082617 5353 sys_catalog.cc:564] T 00000000000000000000000000000000 P 25939f1398844117ab5c15f61d3d96a5 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:45:18.082629 5359 raft_consensus.cc:686] T 00000000000000000000000000000000 P 25939f1398844117ab5c15f61d3d96a5 [term 1 LEADER]: Becoming Leader. State: Replica: 25939f1398844117ab5c15f61d3d96a5, State: Running, Role: LEADER
I20260808 14:45:18.082862 5359 consensus_queue.cc:237] T 00000000000000000000000000000000 P 25939f1398844117ab5c15f61d3d96a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25939f1398844117ab5c15f61d3d96a5" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 45341 } }
I20260808 14:45:18.083263 5359 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25939f1398844117ab5c15f61d3d96a5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 25939f1398844117ab5c15f61d3d96a5. Latest consensus state: current_term: 1 leader_uuid: "25939f1398844117ab5c15f61d3d96a5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25939f1398844117ab5c15f61d3d96a5" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 45341 } } }
I20260808 14:45:18.083413 5361 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25939f1398844117ab5c15f61d3d96a5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "25939f1398844117ab5c15f61d3d96a5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25939f1398844117ab5c15f61d3d96a5" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 45341 } } }
I20260808 14:45:18.083479 5359 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25939f1398844117ab5c15f61d3d96a5 [sys.catalog]: This master's current role is: LEADER
I20260808 14:45:18.083550 5361 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25939f1398844117ab5c15f61d3d96a5 [sys.catalog]: This master's current role is: LEADER
I20260808 14:45:18.083714 5373 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Aug 08 14:45:18 dist-test-slave-42z9 krb5kdc[5233](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200317, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:45:18.084805 5373 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:45:18.086864 5373 catalog_manager.cc:1347] Generated new cluster ID: 9c28ff9742574783a11e68b4e3596549
I20260808 14:45:18.086915 5373 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:45:18.088567 5357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:18.077075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34916 (local address 127.30.214.190:45341)
0808 14:45:18.077245 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:18.077255 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:18.077281 (+ 26us) server_negotiation.cc:407] Connection header received
0808 14:45:18.077809 (+ 528us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:18.077818 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:18.077883 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:18.078024 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:18.078637 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:18.080005 (+ 1368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:18.080771 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:18.081364 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:18.081530 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:18.084421 (+ 2891us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:18.084426 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:18.084426 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:18.084439 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:18.086499 (+ 2060us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:18.086954 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:18.086958 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:18.086958 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:18.087068 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:18.087278 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:18.087279 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:18.087280 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:18.087584 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:18.087717 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:18.088197 (+ 480us) server_negotiation.cc:299] Negotiation successful
0808 14:45:18.088346 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":75,"threads_started":1}
I20260808 14:45:18.099537 5373 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:45:18.100107 5373 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:45:18.114071 5373 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 25939f1398844117ab5c15f61d3d96a5: Generated new TSK 0
I20260808 14:45:18.114302 5373 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.214.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab.
Entry for principal kudu/127.30.214.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab.
I20260808 14:45:18.147756 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.129:0
--local_ip_for_outbound_sockets=127.30.214.129
--webserver_interface=127.30.214.129
--webserver_port=0
--tserver_master_addrs=127.30.214.190:45341
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab
--principal=kudu/127.30.214.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:43353
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:45:18.234007 5390 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:45:18.234225 5390 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:45:18.234251 5390 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:45:18.235488 5390 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:45:18.235538 5390 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:45:18.235565 5390 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.129
I20260808 14:45:18.237179 5390 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:43353
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab
--principal=kudu/127.30.214.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.214.129
--webserver_port=0
--tserver_master_addrs=127.30.214.190:45341
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5390
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.129
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:45:18.237466 5390 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:45:18.237818 5390 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:45:18.242895 5397 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:18.242888 5400 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:18.242887 5398 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:18.243482 5390 server_base.cc:1034] running on GCE node
I20260808 14:45:18.243737 5390 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:45:18.243985 5390 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:45:18.245158 5390 hybrid_clock.cc:648] HybridClock initialized: now 1786200318245112 us; error 57 us; skew 500 ppm
Aug 08 14:45:18 dist-test-slave-42z9 krb5kdc[5233](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200318, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:45:18.247788 5390 init.cc:377] Logged in from keytab as kudu/127.30.214.129@KRBTEST.COM (short username kudu)
I20260808 14:45:18.248170 5390 fs_manager.cc:359] Metadata directory not provided
I20260808 14:45:18.248227 5390 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:45:18.248363 5390 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:45:18.249488 5390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/minicluster-data/ts-0/data/instance:
uuid: "13f91016305b4125876aad42840ac953"
format_stamp: "Formatted at 2026-08-08 14:45:18 on dist-test-slave-42z9"
server_key: "89f52f0aca7b795f3acfc88dfddbdeab"
server_key_iv: "43137d0371ccafb3732cc8581ea42133"
server_key_version: "encryptionkey@0"
I20260808 14:45:18.249842 5390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/minicluster-data/ts-0/wal/instance:
uuid: "13f91016305b4125876aad42840ac953"
format_stamp: "Formatted at 2026-08-08 14:45:18 on dist-test-slave-42z9"
server_key: "89f52f0aca7b795f3acfc88dfddbdeab"
server_key_iv: "43137d0371ccafb3732cc8581ea42133"
server_key_version: "encryptionkey@0"
I20260808 14:45:18.251137 5390 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:45:18.251843 5411 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:18.252003 5390 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:45:18.252089 5390 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/minicluster-data/ts-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/minicluster-data/ts-0/wal
uuid: "13f91016305b4125876aad42840ac953"
format_stamp: "Formatted at 2026-08-08 14:45:18 on dist-test-slave-42z9"
server_key: "89f52f0aca7b795f3acfc88dfddbdeab"
server_key_iv: "43137d0371ccafb3732cc8581ea42133"
server_key_version: "encryptionkey@0"
I20260808 14:45:18.252159 5390 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:45:18.269291 5390 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:45:18.271564 5390 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:45:18.271718 5390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:45:18.271976 5390 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:45:18.272298 5390 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:45:18.272334 5390 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:18.272364 5390 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:45:18.272565 5390 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:18.278503 5390 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.129:45135
I20260808 14:45:18.278551 5584 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.129:45135 every 8 connection(s)
I20260808 14:45:18.278831 5390 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
I20260808 14:45:18.284003 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 5390
I20260808 14:45:18.284132 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/minicluster-data/ts-0/wal/instance
I20260808 14:45:18.284327 31578 external_mini_cluster.cc:1428] Setting key a3df0520e051537510e5e2a7d7f1f481
Aug 08 14:45:18 dist-test-slave-42z9 krb5kdc[5233](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200318, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.129@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:45:18.288120 5357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:18.279583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.129:40305 (local address 127.30.214.190:45341)
0808 14:45:18.279646 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:18.279648 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:18.279828 (+ 180us) server_negotiation.cc:407] Connection header received
0808 14:45:18.280300 (+ 472us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:18.280300 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:18.280310 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:18.280369 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:18.281289 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:18.281825 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:18.282864 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:18.283073 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:18.283126 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:18.285536 (+ 2410us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:18.285538 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:18.285538 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:18.285546 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:18.286732 (+ 1186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:18.287137 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:18.287138 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:18.287139 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:18.287201 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:18.287434 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:18.287435 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:18.287435 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:18.287558 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:18.287617 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:18.287953 (+ 336us) server_negotiation.cc:299] Negotiation successful
0808 14:45:18.288051 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 14:45:18.288321 5590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:18.279541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:45341 (local address 127.30.214.129:40305)
0808 14:45:18.279702 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:18.279747 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:18.280222 (+ 475us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:18.280426 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:18.280429 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:18.280701 (+ 272us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:18.281202 (+ 501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:18.281208 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:18.281890 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:18.281891 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:18.282796 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:18.282799 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:18.283135 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:18.283135 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:18.283234 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:18.283797 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:18.283809 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:18.285425 (+ 1616us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:18.286815 (+ 1390us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:18.286824 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:18.286826 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:18.287065 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:18.287259 (+ 194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:18.287260 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:18.287261 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:18.287375 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:18.287614 (+ 239us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:18.287621 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:18.287793 (+ 172us) client_negotiation.cc:769] Sending connection context
0808 14:45:18.287919 (+ 126us) client_negotiation.cc:240] Negotiation successful
0808 14:45:18.288095 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":73,"threads_started":1}
I20260808 14:45:18.288962 5585 heartbeater.cc:347] Connected to a master server at 127.30.214.190:45341
I20260808 14:45:18.289064 5585 heartbeater.cc:464] Registering TS with master...
I20260808 14:45:18.289222 5585 heartbeater.cc:511] Master 127.30.214.190:45341 requested a full tablet report, sending...
I20260808 14:45:18.289744 5298 ts_manager.cc:194] Registered new tserver with Master: 13f91016305b4125876aad42840ac953 (127.30.214.129:45135)
I20260808 14:45:18.290388 5298 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.214.129@KRBTEST.COM'} at 127.30.214.129:40305
WARNING: no policy specified for kudu/127.30.214.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab.
Entry for principal kudu/127.30.214.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab.
I20260808 14:45:18.312793 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.130:0
--local_ip_for_outbound_sockets=127.30.214.130
--webserver_interface=127.30.214.130
--webserver_port=0
--tserver_master_addrs=127.30.214.190:45341
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab
--principal=kudu/127.30.214.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:43353
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:45:18.395805 5593 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:45:18.396023 5593 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:45:18.396047 5593 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:45:18.397192 5593 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:45:18.397229 5593 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:45:18.397256 5593 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.130
I20260808 14:45:18.398878 5593 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:43353
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab
--principal=kudu/127.30.214.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.214.130
--webserver_port=0
--tserver_master_addrs=127.30.214.190:45341
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5593
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.130
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:45:18.399099 5593 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:45:18.399297 5593 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:45:18.404254 5603 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:18.404263 5601 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:18.404460 5593 server_base.cc:1034] running on GCE node
W20260808 14:45:18.404270 5599 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:18.404776 5593 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:45:18.405022 5593 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:45:18.406159 5593 hybrid_clock.cc:648] HybridClock initialized: now 1786200318406148 us; error 31 us; skew 500 ppm
Aug 08 14:45:18 dist-test-slave-42z9 krb5kdc[5233](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200318, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:45:18.408543 5593 init.cc:377] Logged in from keytab as kudu/127.30.214.130@KRBTEST.COM (short username kudu)
I20260808 14:45:18.408900 5593 fs_manager.cc:359] Metadata directory not provided
I20260808 14:45:18.408963 5593 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:45:18.409090 5593 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:45:18.410174 5593 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/minicluster-data/ts-1/data/instance:
uuid: "efff2a3b1734480986cb400352ead643"
format_stamp: "Formatted at 2026-08-08 14:45:18 on dist-test-slave-42z9"
server_key: "b0ca38f405a4ba8557bef5e17369324b"
server_key_iv: "098d0d8e9ac651f9a040d0fd41903482"
server_key_version: "encryptionkey@0"
I20260808 14:45:18.410502 5593 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/minicluster-data/ts-1/wal/instance:
uuid: "efff2a3b1734480986cb400352ead643"
format_stamp: "Formatted at 2026-08-08 14:45:18 on dist-test-slave-42z9"
server_key: "b0ca38f405a4ba8557bef5e17369324b"
server_key_iv: "098d0d8e9ac651f9a040d0fd41903482"
server_key_version: "encryptionkey@0"
I20260808 14:45:18.411731 5593 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:45:18.412392 5612 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:18.412549 5593 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:45:18.412632 5593 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/minicluster-data/ts-1/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/minicluster-data/ts-1/wal
uuid: "efff2a3b1734480986cb400352ead643"
format_stamp: "Formatted at 2026-08-08 14:45:18 on dist-test-slave-42z9"
server_key: "b0ca38f405a4ba8557bef5e17369324b"
server_key_iv: "098d0d8e9ac651f9a040d0fd41903482"
server_key_version: "encryptionkey@0"
I20260808 14:45:18.412695 5593 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:45:18.428186 5593 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:45:18.430085 5593 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:45:18.430238 5593 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:45:18.430469 5593 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:45:18.430792 5593 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:45:18.430830 5593 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:18.430859 5593 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:45:18.430876 5593 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:18.436641 5593 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.130:41763
I20260808 14:45:18.436683 5788 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.130:41763 every 8 connection(s)
I20260808 14:45:18.436957 5593 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
I20260808 14:45:18.438493 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 5593
I20260808 14:45:18.438606 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/minicluster-data/ts-1/wal/instance
I20260808 14:45:18.438794 31578 external_mini_cluster.cc:1428] Setting key 9ae012de2f8e90af7d94dfcb59431861
Aug 08 14:45:18 dist-test-slave-42z9 krb5kdc[5233](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200318, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.130@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:45:18.446311 5357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:18.437691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.130:51609 (local address 127.30.214.190:45341)
0808 14:45:18.437748 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:18.437751 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:18.437969 (+ 218us) server_negotiation.cc:407] Connection header received
0808 14:45:18.438469 (+ 500us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:18.438470 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:18.438484 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:18.438552 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:18.439673 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:18.440170 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:18.441148 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:18.441337 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:18.441395 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:18.443685 (+ 2290us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:18.443687 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:18.443687 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:18.443695 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:18.444971 (+ 1276us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:18.445362 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:18.445364 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:18.445364 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:18.445421 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:18.445677 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:18.445678 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:18.445678 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:18.445798 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:18.445856 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:18.446132 (+ 276us) server_negotiation.cc:299] Negotiation successful
0808 14:45:18.446218 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 14:45:18.446493 5791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:18.437672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:45341 (local address 127.30.214.130:51609)
0808 14:45:18.437842 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:18.437881 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:18.438378 (+ 497us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:18.438629 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:18.438633 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:18.438975 (+ 342us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:18.439590 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:18.439597 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:18.440254 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:18.440254 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:18.441063 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:18.441066 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:18.441408 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:18.441409 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:18.441573 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:18.442073 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:18.442082 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:18.443590 (+ 1508us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:18.445056 (+ 1466us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:18.445064 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:18.445067 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:18.445294 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:18.445507 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:18.445508 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:18.445508 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:18.445620 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:18.445853 (+ 233us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:18.445860 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:18.446009 (+ 149us) client_negotiation.cc:769] Sending connection context
0808 14:45:18.446101 (+ 92us) client_negotiation.cc:240] Negotiation successful
0808 14:45:18.446266 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":96,"threads_started":1}
WARNING: no policy specified for kudu/127.30.214.131@KRBTEST.COM; defaulting to no policy
I20260808 14:45:18.447568 5789 heartbeater.cc:347] Connected to a master server at 127.30.214.190:45341
I20260808 14:45:18.447721 5789 heartbeater.cc:464] Registering TS with master...
I20260808 14:45:18.447892 5789 heartbeater.cc:511] Master 127.30.214.190:45341 requested a full tablet report, sending...
I20260808 14:45:18.448318 5298 ts_manager.cc:194] Registered new tserver with Master: efff2a3b1734480986cb400352ead643 (127.30.214.130:41763)
I20260808 14:45:18.448704 5298 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.214.130@KRBTEST.COM'} at 127.30.214.130:51609
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab.
Entry for principal kudu/127.30.214.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab.
I20260808 14:45:18.464172 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.131:0
--local_ip_for_outbound_sockets=127.30.214.131
--webserver_interface=127.30.214.131
--webserver_port=0
--tserver_master_addrs=127.30.214.190:45341
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab
--principal=kudu/127.30.214.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:43353
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:45:18.547293 5794 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:45:18.547511 5794 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:45:18.547535 5794 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:45:18.548664 5794 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:45:18.548702 5794 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:45:18.548727 5794 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.131
I20260808 14:45:18.550360 5794 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:43353
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab
--principal=kudu/127.30.214.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.214.131
--webserver_port=0
--tserver_master_addrs=127.30.214.190:45341
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5794
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.131
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:45:18.550581 5794 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:45:18.550777 5794 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:45:18.555927 5812 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:18.555999 5806 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:18.555902 5808 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:18.556259 5794 server_base.cc:1034] running on GCE node
I20260808 14:45:18.556497 5794 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:45:18.556746 5794 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:45:18.557893 5794 hybrid_clock.cc:648] HybridClock initialized: now 1786200318557879 us; error 27 us; skew 500 ppm
Aug 08 14:45:18 dist-test-slave-42z9 krb5kdc[5233](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200318, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:45:18.560454 5794 init.cc:377] Logged in from keytab as kudu/127.30.214.131@KRBTEST.COM (short username kudu)
I20260808 14:45:18.560801 5794 fs_manager.cc:359] Metadata directory not provided
I20260808 14:45:18.560850 5794 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:45:18.560947 5794 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:45:18.562038 5794 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/minicluster-data/ts-2/data/instance:
uuid: "6527930040ec4ac0abc8cefc60130aeb"
format_stamp: "Formatted at 2026-08-08 14:45:18 on dist-test-slave-42z9"
server_key: "1521f50e075b527efcc732e841b0f9ce"
server_key_iv: "f51187836f617a8632808c2cda48206f"
server_key_version: "encryptionkey@0"
I20260808 14:45:18.562350 5794 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/minicluster-data/ts-2/wal/instance:
uuid: "6527930040ec4ac0abc8cefc60130aeb"
format_stamp: "Formatted at 2026-08-08 14:45:18 on dist-test-slave-42z9"
server_key: "1521f50e075b527efcc732e841b0f9ce"
server_key_iv: "f51187836f617a8632808c2cda48206f"
server_key_version: "encryptionkey@0"
I20260808 14:45:18.563611 5794 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:45:18.564285 5819 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:18.564455 5794 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:45:18.564533 5794 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/minicluster-data/ts-2/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/minicluster-data/ts-2/wal
uuid: "6527930040ec4ac0abc8cefc60130aeb"
format_stamp: "Formatted at 2026-08-08 14:45:18 on dist-test-slave-42z9"
server_key: "1521f50e075b527efcc732e841b0f9ce"
server_key_iv: "f51187836f617a8632808c2cda48206f"
server_key_version: "encryptionkey@0"
I20260808 14:45:18.564610 5794 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:45:18.587604 5794 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:45:18.589944 5794 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:45:18.590103 5794 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:45:18.590355 5794 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:45:18.590716 5794 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:45:18.590754 5794 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:18.590786 5794 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:45:18.590811 5794 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:18.596783 5794 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.131:40291
I20260808 14:45:18.596822 5983 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.131:40291 every 8 connection(s)
I20260808 14:45:18.597115 5794 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
I20260808 14:45:18.599845 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 5794
I20260808 14:45:18.599936 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/minicluster-data/ts-2/wal/instance
I20260808 14:45:18.600106 31578 external_mini_cluster.cc:1428] Setting key 3f0bdf242d717854d6ed18c26b9ad3e4
Aug 08 14:45:18 dist-test-slave-42z9 krb5kdc[5233](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200318, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.131@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:45:18.606132 5357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:18.597882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:37403 (local address 127.30.214.190:45341)
0808 14:45:18.597942 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:18.597944 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:18.598138 (+ 194us) server_negotiation.cc:407] Connection header received
0808 14:45:18.598649 (+ 511us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:18.598651 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:18.598663 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:18.598715 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:18.599674 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:18.600260 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:18.601476 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:18.601686 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:18.601747 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:18.603779 (+ 2032us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:18.603780 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:18.603781 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:18.603788 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:18.605040 (+ 1252us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:18.605354 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:18.605355 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:18.605355 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:18.605419 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:18.605641 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:18.605642 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:18.605642 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:18.605748 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:18.605795 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:18.606004 (+ 209us) server_negotiation.cc:299] Negotiation successful
0808 14:45:18.606065 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 14:45:18.606307 5986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:18.597844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:45341 (local address 127.30.214.131:37403)
0808 14:45:18.598016 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:18.598054 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:18.598539 (+ 485us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:18.598782 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:18.598786 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:18.599057 (+ 271us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:18.599571 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:18.599578 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:18.600345 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:18.600346 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:18.601357 (+ 1011us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:18.601361 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:18.601757 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:18.601757 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:18.601863 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:18.602302 (+ 439us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:18.602310 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:18.603680 (+ 1370us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:18.605103 (+ 1423us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:18.605106 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:18.605108 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:18.605303 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:18.605490 (+ 187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:18.605490 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:18.605490 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:18.605595 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:18.605792 (+ 197us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:18.605795 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:18.605908 (+ 113us) client_negotiation.cc:769] Sending connection context
0808 14:45:18.605985 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 14:45:18.606107 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":92,"threads_started":1}
I20260808 14:45:18.606730 5984 heartbeater.cc:347] Connected to a master server at 127.30.214.190:45341
I20260808 14:45:18.606834 5984 heartbeater.cc:464] Registering TS with master...
I20260808 14:45:18.606998 5984 heartbeater.cc:511] Master 127.30.214.190:45341 requested a full tablet report, sending...
I20260808 14:45:18.607350 5298 ts_manager.cc:194] Registered new tserver with Master: 6527930040ec4ac0abc8cefc60130aeb (127.30.214.131:40291)
I20260808 14:45:18.607705 5298 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.214.131@KRBTEST.COM'} at 127.30.214.131:37403
I20260808 14:45:18.612085 31578 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:45:18.618868 5357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:18.613336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34924 (local address 127.30.214.190:45341)
0808 14:45:18.613386 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:18.613388 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:18.613468 (+ 80us) server_negotiation.cc:407] Connection header received
0808 14:45:18.613536 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:18.613537 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:18.613546 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:18.613592 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:18.614133 (+ 541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:18.614657 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:18.615415 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:18.615609 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:18.615657 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:18.616737 (+ 1080us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:18.616738 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:18.616738 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:18.616744 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:18.617977 (+ 1233us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:18.618260 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:18.618261 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:18.618261 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:18.618308 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:18.618439 (+ 131us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:18.618439 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:18.618440 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:18.618582 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:18.618651 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:18.618743 (+ 92us) server_negotiation.cc:299] Negotiation successful
0808 14:45:18.618802 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 14:45:18.620268 5298 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34924:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:45:18.621932 5298 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:45:18.628259 6003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:18.624404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48828 (local address 127.30.214.130:41763)
0808 14:45:18.624622 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:18.624626 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:18.624635 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:45:18.624670 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:18.624671 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:18.624684 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:18.624761 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:45:18.624960 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:18.625831 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:18.627094 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:18.627848 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:18.627922 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:18.627980 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:18.628131 (+ 151us) server_negotiation.cc:299] Negotiation successful
0808 14:45:18.628173 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":191,"thread_start_us":114,"threads_started":1}
I20260808 14:45:18.628243 5998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:18.624106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.131:40291 (local address 127.0.0.1:48438)
0808 14:45:18.624275 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:18.624315 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:18.624419 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:18.625039 (+ 620us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:18.625039 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:18.625042 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:45:18.625091 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:18.625092 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:18.626416 (+ 1324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:18.626417 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:18.627334 (+ 917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:18.627336 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:18.627994 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:18.627995 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:18.628042 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:18.628045 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:45:18.628080 (+ 35us) client_negotiation.cc:240] Negotiation successful
0808 14:45:18.628135 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":55,"threads_started":1}
I20260808 14:45:18.628243 5997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:18.624107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.130:41763 (local address 127.0.0.1:48828)
0808 14:45:18.624364 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:18.624376 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:18.624433 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:18.624784 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:18.624787 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:18.624790 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:45:18.624869 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:18.624871 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:18.625918 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:18.625919 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:18.627014 (+ 1095us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:18.627016 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:18.627932 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:18.627933 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:18.628017 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:18.628033 (+ 16us) client_negotiation.cc:769] Sending connection context
0808 14:45:18.628113 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 14:45:18.628145 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":239,"mutex_wait_us":1,"thread_start_us":93,"threads_started":1}
I20260808 14:45:18.628674 6006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:18.624607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48438 (local address 127.30.214.131:40291)
0808 14:45:18.624866 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:18.624870 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:18.624880 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:45:18.624927 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:18.624930 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:18.624946 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:18.625158 (+ 212us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:45:18.625223 (+ 65us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:18.626313 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:18.627409 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:18.627899 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:18.628505 (+ 606us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:18.628550 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:18.628580 (+ 30us) server_negotiation.cc:299] Negotiation successful
0808 14:45:18.628613 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":95,"threads_started":1}
I20260808 14:45:18.628728 5999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:18.624106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.129:45135 (local address 127.0.0.1:46970)
0808 14:45:18.624856 (+ 750us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:18.624866 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:18.624918 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:18.625181 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:18.625181 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:18.625183 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:45:18.625230 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:18.625232 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:18.626532 (+ 1300us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:18.626533 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:18.627561 (+ 1028us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:18.627564 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:18.628511 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:18.628512 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:18.628570 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:18.628574 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:45:18.628615 (+ 41us) client_negotiation.cc:240] Negotiation successful
0808 14:45:18.628654 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":732,"mutex_wait_us":21,"thread_start_us":79,"threads_started":1}
I20260808 14:45:18.629020 6002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:18.624405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46970 (local address 127.30.214.129:45135)
0808 14:45:18.624806 (+ 401us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:18.624810 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:18.624969 (+ 159us) server_negotiation.cc:407] Connection header received
0808 14:45:18.625010 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:18.625012 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:18.625029 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:18.625095 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:45:18.625316 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:18.626446 (+ 1130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:18.627655 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:18.628351 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:18.628422 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:18.628473 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:18.628880 (+ 407us) server_negotiation.cc:299] Negotiation successful
0808 14:45:18.628940 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":363,"thread_start_us":85,"threads_started":1}
I20260808 14:45:18.629375 5892 tablet_service.cc:1467] Processing CreateTablet for tablet 2ca7550dff1e49fa8a6d9da33115a0c8 (DEFAULT_TABLE table=test-table [id=78f3b7434f89466698daaa53b5a7329e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:45:18.629670 5486 tablet_service.cc:1467] Processing CreateTablet for tablet 2ca7550dff1e49fa8a6d9da33115a0c8 (DEFAULT_TABLE table=test-table [id=78f3b7434f89466698daaa53b5a7329e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:45:18.629815 5892 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ca7550dff1e49fa8a6d9da33115a0c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:45:18.629798 5688 tablet_service.cc:1467] Processing CreateTablet for tablet 2ca7550dff1e49fa8a6d9da33115a0c8 (DEFAULT_TABLE table=test-table [id=78f3b7434f89466698daaa53b5a7329e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:45:18.629961 5486 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ca7550dff1e49fa8a6d9da33115a0c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:45:18.630065 5688 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ca7550dff1e49fa8a6d9da33115a0c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:45:18.632778 6008 tablet_bootstrap.cc:492] T 2ca7550dff1e49fa8a6d9da33115a0c8 P efff2a3b1734480986cb400352ead643: Bootstrap starting.
I20260808 14:45:18.633268 6009 tablet_bootstrap.cc:492] T 2ca7550dff1e49fa8a6d9da33115a0c8 P 6527930040ec4ac0abc8cefc60130aeb: Bootstrap starting.
I20260808 14:45:18.633509 6008 tablet_bootstrap.cc:654] T 2ca7550dff1e49fa8a6d9da33115a0c8 P efff2a3b1734480986cb400352ead643: Neither blocks nor log segments found. Creating new log.
I20260808 14:45:18.633618 6011 tablet_bootstrap.cc:492] T 2ca7550dff1e49fa8a6d9da33115a0c8 P 13f91016305b4125876aad42840ac953: Bootstrap starting.
I20260808 14:45:18.633965 6009 tablet_bootstrap.cc:654] T 2ca7550dff1e49fa8a6d9da33115a0c8 P 6527930040ec4ac0abc8cefc60130aeb: Neither blocks nor log segments found. Creating new log.
I20260808 14:45:18.634172 6011 tablet_bootstrap.cc:654] T 2ca7550dff1e49fa8a6d9da33115a0c8 P 13f91016305b4125876aad42840ac953: Neither blocks nor log segments found. Creating new log.
I20260808 14:45:18.634176 6008 log.cc:824] T 2ca7550dff1e49fa8a6d9da33115a0c8 P efff2a3b1734480986cb400352ead643: Log is configured to *not* fsync() on all Append() calls
I20260808 14:45:18.634545 6009 log.cc:824] T 2ca7550dff1e49fa8a6d9da33115a0c8 P 6527930040ec4ac0abc8cefc60130aeb: Log is configured to *not* fsync() on all Append() calls
I20260808 14:45:18.634754 6011 log.cc:824] T 2ca7550dff1e49fa8a6d9da33115a0c8 P 13f91016305b4125876aad42840ac953: Log is configured to *not* fsync() on all Append() calls
I20260808 14:45:18.635018 6008 tablet_bootstrap.cc:492] T 2ca7550dff1e49fa8a6d9da33115a0c8 P efff2a3b1734480986cb400352ead643: No bootstrap required, opened a new log
I20260808 14:45:18.635083 6008 ts_tablet_manager.cc:1397] T 2ca7550dff1e49fa8a6d9da33115a0c8 P efff2a3b1734480986cb400352ead643: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:45:18.635370 6011 tablet_bootstrap.cc:492] T 2ca7550dff1e49fa8a6d9da33115a0c8 P 13f91016305b4125876aad42840ac953: No bootstrap required, opened a new log
I20260808 14:45:18.635432 6011 ts_tablet_manager.cc:1397] T 2ca7550dff1e49fa8a6d9da33115a0c8 P 13f91016305b4125876aad42840ac953: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:45:18.636814 6008 raft_consensus.cc:348] T 2ca7550dff1e49fa8a6d9da33115a0c8 P efff2a3b1734480986cb400352ead643 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f91016305b4125876aad42840ac953" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 45135 } } peers { permanent_uuid: "6527930040ec4ac0abc8cefc60130aeb" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40291 } } peers { permanent_uuid: "efff2a3b1734480986cb400352ead643" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 41763 } }
I20260808 14:45:18.636855 6011 raft_consensus.cc:348] T 2ca7550dff1e49fa8a6d9da33115a0c8 P 13f91016305b4125876aad42840ac953 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f91016305b4125876aad42840ac953" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 45135 } } peers { permanent_uuid: "6527930040ec4ac0abc8cefc60130aeb" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40291 } } peers { permanent_uuid: "efff2a3b1734480986cb400352ead643" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 41763 } }
I20260808 14:45:18.636978 6011 raft_consensus.cc:374] T 2ca7550dff1e49fa8a6d9da33115a0c8 P 13f91016305b4125876aad42840ac953 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:45:18.636965 6008 raft_consensus.cc:374] T 2ca7550dff1e49fa8a6d9da33115a0c8 P efff2a3b1734480986cb400352ead643 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:45:18.636999 6011 raft_consensus.cc:729] T 2ca7550dff1e49fa8a6d9da33115a0c8 P 13f91016305b4125876aad42840ac953 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13f91016305b4125876aad42840ac953, State: Initialized, Role: FOLLOWER
I20260808 14:45:18.637001 6008 raft_consensus.cc:729] T 2ca7550dff1e49fa8a6d9da33115a0c8 P efff2a3b1734480986cb400352ead643 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efff2a3b1734480986cb400352ead643, State: Initialized, Role: FOLLOWER
I20260808 14:45:18.637121 6008 consensus_queue.cc:260] T 2ca7550dff1e49fa8a6d9da33115a0c8 P efff2a3b1734480986cb400352ead643 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f91016305b4125876aad42840ac953" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 45135 } } peers { permanent_uuid: "6527930040ec4ac0abc8cefc60130aeb" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40291 } } peers { permanent_uuid: "efff2a3b1734480986cb400352ead643" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 41763 } }
I20260808 14:45:18.637120 6011 consensus_queue.cc:260] T 2ca7550dff1e49fa8a6d9da33115a0c8 P 13f91016305b4125876aad42840ac953 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f91016305b4125876aad42840ac953" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 45135 } } peers { permanent_uuid: "6527930040ec4ac0abc8cefc60130aeb" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40291 } } peers { permanent_uuid: "efff2a3b1734480986cb400352ead643" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 41763 } }
I20260808 14:45:18.637428 6011 ts_tablet_manager.cc:1428] T 2ca7550dff1e49fa8a6d9da33115a0c8 P 13f91016305b4125876aad42840ac953: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:45:18.637465 5789 heartbeater.cc:503] Master 127.30.214.190:45341 was elected leader, sending a full tablet report...
I20260808 14:45:18.637494 5585 heartbeater.cc:503] Master 127.30.214.190:45341 was elected leader, sending a full tablet report...
I20260808 14:45:18.637468 6008 ts_tablet_manager.cc:1428] T 2ca7550dff1e49fa8a6d9da33115a0c8 P efff2a3b1734480986cb400352ead643: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:45:18.638442 6009 tablet_bootstrap.cc:492] T 2ca7550dff1e49fa8a6d9da33115a0c8 P 6527930040ec4ac0abc8cefc60130aeb: No bootstrap required, opened a new log
I20260808 14:45:18.638521 6009 ts_tablet_manager.cc:1397] T 2ca7550dff1e49fa8a6d9da33115a0c8 P 6527930040ec4ac0abc8cefc60130aeb: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260808 14:45:18.640169 6009 raft_consensus.cc:348] T 2ca7550dff1e49fa8a6d9da33115a0c8 P 6527930040ec4ac0abc8cefc60130aeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f91016305b4125876aad42840ac953" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 45135 } } peers { permanent_uuid: "6527930040ec4ac0abc8cefc60130aeb" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40291 } } peers { permanent_uuid: "efff2a3b1734480986cb400352ead643" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 41763 } }
I20260808 14:45:18.640305 6009 raft_consensus.cc:374] T 2ca7550dff1e49fa8a6d9da33115a0c8 P 6527930040ec4ac0abc8cefc60130aeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:45:18.640326 6009 raft_consensus.cc:729] T 2ca7550dff1e49fa8a6d9da33115a0c8 P 6527930040ec4ac0abc8cefc60130aeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6527930040ec4ac0abc8cefc60130aeb, State: Initialized, Role: FOLLOWER
I20260808 14:45:18.640411 6009 consensus_queue.cc:260] T 2ca7550dff1e49fa8a6d9da33115a0c8 P 6527930040ec4ac0abc8cefc60130aeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f91016305b4125876aad42840ac953" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 45135 } } peers { permanent_uuid: "6527930040ec4ac0abc8cefc60130aeb" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40291 } } peers { permanent_uuid: "efff2a3b1734480986cb400352ead643" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 41763 } }
I20260808 14:45:18.640638 6009 ts_tablet_manager.cc:1428] T 2ca7550dff1e49fa8a6d9da33115a0c8 P 6527930040ec4ac0abc8cefc60130aeb: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:45:18.640663 5984 heartbeater.cc:503] Master 127.30.214.190:45341 was elected leader, sending a full tablet report...
I20260808 14:45:18.682521 6016 raft_consensus.cc:482] T 2ca7550dff1e49fa8a6d9da33115a0c8 P efff2a3b1734480986cb400352ead643 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:45:18.682664 6016 raft_consensus.cc:504] T 2ca7550dff1e49fa8a6d9da33115a0c8 P efff2a3b1734480986cb400352ead643 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f91016305b4125876aad42840ac953" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 45135 } } peers { permanent_uuid: "6527930040ec4ac0abc8cefc60130aeb" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40291 } } peers { permanent_uuid: "efff2a3b1734480986cb400352ead643" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 41763 } }
I20260808 14:45:18.683053 6016 leader_election.cc:288] T 2ca7550dff1e49fa8a6d9da33115a0c8 P efff2a3b1734480986cb400352ead643 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13f91016305b4125876aad42840ac953 (127.30.214.129:45135), 6527930040ec4ac0abc8cefc60130aeb (127.30.214.131:40291)
I20260808 14:45:18.685943 6006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:18.683404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.130:48683 (local address 127.30.214.131:40291)
0808 14:45:18.683449 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:18.683451 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:18.683512 (+ 61us) server_negotiation.cc:407] Connection header received
0808 14:45:18.683547 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:18.683548 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:18.683557 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:18.683620 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:45:18.683777 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:18.684278 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:18.685225 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:18.685641 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:18.685711 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:18.685720 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:18.685849 (+ 129us) server_negotiation.cc:299] Negotiation successful
0808 14:45:18.685887 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 14:45:18.685937 6002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:18.683300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.130:32937 (local address 127.30.214.129:45135)
0808 14:45:18.683355 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:18.683357 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:18.683376 (+ 19us) server_negotiation.cc:407] Connection header received
0808 14:45:18.683404 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:18.683405 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:18.683414 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:18.683475 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:45:18.683646 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:18.684168 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:18.685176 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:18.685593 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:18.685650 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:18.685658 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:18.685825 (+ 167us) server_negotiation.cc:299] Negotiation successful
0808 14:45:18.685864 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 14:45:18.685937 5791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:18.683220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.129:45135 (local address 127.30.214.130:32937)
0808 14:45:18.683281 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:18.683291 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:18.683333 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:18.683486 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:18.683487 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:18.683489 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:45:18.683573 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:18.683575 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:18.684246 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:18.684247 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:18.685089 (+ 842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:18.685092 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:18.685674 (+ 582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:18.685675 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:18.685755 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:18.685759 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:45:18.685809 (+ 50us) client_negotiation.cc:240] Negotiation successful
0808 14:45:18.685850 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260808 14:45:18.685962 6020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:18.683249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.131:40291 (local address 127.30.214.130:48683)
0808 14:45:18.683448 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:18.683457 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:18.683505 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:18.683637 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:18.683638 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:18.683639 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:45:18.683713 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:18.683715 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:18.684354 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:18.684355 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:18.685130 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:18.685133 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:18.685719 (+ 586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:18.685720 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:18.685781 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:18.685784 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:45:18.685836 (+ 52us) client_negotiation.cc:240] Negotiation successful
0808 14:45:18.685872 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":126,"threads_started":1}
I20260808 14:45:18.686278 5514 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ca7550dff1e49fa8a6d9da33115a0c8" candidate_uuid: "efff2a3b1734480986cb400352ead643" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13f91016305b4125876aad42840ac953" is_pre_election: true
I20260808 14:45:18.686321 5922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ca7550dff1e49fa8a6d9da33115a0c8" candidate_uuid: "efff2a3b1734480986cb400352ead643" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6527930040ec4ac0abc8cefc60130aeb" is_pre_election: true
I20260808 14:45:18.686452 5514 raft_consensus.cc:2454] T 2ca7550dff1e49fa8a6d9da33115a0c8 P 13f91016305b4125876aad42840ac953 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efff2a3b1734480986cb400352ead643 in term 0.
I20260808 14:45:18.686455 5922 raft_consensus.cc:2454] T 2ca7550dff1e49fa8a6d9da33115a0c8 P 6527930040ec4ac0abc8cefc60130aeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efff2a3b1734480986cb400352ead643 in term 0.
I20260808 14:45:18.686692 5617 leader_election.cc:302] T 2ca7550dff1e49fa8a6d9da33115a0c8 P efff2a3b1734480986cb400352ead643 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13f91016305b4125876aad42840ac953, efff2a3b1734480986cb400352ead643; no voters:
I20260808 14:45:18.686862 6016 raft_consensus.cc:2781] T 2ca7550dff1e49fa8a6d9da33115a0c8 P efff2a3b1734480986cb400352ead643 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:45:18.686903 6016 raft_consensus.cc:482] T 2ca7550dff1e49fa8a6d9da33115a0c8 P efff2a3b1734480986cb400352ead643 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:45:18.686924 6016 raft_consensus.cc:3037] T 2ca7550dff1e49fa8a6d9da33115a0c8 P efff2a3b1734480986cb400352ead643 [term 0 FOLLOWER]: Advancing to term 1
W20260808 14:45:18.687412 5790 tablet.cc:2369] T 2ca7550dff1e49fa8a6d9da33115a0c8 P efff2a3b1734480986cb400352ead643: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:45:18.687657 6016 raft_consensus.cc:504] T 2ca7550dff1e49fa8a6d9da33115a0c8 P efff2a3b1734480986cb400352ead643 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f91016305b4125876aad42840ac953" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 45135 } } peers { permanent_uuid: "6527930040ec4ac0abc8cefc60130aeb" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40291 } } peers { permanent_uuid: "efff2a3b1734480986cb400352ead643" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 41763 } }
I20260808 14:45:18.687789 6016 leader_election.cc:288] T 2ca7550dff1e49fa8a6d9da33115a0c8 P efff2a3b1734480986cb400352ead643 [CANDIDATE]: Term 1 election: Requested vote from peers 13f91016305b4125876aad42840ac953 (127.30.214.129:45135), 6527930040ec4ac0abc8cefc60130aeb (127.30.214.131:40291)
I20260808 14:45:18.687929 5514 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ca7550dff1e49fa8a6d9da33115a0c8" candidate_uuid: "efff2a3b1734480986cb400352ead643" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13f91016305b4125876aad42840ac953"
I20260808 14:45:18.687964 5922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ca7550dff1e49fa8a6d9da33115a0c8" candidate_uuid: "efff2a3b1734480986cb400352ead643" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6527930040ec4ac0abc8cefc60130aeb"
I20260808 14:45:18.688031 5922 raft_consensus.cc:3037] T 2ca7550dff1e49fa8a6d9da33115a0c8 P 6527930040ec4ac0abc8cefc60130aeb [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:18.688016 5514 raft_consensus.cc:3037] T 2ca7550dff1e49fa8a6d9da33115a0c8 P 13f91016305b4125876aad42840ac953 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:18.688896 5514 raft_consensus.cc:2454] T 2ca7550dff1e49fa8a6d9da33115a0c8 P 13f91016305b4125876aad42840ac953 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efff2a3b1734480986cb400352ead643 in term 1.
I20260808 14:45:18.688896 5922 raft_consensus.cc:2454] T 2ca7550dff1e49fa8a6d9da33115a0c8 P 6527930040ec4ac0abc8cefc60130aeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efff2a3b1734480986cb400352ead643 in term 1.
I20260808 14:45:18.689056 5617 leader_election.cc:302] T 2ca7550dff1e49fa8a6d9da33115a0c8 P efff2a3b1734480986cb400352ead643 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13f91016305b4125876aad42840ac953, efff2a3b1734480986cb400352ead643; no voters:
I20260808 14:45:18.689157 6016 raft_consensus.cc:2781] T 2ca7550dff1e49fa8a6d9da33115a0c8 P efff2a3b1734480986cb400352ead643 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:45:18.689306 6016 raft_consensus.cc:686] T 2ca7550dff1e49fa8a6d9da33115a0c8 P efff2a3b1734480986cb400352ead643 [term 1 LEADER]: Becoming Leader. State: Replica: efff2a3b1734480986cb400352ead643, State: Running, Role: LEADER
I20260808 14:45:18.689388 6016 consensus_queue.cc:237] T 2ca7550dff1e49fa8a6d9da33115a0c8 P efff2a3b1734480986cb400352ead643 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f91016305b4125876aad42840ac953" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 45135 } } peers { permanent_uuid: "6527930040ec4ac0abc8cefc60130aeb" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40291 } } peers { permanent_uuid: "efff2a3b1734480986cb400352ead643" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 41763 } }
I20260808 14:45:18.690265 5298 catalog_manager.cc:5495] T 2ca7550dff1e49fa8a6d9da33115a0c8 P efff2a3b1734480986cb400352ead643 reported cstate change: term changed from 0 to 1, leader changed from <none> to efff2a3b1734480986cb400352ead643 (127.30.214.130). New cstate: current_term: 1 leader_uuid: "efff2a3b1734480986cb400352ead643" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f91016305b4125876aad42840ac953" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 45135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6527930040ec4ac0abc8cefc60130aeb" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efff2a3b1734480986cb400352ead643" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 41763 } health_report { overall_health: HEALTHY } } }
I20260808 14:45:18.700929 6003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:18.698840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48834 (local address 127.30.214.130:41763)
0808 14:45:18.698894 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:18.698896 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:18.698905 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:45:18.698949 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:18.698950 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:18.698967 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:18.699025 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:45:18.699148 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:18.699627 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:18.700330 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:18.700516 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:18.700561 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:18.700663 (+ 102us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:45:18.700761 (+ 98us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:45:18.700814 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:18.700826 (+ 12us) server_negotiation.cc:299] Negotiation successful
0808 14:45:18.700842 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 14:45:18.702821 5514 raft_consensus.cc:1261] T 2ca7550dff1e49fa8a6d9da33115a0c8 P 13f91016305b4125876aad42840ac953 [term 1 FOLLOWER]: Refusing update from remote peer efff2a3b1734480986cb400352ead643: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:45:18.702821 5922 raft_consensus.cc:1261] T 2ca7550dff1e49fa8a6d9da33115a0c8 P 6527930040ec4ac0abc8cefc60130aeb [term 1 FOLLOWER]: Refusing update from remote peer efff2a3b1734480986cb400352ead643: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:45:18.703217 6016 consensus_queue.cc:1035] T 2ca7550dff1e49fa8a6d9da33115a0c8 P efff2a3b1734480986cb400352ead643 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6527930040ec4ac0abc8cefc60130aeb" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:45:18.703369 6023 consensus_queue.cc:1035] T 2ca7550dff1e49fa8a6d9da33115a0c8 P efff2a3b1734480986cb400352ead643 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f91016305b4125876aad42840ac953" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 45135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:45:18.705981 6029 mvcc.cc:205] Tried to move back new op lower bound from 7316276505403805696 to 7316276505352429568. Current Snapshot: MvccSnapshot[applied={T|T < 7316276505403805696}]
I20260808 14:45:18.708642 5298 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34924:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:45:18.708742 5298 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34924:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:45:18.709509 5298 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 25939f1398844117ab5c15f61d3d96a5: Sending DeleteTablet for 3 replicas of tablet 2ca7550dff1e49fa8a6d9da33115a0c8
I20260808 14:45:18.709856 5688 tablet_service.cc:1514] Processing DeleteTablet for tablet 2ca7550dff1e49fa8a6d9da33115a0c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:45:18 UTC) from {username='kudu', principal='kudu/127.30.214.190@KRBTEST.COM'} at 127.0.0.1:48828
I20260808 14:45:18.709906 5486 tablet_service.cc:1514] Processing DeleteTablet for tablet 2ca7550dff1e49fa8a6d9da33115a0c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:45:18 UTC) from {username='kudu', principal='kudu/127.30.214.190@KRBTEST.COM'} at 127.0.0.1:46970
I20260808 14:45:18.710136 5892 tablet_service.cc:1514] Processing DeleteTablet for tablet 2ca7550dff1e49fa8a6d9da33115a0c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:45:18 UTC) from {username='kudu', principal='kudu/127.30.214.190@KRBTEST.COM'} at 127.0.0.1:48438
I20260808 14:45:18.710368 6043 tablet_replica.cc:330] T 2ca7550dff1e49fa8a6d9da33115a0c8 P efff2a3b1734480986cb400352ead643: stopping tablet replica
I20260808 14:45:18.710371 6045 tablet_replica.cc:330] T 2ca7550dff1e49fa8a6d9da33115a0c8 P 6527930040ec4ac0abc8cefc60130aeb: stopping tablet replica
I20260808 14:45:18.710440 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 5390
I20260808 14:45:18.710482 6045 raft_consensus.cc:2229] T 2ca7550dff1e49fa8a6d9da33115a0c8 P 6527930040ec4ac0abc8cefc60130aeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:45:18.710536 6044 tablet_replica.cc:330] T 2ca7550dff1e49fa8a6d9da33115a0c8 P 13f91016305b4125876aad42840ac953: stopping tablet replica
I20260808 14:45:18.710592 6045 raft_consensus.cc:2258] T 2ca7550dff1e49fa8a6d9da33115a0c8 P 6527930040ec4ac0abc8cefc60130aeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:45:18.710633 6044 raft_consensus.cc:2229] T 2ca7550dff1e49fa8a6d9da33115a0c8 P 13f91016305b4125876aad42840ac953 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:45:18.710726 6044 raft_consensus.cc:2258] T 2ca7550dff1e49fa8a6d9da33115a0c8 P 13f91016305b4125876aad42840ac953 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:45:18.710850 6043 raft_consensus.cc:2229] T 2ca7550dff1e49fa8a6d9da33115a0c8 P efff2a3b1734480986cb400352ead643 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:45:18.710968 6043 raft_consensus.cc:2258] T 2ca7550dff1e49fa8a6d9da33115a0c8 P efff2a3b1734480986cb400352ead643 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:45:18.711102 6045 ts_tablet_manager.cc:1905] T 2ca7550dff1e49fa8a6d9da33115a0c8 P 6527930040ec4ac0abc8cefc60130aeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:45:18.712868 6045 ts_tablet_manager.cc:1918] T 2ca7550dff1e49fa8a6d9da33115a0c8 P 6527930040ec4ac0abc8cefc60130aeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:45:18.712960 6045 log.cc:1196] T 2ca7550dff1e49fa8a6d9da33115a0c8 P 6527930040ec4ac0abc8cefc60130aeb: Deleting WAL directory at /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/minicluster-data/ts-2/wal/wals/2ca7550dff1e49fa8a6d9da33115a0c8
I20260808 14:45:18.713248 6045 ts_tablet_manager.cc:1939] T 2ca7550dff1e49fa8a6d9da33115a0c8 P 6527930040ec4ac0abc8cefc60130aeb: Deleting consensus metadata
I20260808 14:45:18.713361 6043 ts_tablet_manager.cc:1905] T 2ca7550dff1e49fa8a6d9da33115a0c8 P efff2a3b1734480986cb400352ead643: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:45:18.713726 5275 catalog_manager.cc:4841] TS 6527930040ec4ac0abc8cefc60130aeb (127.30.214.131:40291): tablet 2ca7550dff1e49fa8a6d9da33115a0c8 (table test-table [id=78f3b7434f89466698daaa53b5a7329e]) successfully deleted
I20260808 14:45:18.715081 6043 ts_tablet_manager.cc:1918] T 2ca7550dff1e49fa8a6d9da33115a0c8 P efff2a3b1734480986cb400352ead643: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:45:18.715162 6043 log.cc:1196] T 2ca7550dff1e49fa8a6d9da33115a0c8 P efff2a3b1734480986cb400352ead643: Deleting WAL directory at /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786200295877777-31578-0/minicluster-data/ts-1/wal/wals/2ca7550dff1e49fa8a6d9da33115a0c8
I20260808 14:45:18.715498 6043 ts_tablet_manager.cc:1939] T 2ca7550dff1e49fa8a6d9da33115a0c8 P efff2a3b1734480986cb400352ead643: Deleting consensus metadata
I20260808 14:45:18.716064 5277 catalog_manager.cc:4841] TS efff2a3b1734480986cb400352ead643 (127.30.214.130:41763): tablet 2ca7550dff1e49fa8a6d9da33115a0c8 (table test-table [id=78f3b7434f89466698daaa53b5a7329e]) successfully deleted
W20260808 14:45:18.724740 5278 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.30.214.129:45135 (error 108)
I20260808 14:45:18.724874 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 5593
I20260808 14:45:18.727530 5999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:18.725219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.129:45135 (local address 127.0.0.1:46976)
0808 14:45:18.727401 (+ 2182us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:18.727478 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.129:45135: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2150}
W20260808 14:45:18.729393 5278 catalog_manager.cc:4584] TS 13f91016305b4125876aad42840ac953 (127.30.214.129:45135): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 2ca7550dff1e49fa8a6d9da33115a0c8: Network error: Client connection negotiation failed: client connection to 127.30.214.129:45135: connect: Connection refused (error 111)
I20260808 14:45:18.733865 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 5794
I20260808 14:45:18.751075 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 5251
2026-08-08T14:45:18Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2080 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-08T14:45:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:45:18Z Disabled control of system clock
I20260808 14:45:18.789034 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200295877777-31578-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200295877777-31578-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200295877777-31578-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:34781
--webserver_interface=127.30.214.190
--webserver_port=0
--builtin_ntp_servers=127.30.214.148:34507
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.214.190:34781
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 14:45:18.871459 6054 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:45:18.871708 6054 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:45:18.871731 6054 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:45:18.872988 6054 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:45:18.873044 6054 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:45:18.873055 6054 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:45:18.873067 6054 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:45:18.873078 6054 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:45:18.874610 6054 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:34507
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200295877777-31578-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200295877777-31578-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.214.190:34781
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:34781
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6054
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200295877777-31578-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:45:18.874889 6054 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:45:18.875221 6054 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:45:18.880106 6064 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:18.880119 6063 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:18.880128 6067 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:18.880271 6054 server_base.cc:1034] running on GCE node
I20260808 14:45:18.880614 6054 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:45:18.880936 6054 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:45:18.882085 6054 hybrid_clock.cc:648] HybridClock initialized: now 1786200318882067 us; error 39 us; skew 500 ppm
I20260808 14:45:18.883402 6054 webserver.cc:460] Webserver started at http://127.30.214.190:40697/ using document root <none> and password file <none>
I20260808 14:45:18.883626 6054 fs_manager.cc:359] Metadata directory not provided
I20260808 14:45:18.883675 6054 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:45:18.883805 6054 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:45:18.884868 6054 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200295877777-31578-0/minicluster-data/master-0/data/instance:
uuid: "2b0823881f9f4e14a503940502ffcd43"
format_stamp: "Formatted at 2026-08-08 14:45:18 on dist-test-slave-42z9"
server_key: "42ab1fd6f282d80e01478bda63a22b34"
server_key_iv: "760c407ea3bdfa17767c166d4983a487"
server_key_version: "encryptionkey@0"
I20260808 14:45:18.885223 6054 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200295877777-31578-0/minicluster-data/master-0/wal/instance:
uuid: "2b0823881f9f4e14a503940502ffcd43"
format_stamp: "Formatted at 2026-08-08 14:45:18 on dist-test-slave-42z9"
server_key: "42ab1fd6f282d80e01478bda63a22b34"
server_key_iv: "760c407ea3bdfa17767c166d4983a487"
server_key_version: "encryptionkey@0"
I20260808 14:45:18.886551 6054 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 14:45:18.887271 6079 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:18.887421 6054 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:45:18.887519 6054 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200295877777-31578-0/minicluster-data/master-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200295877777-31578-0/minicluster-data/master-0/wal
uuid: "2b0823881f9f4e14a503940502ffcd43"
format_stamp: "Formatted at 2026-08-08 14:45:18 on dist-test-slave-42z9"
server_key: "42ab1fd6f282d80e01478bda63a22b34"
server_key_iv: "760c407ea3bdfa17767c166d4983a487"
server_key_version: "encryptionkey@0"
I20260808 14:45:18.887599 6054 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200295877777-31578-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200295877777-31578-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200295877777-31578-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:45:18.891067 6054 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:45:18.891363 6054 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:45:18.891489 6054 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:45:18.895354 6054 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.190:34781
I20260808 14:45:18.895390 6167 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.190:34781 every 8 connection(s)
I20260808 14:45:18.895705 6054 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
I20260808 14:45:18.896368 6170 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:45:18.899387 6170 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2b0823881f9f4e14a503940502ffcd43: Bootstrap starting.
I20260808 14:45:18.899976 6170 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2b0823881f9f4e14a503940502ffcd43: Neither blocks nor log segments found. Creating new log.
I20260808 14:45:18.900223 6170 log.cc:824] T 00000000000000000000000000000000 P 2b0823881f9f4e14a503940502ffcd43: Log is configured to *not* fsync() on all Append() calls
I20260808 14:45:18.900884 6170 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2b0823881f9f4e14a503940502ffcd43: No bootstrap required, opened a new log
I20260808 14:45:18.902522 6170 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2b0823881f9f4e14a503940502ffcd43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b0823881f9f4e14a503940502ffcd43" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 34781 } }
I20260808 14:45:18.902678 6170 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2b0823881f9f4e14a503940502ffcd43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:45:18.902699 6170 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2b0823881f9f4e14a503940502ffcd43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b0823881f9f4e14a503940502ffcd43, State: Initialized, Role: FOLLOWER
I20260808 14:45:18.902810 6170 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2b0823881f9f4e14a503940502ffcd43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b0823881f9f4e14a503940502ffcd43" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 34781 } }
I20260808 14:45:18.902864 6170 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2b0823881f9f4e14a503940502ffcd43 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:45:18.902884 6170 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2b0823881f9f4e14a503940502ffcd43 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:45:18.902917 6170 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2b0823881f9f4e14a503940502ffcd43 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:18.903488 6170 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2b0823881f9f4e14a503940502ffcd43 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b0823881f9f4e14a503940502ffcd43" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 34781 } }
I20260808 14:45:18.903584 6170 leader_election.cc:302] T 00000000000000000000000000000000 P 2b0823881f9f4e14a503940502ffcd43 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2b0823881f9f4e14a503940502ffcd43; no voters:
I20260808 14:45:18.903659 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 6054
I20260808 14:45:18.903759 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200295877777-31578-0/minicluster-data/master-0/wal/instance
I20260808 14:45:18.903754 6170 leader_election.cc:288] T 00000000000000000000000000000000 P 2b0823881f9f4e14a503940502ffcd43 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:45:18.903810 6173 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2b0823881f9f4e14a503940502ffcd43 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:45:18.903934 6173 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2b0823881f9f4e14a503940502ffcd43 [term 1 LEADER]: Becoming Leader. State: Replica: 2b0823881f9f4e14a503940502ffcd43, State: Running, Role: LEADER
I20260808 14:45:18.903945 31578 external_mini_cluster.cc:1428] Setting key 688135fcd8a8f2242b6da1f04988011e
I20260808 14:45:18.904037 6170 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2b0823881f9f4e14a503940502ffcd43 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:45:18.904095 6173 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2b0823881f9f4e14a503940502ffcd43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b0823881f9f4e14a503940502ffcd43" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 34781 } }
I20260808 14:45:18.904771 6176 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b0823881f9f4e14a503940502ffcd43 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2b0823881f9f4e14a503940502ffcd43. Latest consensus state: current_term: 1 leader_uuid: "2b0823881f9f4e14a503940502ffcd43" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b0823881f9f4e14a503940502ffcd43" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 34781 } } }
I20260808 14:45:18.904860 6176 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b0823881f9f4e14a503940502ffcd43 [sys.catalog]: This master's current role is: LEADER
I20260808 14:45:18.905184 6174 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b0823881f9f4e14a503940502ffcd43 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2b0823881f9f4e14a503940502ffcd43" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b0823881f9f4e14a503940502ffcd43" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 34781 } } }
I20260808 14:45:18.905264 6174 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b0823881f9f4e14a503940502ffcd43 [sys.catalog]: This master's current role is: LEADER
W20260808 14:45:18.906313 6194 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2b0823881f9f4e14a503940502ffcd43: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:45:18.906384 6194 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:45:18.906476 6187 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:45:18.906535 6181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:18.904460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42466 (local address 127.30.214.190:34781)
0808 14:45:18.904666 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:18.904676 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:18.904714 (+ 38us) server_negotiation.cc:407] Connection header received
0808 14:45:18.904834 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:18.904841 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:18.904888 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:18.905582 (+ 694us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:18.905974 (+ 392us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:18.905976 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:18.905977 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:45:18.905979 (+ 2us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:18.906007 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:45:18.906016 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:18.906081 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:18.906251 (+ 170us) server_negotiation.cc:299] Negotiation successful
0808 14:45:18.906308 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":77,"threads_started":1}
I20260808 14:45:18.906670 6187 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:45:18.908048 6187 catalog_manager.cc:1347] Generated new cluster ID: c71535cad4c24bc491c1e9080720819e
I20260808 14:45:18.908109 6187 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:45:18.932503 6187 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:45:18.932713 6187 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:45:18.935999 6187 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2b0823881f9f4e14a503940502ffcd43: Generated new TSK 0
I20260808 14:45:18.936188 6187 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:45:18.947389 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200295877777-31578-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200295877777-31578-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200295877777-31578-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.129:0
--local_ip_for_outbound_sockets=127.30.214.129
--webserver_interface=127.30.214.129
--webserver_port=0
--tserver_master_addrs=127.30.214.190:34781
--builtin_ntp_servers=127.30.214.148:34507
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 14:45:19.049060 6200 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:45:19.049293 6200 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:45:19.049317 6200 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:45:19.050597 6200 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:45:19.050649 6200 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:45:19.050678 6200 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.129
I20260808 14:45:19.052148 6200 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:34507
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200295877777-31578-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200295877777-31578-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.214.129
--webserver_port=0
--tserver_master_addrs=127.30.214.190:34781
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6200
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.129
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200295877777-31578-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:45:19.052426 6200 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:45:19.052743 6200 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:45:19.057790 6217 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:19.057775 6211 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:19.057762 6214 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:19.058175 6200 server_base.cc:1034] running on GCE node
I20260808 14:45:19.058367 6200 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:45:19.058615 6200 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:45:19.059806 6200 hybrid_clock.cc:648] HybridClock initialized: now 1786200319059788 us; error 36 us; skew 500 ppm
I20260808 14:45:19.061137 6200 webserver.cc:460] Webserver started at http://127.30.214.129:44995/ using document root <none> and password file <none>
I20260808 14:45:19.061389 6200 fs_manager.cc:359] Metadata directory not provided
I20260808 14:45:19.061470 6200 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:45:19.061625 6200 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:45:19.062732 6200 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200295877777-31578-0/minicluster-data/ts-0/data/instance:
uuid: "a95d6ac2458a4b4aa375292cb7f4bd63"
format_stamp: "Formatted at 2026-08-08 14:45:19 on dist-test-slave-42z9"
server_key: "afcac76facbbf603a6357f2ce7dc7abf"
server_key_iv: "86ce4e2a5cbce1841b522932ee8df95e"
server_key_version: "encryptionkey@0"
I20260808 14:45:19.063077 6200 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200295877777-31578-0/minicluster-data/ts-0/wal/instance:
uuid: "a95d6ac2458a4b4aa375292cb7f4bd63"
format_stamp: "Formatted at 2026-08-08 14:45:19 on dist-test-slave-42z9"
server_key: "afcac76facbbf603a6357f2ce7dc7abf"
server_key_iv: "86ce4e2a5cbce1841b522932ee8df95e"
server_key_version: "encryptionkey@0"
I20260808 14:45:19.064342 6200 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 14:45:19.065033 6227 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:19.065183 6200 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:45:19.065269 6200 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200295877777-31578-0/minicluster-data/ts-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200295877777-31578-0/minicluster-data/ts-0/wal
uuid: "a95d6ac2458a4b4aa375292cb7f4bd63"
format_stamp: "Formatted at 2026-08-08 14:45:19 on dist-test-slave-42z9"
server_key: "afcac76facbbf603a6357f2ce7dc7abf"
server_key_iv: "86ce4e2a5cbce1841b522932ee8df95e"
server_key_version: "encryptionkey@0"
I20260808 14:45:19.065343 6200 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200295877777-31578-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200295877777-31578-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200295877777-31578-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:45:19.068708 6200 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:45:19.068974 6200 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:45:19.069097 6200 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:45:19.069289 6200 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:45:19.069654 6200 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:45:19.069691 6200 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:19.069718 6200 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:45:19.069742 6200 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:19.075289 6200 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.129:45037
I20260808 14:45:19.075341 6387 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.129:45037 every 8 connection(s)
I20260808 14:45:19.075680 6200 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
I20260808 14:45:19.078681 6181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:19.076391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.129:35897 (local address 127.30.214.190:34781)
0808 14:45:19.076454 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:19.076456 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:19.076690 (+ 234us) server_negotiation.cc:407] Connection header received
0808 14:45:19.077197 (+ 507us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:19.077198 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:19.077207 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:19.077259 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:19.078435 (+ 1176us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:19.078437 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:19.078437 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:45:19.078442 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:19.078459 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:45:19.078464 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:19.078514 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:19.078587 (+ 73us) server_negotiation.cc:299] Negotiation successful
0808 14:45:19.078604 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 14:45:19.078883 6390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:19.076363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:34781 (local address 127.30.214.129:35897)
0808 14:45:19.076569 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:19.076605 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:19.077094 (+ 489us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:19.077330 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:19.077334 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:19.077343 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:19.078281 (+ 938us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:45:19.078281 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:19.078311 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:45:19.078341 (+ 30us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:19.078518 (+ 177us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:19.078524 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:19.078527 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:45:19.078599 (+ 72us) client_negotiation.cc:240] Negotiation successful
0808 14:45:19.078667 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":98,"threads_started":1}
I20260808 14:45:19.079357 6388 heartbeater.cc:347] Connected to a master server at 127.30.214.190:34781
I20260808 14:45:19.079447 6388 heartbeater.cc:464] Registering TS with master...
I20260808 14:45:19.079607 6388 heartbeater.cc:511] Master 127.30.214.190:34781 requested a full tablet report, sending...
I20260808 14:45:19.080087 6105 ts_manager.cc:194] Registered new tserver with Master: a95d6ac2458a4b4aa375292cb7f4bd63 (127.30.214.129:45037)
I20260808 14:45:19.083722 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 6200
I20260808 14:45:19.083820 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200295877777-31578-0/minicluster-data/ts-0/wal/instance
I20260808 14:45:19.083977 31578 external_mini_cluster.cc:1428] Setting key 85e0ed458691dc298c1f5506cdf65095
I20260808 14:45:19.084872 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200295877777-31578-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200295877777-31578-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200295877777-31578-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.130:0
--local_ip_for_outbound_sockets=127.30.214.130
--webserver_interface=127.30.214.130
--webserver_port=0
--tserver_master_addrs=127.30.214.190:34781
--builtin_ntp_servers=127.30.214.148:34507
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 14:45:19.170027 6391 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:45:19.170282 6391 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:45:19.170310 6391 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:45:19.171581 6391 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:45:19.171633 6391 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:45:19.171661 6391 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.130
I20260808 14:45:19.173105 6391 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:34507
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200295877777-31578-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200295877777-31578-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.214.130
--webserver_port=0
--tserver_master_addrs=127.30.214.190:34781
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6391
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.130
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200295877777-31578-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:45:19.173370 6391 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:45:19.173837 6391 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:45:19.178872 6400 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:19.178862 6403 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:19.178885 6401 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:19.179425 6391 server_base.cc:1034] running on GCE node
I20260808 14:45:19.179628 6391 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:45:19.179876 6391 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:45:19.181064 6391 hybrid_clock.cc:648] HybridClock initialized: now 1786200319181047 us; error 24 us; skew 500 ppm
I20260808 14:45:19.182444 6391 webserver.cc:460] Webserver started at http://127.30.214.130:44285/ using document root <none> and password file <none>
I20260808 14:45:19.182699 6391 fs_manager.cc:359] Metadata directory not provided
I20260808 14:45:19.182752 6391 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:45:19.182893 6391 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:45:19.184008 6391 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200295877777-31578-0/minicluster-data/ts-1/data/instance:
uuid: "b76d2721edd8410aa89b03448e5e2d99"
format_stamp: "Formatted at 2026-08-08 14:45:19 on dist-test-slave-42z9"
server_key: "ec35ab91af5bb8781375f472181a046d"
server_key_iv: "63f74ef50c15e6ddd07782bdfe34347e"
server_key_version: "encryptionkey@0"
I20260808 14:45:19.184360 6391 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200295877777-31578-0/minicluster-data/ts-1/wal/instance:
uuid: "b76d2721edd8410aa89b03448e5e2d99"
format_stamp: "Formatted at 2026-08-08 14:45:19 on dist-test-slave-42z9"
server_key: "ec35ab91af5bb8781375f472181a046d"
server_key_iv: "63f74ef50c15e6ddd07782bdfe34347e"
server_key_version: "encryptionkey@0"
I20260808 14:45:19.185680 6391 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:45:19.186375 6416 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:19.186537 6391 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:45:19.186623 6391 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200295877777-31578-0/minicluster-data/ts-1/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200295877777-31578-0/minicluster-data/ts-1/wal
uuid: "b76d2721edd8410aa89b03448e5e2d99"
format_stamp: "Formatted at 2026-08-08 14:45:19 on dist-test-slave-42z9"
server_key: "ec35ab91af5bb8781375f472181a046d"
server_key_iv: "63f74ef50c15e6ddd07782bdfe34347e"
server_key_version: "encryptionkey@0"
I20260808 14:45:19.186691 6391 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200295877777-31578-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200295877777-31578-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200295877777-31578-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:45:19.190151 6391 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:45:19.190416 6391 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:45:19.190549 6391 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:45:19.190743 6391 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:45:19.191066 6391 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:45:19.191109 6391 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:19.191136 6391 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:45:19.191164 6391 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:19.196749 6391 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.130:39457
I20260808 14:45:19.196794 6592 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.130:39457 every 8 connection(s)
I20260808 14:45:19.197120 6391 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
I20260808 14:45:19.200312 6181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:19.197881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.130:56819 (local address 127.30.214.190:34781)
0808 14:45:19.197944 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:19.197946 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:19.198166 (+ 220us) server_negotiation.cc:407] Connection header received
0808 14:45:19.198664 (+ 498us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:19.198665 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:19.198673 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:19.198733 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:19.200038 (+ 1305us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:19.200040 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:19.200040 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:45:19.200045 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:19.200063 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:45:19.200068 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:19.200119 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:19.200194 (+ 75us) server_negotiation.cc:299] Negotiation successful
0808 14:45:19.200211 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 14:45:19.200471 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 6391
I20260808 14:45:19.200505 6599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:19.197855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:34781 (local address 127.30.214.130:56819)
0808 14:45:19.198045 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:19.198085 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:19.198560 (+ 475us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:19.198810 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:19.198814 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:19.198823 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:19.199859 (+ 1036us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:45:19.199860 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:19.199891 (+ 31us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:45:19.199923 (+ 32us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:19.200123 (+ 200us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:19.200128 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:19.200131 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:45:19.200201 (+ 70us) client_negotiation.cc:240] Negotiation successful
0808 14:45:19.200268 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":89,"threads_started":1}
I20260808 14:45:19.200591 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200295877777-31578-0/minicluster-data/ts-1/wal/instance
I20260808 14:45:19.200757 31578 external_mini_cluster.cc:1428] Setting key c61f81bb85719252395fde5832302e47
I20260808 14:45:19.201046 6593 heartbeater.cc:347] Connected to a master server at 127.30.214.190:34781
I20260808 14:45:19.201145 6593 heartbeater.cc:464] Registering TS with master...
I20260808 14:45:19.201295 6593 heartbeater.cc:511] Master 127.30.214.190:34781 requested a full tablet report, sending...
I20260808 14:45:19.201706 6105 ts_manager.cc:194] Registered new tserver with Master: b76d2721edd8410aa89b03448e5e2d99 (127.30.214.130:39457)
I20260808 14:45:19.201767 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200295877777-31578-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200295877777-31578-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200295877777-31578-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.131:0
--local_ip_for_outbound_sockets=127.30.214.131
--webserver_interface=127.30.214.131
--webserver_port=0
--tserver_master_addrs=127.30.214.190:34781
--builtin_ntp_servers=127.30.214.148:34507
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 14:45:19.285799 6603 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:45:19.286016 6603 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:45:19.286041 6603 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:45:19.287257 6603 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:45:19.287305 6603 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:45:19.287336 6603 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.131
I20260808 14:45:19.288756 6603 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:34507
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200295877777-31578-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200295877777-31578-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.214.131
--webserver_port=0
--tserver_master_addrs=127.30.214.190:34781
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6603
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.131
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200295877777-31578-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:45:19.289037 6603 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:45:19.289376 6603 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:45:19.294641 6610 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:19.294791 6603 server_base.cc:1034] running on GCE node
W20260808 14:45:19.294668 6614 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:19.294668 6609 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:19.295125 6603 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:45:19.295374 6603 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:45:19.296535 6603 hybrid_clock.cc:648] HybridClock initialized: now 1786200319296515 us; error 31 us; skew 500 ppm
I20260808 14:45:19.297928 6603 webserver.cc:460] Webserver started at http://127.30.214.131:43641/ using document root <none> and password file <none>
I20260808 14:45:19.298170 6603 fs_manager.cc:359] Metadata directory not provided
I20260808 14:45:19.298218 6603 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:45:19.298352 6603 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:45:19.299448 6603 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200295877777-31578-0/minicluster-data/ts-2/data/instance:
uuid: "87bedf03b5c5491499dbbc5de1e30750"
format_stamp: "Formatted at 2026-08-08 14:45:19 on dist-test-slave-42z9"
server_key: "e18f4747f7b855d6936f60f70faf279c"
server_key_iv: "4d4dd991d62be53965be178de20c62f0"
server_key_version: "encryptionkey@0"
I20260808 14:45:19.299784 6603 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200295877777-31578-0/minicluster-data/ts-2/wal/instance:
uuid: "87bedf03b5c5491499dbbc5de1e30750"
format_stamp: "Formatted at 2026-08-08 14:45:19 on dist-test-slave-42z9"
server_key: "e18f4747f7b855d6936f60f70faf279c"
server_key_iv: "4d4dd991d62be53965be178de20c62f0"
server_key_version: "encryptionkey@0"
I20260808 14:45:19.301029 6603 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 14:45:19.301767 6624 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:19.301903 6603 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:45:19.301988 6603 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200295877777-31578-0/minicluster-data/ts-2/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200295877777-31578-0/minicluster-data/ts-2/wal
uuid: "87bedf03b5c5491499dbbc5de1e30750"
format_stamp: "Formatted at 2026-08-08 14:45:19 on dist-test-slave-42z9"
server_key: "e18f4747f7b855d6936f60f70faf279c"
server_key_iv: "4d4dd991d62be53965be178de20c62f0"
server_key_version: "encryptionkey@0"
I20260808 14:45:19.302053 6603 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200295877777-31578-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200295877777-31578-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200295877777-31578-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:45:19.305652 6603 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:45:19.305919 6603 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:45:19.306038 6603 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:45:19.306232 6603 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:45:19.306538 6603 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:45:19.306581 6603 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:19.306609 6603 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:45:19.306634 6603 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:19.312443 6603 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.131:44603
I20260808 14:45:19.312515 6806 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.131:44603 every 8 connection(s)
I20260808 14:45:19.312851 6603 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
I20260808 14:45:19.315915 6181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:19.313631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:46099 (local address 127.30.214.190:34781)
0808 14:45:19.313693 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:19.313695 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:19.313935 (+ 240us) server_negotiation.cc:407] Connection header received
0808 14:45:19.314438 (+ 503us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:19.314439 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:19.314447 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:19.314502 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:19.315657 (+ 1155us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:19.315659 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:19.315660 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:45:19.315665 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:19.315682 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:45:19.315686 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:19.315737 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:19.315810 (+ 73us) server_negotiation.cc:299] Negotiation successful
0808 14:45:19.315828 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 14:45:19.316097 6810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:19.313622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:34781 (local address 127.30.214.131:46099)
0808 14:45:19.313818 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:19.313853 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:19.314330 (+ 477us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:19.314574 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:19.314578 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:19.314587 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:19.315500 (+ 913us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:45:19.315501 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:19.315532 (+ 31us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:45:19.315562 (+ 30us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:19.315741 (+ 179us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:19.315746 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:19.315750 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:45:19.315817 (+ 67us) client_negotiation.cc:240] Negotiation successful
0808 14:45:19.315883 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":85,"threads_started":1}
I20260808 14:45:19.316593 6808 heartbeater.cc:347] Connected to a master server at 127.30.214.190:34781
I20260808 14:45:19.316684 6808 heartbeater.cc:464] Registering TS with master...
I20260808 14:45:19.316838 6808 heartbeater.cc:511] Master 127.30.214.190:34781 requested a full tablet report, sending...
I20260808 14:45:19.317198 6105 ts_manager.cc:194] Registered new tserver with Master: 87bedf03b5c5491499dbbc5de1e30750 (127.30.214.131:44603)
I20260808 14:45:19.317651 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 6603
I20260808 14:45:19.317755 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200295877777-31578-0/minicluster-data/ts-2/wal/instance
I20260808 14:45:19.317924 31578 external_mini_cluster.cc:1428] Setting key cba56d6ddd927ffcb9454add25850db6
I20260808 14:45:19.318692 31578 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:45:19.320844 6181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:19.319980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42474 (local address 127.30.214.190:34781)
0808 14:45:19.320049 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:19.320050 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:19.320116 (+ 66us) server_negotiation.cc:407] Connection header received
0808 14:45:19.320161 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:19.320162 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:19.320166 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:19.320209 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:19.320675 (+ 466us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:19.320676 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:19.320676 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:45:19.320679 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:19.320694 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:45:19.320698 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:19.320732 (+ 34us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:19.320765 (+ 33us) server_negotiation.cc:299] Negotiation successful
0808 14:45:19.320777 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 14:45:19.322269 6105 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42474:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:45:19.323779 6105 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:45:19.327492 6823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:19.326100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57656 (local address 127.30.214.129:45037)
0808 14:45:19.326289 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:19.326295 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:19.326306 (+ 11us) server_negotiation.cc:407] Connection header received
0808 14:45:19.326334 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:19.326337 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:19.326347 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:19.326679 (+ 332us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:19.327205 (+ 526us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:19.327210 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:19.327210 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:45:19.327214 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:19.327248 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:45:19.327266 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:19.327327 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:19.327411 (+ 84us) server_negotiation.cc:299] Negotiation successful
0808 14:45:19.327426 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":93,"threads_started":1}
I20260808 14:45:19.327481 6821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:19.325818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.129:45037 (local address 127.0.0.1:57656)
0808 14:45:19.326006 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:19.326016 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:19.326064 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:19.326453 (+ 389us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:19.326454 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:19.326457 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:19.327054 (+ 597us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:45:19.327055 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:19.327062 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:45:19.327077 (+ 15us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:19.327322 (+ 245us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:19.327329 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:19.327332 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:45:19.327399 (+ 67us) client_negotiation.cc:240] Negotiation successful
0808 14:45:19.327409 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"mutex_wait_us":2,"spinlock_wait_cycles":768,"thread_start_us":112,"threads_started":1}
I20260808 14:45:19.327489 6819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:19.325818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.131:44603 (local address 127.0.0.1:34322)
0808 14:45:19.325951 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:19.325993 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:19.326052 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:19.326439 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:19.326446 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:19.326453 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:19.327009 (+ 556us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:45:19.327009 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:19.327026 (+ 17us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:45:19.327051 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:19.327353 (+ 302us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:19.327354 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:19.327355 (+ 1us) client_negotiation.cc:769] Sending connection context
0808 14:45:19.327383 (+ 28us) client_negotiation.cc:240] Negotiation successful
0808 14:45:19.327397 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":95,"threads_started":1}
I20260808 14:45:19.327659 6822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:19.326099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34322 (local address 127.30.214.131:44603)
0808 14:45:19.326274 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:19.326278 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:19.326290 (+ 12us) server_negotiation.cc:407] Connection header received
0808 14:45:19.326317 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:19.326320 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:19.326330 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:19.326677 (+ 347us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:19.327232 (+ 555us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:19.327235 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:19.327235 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:45:19.327239 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:19.327268 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:45:19.327282 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:19.327528 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:19.327552 (+ 24us) server_negotiation.cc:299] Negotiation successful
0808 14:45:19.327577 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":80,"threads_started":1}
I20260808 14:45:19.328083 6820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:19.325822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.130:39457 (local address 127.0.0.1:56658)
0808 14:45:19.326347 (+ 525us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:19.326357 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:19.326418 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:19.327076 (+ 658us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:19.327077 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:19.327080 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:19.327732 (+ 652us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:45:19.327732 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:19.327739 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:45:19.327751 (+ 12us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:19.327950 (+ 199us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:19.327951 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:19.327952 (+ 1us) client_negotiation.cc:769] Sending connection context
0808 14:45:19.328006 (+ 54us) client_negotiation.cc:240] Negotiation successful
0808 14:45:19.328019 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":508,"thread_start_us":78,"threads_started":1}
I20260808 14:45:19.328118 6824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:19.326295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56658 (local address 127.30.214.130:39457)
0808 14:45:19.326566 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:19.326570 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:19.326580 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:45:19.326605 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:19.326608 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:19.326617 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:19.326684 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:19.327828 (+ 1144us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:19.327837 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:19.327837 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:45:19.327841 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:19.327873 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:45:19.327898 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:19.327953 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:19.328013 (+ 60us) server_negotiation.cc:299] Negotiation successful
0808 14:45:19.328026 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":231,"thread_start_us":87,"threads_started":1}
I20260808 14:45:19.328306 6296 tablet_service.cc:1467] Processing CreateTablet for tablet faa2bd14eeaa42a694038e3c39746918 (DEFAULT_TABLE table=test-table [id=26019b8cbc3341a29d65ab6f531b370a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:45:19.328668 6296 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet faa2bd14eeaa42a694038e3c39746918. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:45:19.328680 6487 tablet_service.cc:1467] Processing CreateTablet for tablet faa2bd14eeaa42a694038e3c39746918 (DEFAULT_TABLE table=test-table [id=26019b8cbc3341a29d65ab6f531b370a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:45:19.329025 6487 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet faa2bd14eeaa42a694038e3c39746918. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:45:19.331751 6827 tablet_bootstrap.cc:492] T faa2bd14eeaa42a694038e3c39746918 P b76d2721edd8410aa89b03448e5e2d99: Bootstrap starting.
I20260808 14:45:19.331831 6700 tablet_service.cc:1467] Processing CreateTablet for tablet faa2bd14eeaa42a694038e3c39746918 (DEFAULT_TABLE table=test-table [id=26019b8cbc3341a29d65ab6f531b370a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:45:19.332226 6700 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet faa2bd14eeaa42a694038e3c39746918. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:45:19.332494 6827 tablet_bootstrap.cc:654] T faa2bd14eeaa42a694038e3c39746918 P b76d2721edd8410aa89b03448e5e2d99: Neither blocks nor log segments found. Creating new log.
I20260808 14:45:19.332815 6827 log.cc:824] T faa2bd14eeaa42a694038e3c39746918 P b76d2721edd8410aa89b03448e5e2d99: Log is configured to *not* fsync() on all Append() calls
I20260808 14:45:19.333671 6827 tablet_bootstrap.cc:492] T faa2bd14eeaa42a694038e3c39746918 P b76d2721edd8410aa89b03448e5e2d99: No bootstrap required, opened a new log
I20260808 14:45:19.333760 6827 ts_tablet_manager.cc:1397] T faa2bd14eeaa42a694038e3c39746918 P b76d2721edd8410aa89b03448e5e2d99: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:45:19.335786 6825 tablet_bootstrap.cc:492] T faa2bd14eeaa42a694038e3c39746918 P a95d6ac2458a4b4aa375292cb7f4bd63: Bootstrap starting.
I20260808 14:45:19.335997 6830 tablet_bootstrap.cc:492] T faa2bd14eeaa42a694038e3c39746918 P 87bedf03b5c5491499dbbc5de1e30750: Bootstrap starting.
I20260808 14:45:19.336344 6827 raft_consensus.cc:348] T faa2bd14eeaa42a694038e3c39746918 P b76d2721edd8410aa89b03448e5e2d99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a95d6ac2458a4b4aa375292cb7f4bd63" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 45037 } } peers { permanent_uuid: "b76d2721edd8410aa89b03448e5e2d99" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 39457 } } peers { permanent_uuid: "87bedf03b5c5491499dbbc5de1e30750" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44603 } }
I20260808 14:45:19.336536 6825 tablet_bootstrap.cc:654] T faa2bd14eeaa42a694038e3c39746918 P a95d6ac2458a4b4aa375292cb7f4bd63: Neither blocks nor log segments found. Creating new log.
I20260808 14:45:19.336536 6827 raft_consensus.cc:374] T faa2bd14eeaa42a694038e3c39746918 P b76d2721edd8410aa89b03448e5e2d99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:45:19.336578 6827 raft_consensus.cc:729] T faa2bd14eeaa42a694038e3c39746918 P b76d2721edd8410aa89b03448e5e2d99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b76d2721edd8410aa89b03448e5e2d99, State: Initialized, Role: FOLLOWER
I20260808 14:45:19.336621 6830 tablet_bootstrap.cc:654] T faa2bd14eeaa42a694038e3c39746918 P 87bedf03b5c5491499dbbc5de1e30750: Neither blocks nor log segments found. Creating new log.
I20260808 14:45:19.336740 6827 consensus_queue.cc:260] T faa2bd14eeaa42a694038e3c39746918 P b76d2721edd8410aa89b03448e5e2d99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a95d6ac2458a4b4aa375292cb7f4bd63" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 45037 } } peers { permanent_uuid: "b76d2721edd8410aa89b03448e5e2d99" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 39457 } } peers { permanent_uuid: "87bedf03b5c5491499dbbc5de1e30750" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44603 } }
I20260808 14:45:19.336853 6825 log.cc:824] T faa2bd14eeaa42a694038e3c39746918 P a95d6ac2458a4b4aa375292cb7f4bd63: Log is configured to *not* fsync() on all Append() calls
I20260808 14:45:19.336908 6830 log.cc:824] T faa2bd14eeaa42a694038e3c39746918 P 87bedf03b5c5491499dbbc5de1e30750: Log is configured to *not* fsync() on all Append() calls
I20260808 14:45:19.337030 6827 ts_tablet_manager.cc:1428] T faa2bd14eeaa42a694038e3c39746918 P b76d2721edd8410aa89b03448e5e2d99: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260808 14:45:19.337172 6593 heartbeater.cc:503] Master 127.30.214.190:34781 was elected leader, sending a full tablet report...
I20260808 14:45:19.337790 6825 tablet_bootstrap.cc:492] T faa2bd14eeaa42a694038e3c39746918 P a95d6ac2458a4b4aa375292cb7f4bd63: No bootstrap required, opened a new log
I20260808 14:45:19.337908 6825 ts_tablet_manager.cc:1397] T faa2bd14eeaa42a694038e3c39746918 P a95d6ac2458a4b4aa375292cb7f4bd63: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20260808 14:45:19.338232 6830 tablet_bootstrap.cc:492] T faa2bd14eeaa42a694038e3c39746918 P 87bedf03b5c5491499dbbc5de1e30750: No bootstrap required, opened a new log
I20260808 14:45:19.338313 6830 ts_tablet_manager.cc:1397] T faa2bd14eeaa42a694038e3c39746918 P 87bedf03b5c5491499dbbc5de1e30750: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 14:45:19.339978 6825 raft_consensus.cc:348] T faa2bd14eeaa42a694038e3c39746918 P a95d6ac2458a4b4aa375292cb7f4bd63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a95d6ac2458a4b4aa375292cb7f4bd63" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 45037 } } peers { permanent_uuid: "b76d2721edd8410aa89b03448e5e2d99" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 39457 } } peers { permanent_uuid: "87bedf03b5c5491499dbbc5de1e30750" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44603 } }
I20260808 14:45:19.340116 6825 raft_consensus.cc:374] T faa2bd14eeaa42a694038e3c39746918 P a95d6ac2458a4b4aa375292cb7f4bd63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:45:19.340137 6825 raft_consensus.cc:729] T faa2bd14eeaa42a694038e3c39746918 P a95d6ac2458a4b4aa375292cb7f4bd63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a95d6ac2458a4b4aa375292cb7f4bd63, State: Initialized, Role: FOLLOWER
I20260808 14:45:19.340240 6825 consensus_queue.cc:260] T faa2bd14eeaa42a694038e3c39746918 P a95d6ac2458a4b4aa375292cb7f4bd63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a95d6ac2458a4b4aa375292cb7f4bd63" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 45037 } } peers { permanent_uuid: "b76d2721edd8410aa89b03448e5e2d99" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 39457 } } peers { permanent_uuid: "87bedf03b5c5491499dbbc5de1e30750" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44603 } }
I20260808 14:45:19.340235 6830 raft_consensus.cc:348] T faa2bd14eeaa42a694038e3c39746918 P 87bedf03b5c5491499dbbc5de1e30750 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a95d6ac2458a4b4aa375292cb7f4bd63" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 45037 } } peers { permanent_uuid: "b76d2721edd8410aa89b03448e5e2d99" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 39457 } } peers { permanent_uuid: "87bedf03b5c5491499dbbc5de1e30750" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44603 } }
I20260808 14:45:19.340396 6830 raft_consensus.cc:374] T faa2bd14eeaa42a694038e3c39746918 P 87bedf03b5c5491499dbbc5de1e30750 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:45:19.340440 6830 raft_consensus.cc:729] T faa2bd14eeaa42a694038e3c39746918 P 87bedf03b5c5491499dbbc5de1e30750 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87bedf03b5c5491499dbbc5de1e30750, State: Initialized, Role: FOLLOWER
I20260808 14:45:19.340526 6825 ts_tablet_manager.cc:1428] T faa2bd14eeaa42a694038e3c39746918 P a95d6ac2458a4b4aa375292cb7f4bd63: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260808 14:45:19.340566 6830 consensus_queue.cc:260] T faa2bd14eeaa42a694038e3c39746918 P 87bedf03b5c5491499dbbc5de1e30750 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a95d6ac2458a4b4aa375292cb7f4bd63" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 45037 } } peers { permanent_uuid: "b76d2721edd8410aa89b03448e5e2d99" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 39457 } } peers { permanent_uuid: "87bedf03b5c5491499dbbc5de1e30750" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44603 } }
I20260808 14:45:19.340610 6388 heartbeater.cc:503] Master 127.30.214.190:34781 was elected leader, sending a full tablet report...
I20260808 14:45:19.340829 6830 ts_tablet_manager.cc:1428] T faa2bd14eeaa42a694038e3c39746918 P 87bedf03b5c5491499dbbc5de1e30750: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 14:45:19.340969 6808 heartbeater.cc:503] Master 127.30.214.190:34781 was elected leader, sending a full tablet report...
W20260808 14:45:19.447685 6594 tablet.cc:2369] T faa2bd14eeaa42a694038e3c39746918 P b76d2721edd8410aa89b03448e5e2d99: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:45:19.488368 6831 raft_consensus.cc:482] T faa2bd14eeaa42a694038e3c39746918 P b76d2721edd8410aa89b03448e5e2d99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:45:19.488525 6831 raft_consensus.cc:504] T faa2bd14eeaa42a694038e3c39746918 P b76d2721edd8410aa89b03448e5e2d99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a95d6ac2458a4b4aa375292cb7f4bd63" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 45037 } } peers { permanent_uuid: "b76d2721edd8410aa89b03448e5e2d99" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 39457 } } peers { permanent_uuid: "87bedf03b5c5491499dbbc5de1e30750" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44603 } }
I20260808 14:45:19.488925 6831 leader_election.cc:288] T faa2bd14eeaa42a694038e3c39746918 P b76d2721edd8410aa89b03448e5e2d99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a95d6ac2458a4b4aa375292cb7f4bd63 (127.30.214.129:45037), 87bedf03b5c5491499dbbc5de1e30750 (127.30.214.131:44603)
I20260808 14:45:19.490224 6823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:19.489190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.130:33771 (local address 127.30.214.129:45037)
0808 14:45:19.489239 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:19.489240 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:19.489252 (+ 12us) server_negotiation.cc:407] Connection header received
0808 14:45:19.489309 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:19.489309 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:19.489316 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:19.489373 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:19.489991 (+ 618us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:19.489993 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:19.489993 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:45:19.489998 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:19.490020 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:45:19.490025 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:19.490090 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:19.490147 (+ 57us) server_negotiation.cc:299] Negotiation successful
0808 14:45:19.490161 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 14:45:19.490223 6599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:19.489127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.129:45037 (local address 127.30.214.130:33771)
0808 14:45:19.489189 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:19.489200 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:19.489244 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:19.489386 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:19.489387 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:19.489389 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:19.489875 (+ 486us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:45:19.489876 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:19.489904 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:45:19.489921 (+ 17us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:19.490092 (+ 171us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:19.490093 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:19.490094 (+ 1us) client_negotiation.cc:769] Sending connection context
0808 14:45:19.490138 (+ 44us) client_negotiation.cc:240] Negotiation successful
0808 14:45:19.490153 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260808 14:45:19.490449 6822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:19.489235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.130:55677 (local address 127.30.214.131:44603)
0808 14:45:19.489283 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:19.489285 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:19.489460 (+ 175us) server_negotiation.cc:407] Connection header received
0808 14:45:19.489513 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:19.489514 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:19.489520 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:19.489565 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:19.490151 (+ 586us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:19.490153 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:19.490153 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:45:19.490158 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:19.490176 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:45:19.490180 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:19.490233 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:19.490350 (+ 117us) server_negotiation.cc:299] Negotiation successful
0808 14:45:19.490385 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 14:45:19.490629 6839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:19.489150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.131:44603 (local address 127.30.214.130:55677)
0808 14:45:19.489360 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:19.489369 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:19.489433 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:19.489580 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:19.489581 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:19.489583 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:19.490044 (+ 461us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:45:19.490045 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:19.490052 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:45:19.490065 (+ 13us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:19.490266 (+ 201us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:19.490266 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:19.490267 (+ 1us) client_negotiation.cc:769] Sending connection context
0808 14:45:19.490539 (+ 272us) client_negotiation.cc:240] Negotiation successful
0808 14:45:19.490555 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":141,"threads_started":1}
I20260808 14:45:19.490630 6328 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "faa2bd14eeaa42a694038e3c39746918" candidate_uuid: "b76d2721edd8410aa89b03448e5e2d99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a95d6ac2458a4b4aa375292cb7f4bd63" is_pre_election: true
I20260808 14:45:19.490799 6328 raft_consensus.cc:2454] T faa2bd14eeaa42a694038e3c39746918 P a95d6ac2458a4b4aa375292cb7f4bd63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b76d2721edd8410aa89b03448e5e2d99 in term 0.
I20260808 14:45:19.491040 6736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "faa2bd14eeaa42a694038e3c39746918" candidate_uuid: "b76d2721edd8410aa89b03448e5e2d99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87bedf03b5c5491499dbbc5de1e30750" is_pre_election: true
I20260808 14:45:19.491077 6420 leader_election.cc:302] T faa2bd14eeaa42a694038e3c39746918 P b76d2721edd8410aa89b03448e5e2d99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a95d6ac2458a4b4aa375292cb7f4bd63, b76d2721edd8410aa89b03448e5e2d99; no voters:
I20260808 14:45:19.491189 6736 raft_consensus.cc:2454] T faa2bd14eeaa42a694038e3c39746918 P 87bedf03b5c5491499dbbc5de1e30750 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b76d2721edd8410aa89b03448e5e2d99 in term 0.
I20260808 14:45:19.491206 6831 raft_consensus.cc:2781] T faa2bd14eeaa42a694038e3c39746918 P b76d2721edd8410aa89b03448e5e2d99 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:45:19.491252 6831 raft_consensus.cc:482] T faa2bd14eeaa42a694038e3c39746918 P b76d2721edd8410aa89b03448e5e2d99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:45:19.491283 6831 raft_consensus.cc:3037] T faa2bd14eeaa42a694038e3c39746918 P b76d2721edd8410aa89b03448e5e2d99 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:19.492038 6831 raft_consensus.cc:504] T faa2bd14eeaa42a694038e3c39746918 P b76d2721edd8410aa89b03448e5e2d99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a95d6ac2458a4b4aa375292cb7f4bd63" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 45037 } } peers { permanent_uuid: "b76d2721edd8410aa89b03448e5e2d99" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 39457 } } peers { permanent_uuid: "87bedf03b5c5491499dbbc5de1e30750" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44603 } }
I20260808 14:45:19.492170 6831 leader_election.cc:288] T faa2bd14eeaa42a694038e3c39746918 P b76d2721edd8410aa89b03448e5e2d99 [CANDIDATE]: Term 1 election: Requested vote from peers a95d6ac2458a4b4aa375292cb7f4bd63 (127.30.214.129:45037), 87bedf03b5c5491499dbbc5de1e30750 (127.30.214.131:44603)
I20260808 14:45:19.492354 6736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "faa2bd14eeaa42a694038e3c39746918" candidate_uuid: "b76d2721edd8410aa89b03448e5e2d99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87bedf03b5c5491499dbbc5de1e30750"
I20260808 14:45:19.492439 6736 raft_consensus.cc:3037] T faa2bd14eeaa42a694038e3c39746918 P 87bedf03b5c5491499dbbc5de1e30750 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:19.492569 6328 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "faa2bd14eeaa42a694038e3c39746918" candidate_uuid: "b76d2721edd8410aa89b03448e5e2d99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a95d6ac2458a4b4aa375292cb7f4bd63"
I20260808 14:45:19.492666 6328 raft_consensus.cc:3037] T faa2bd14eeaa42a694038e3c39746918 P a95d6ac2458a4b4aa375292cb7f4bd63 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:19.493206 6736 raft_consensus.cc:2454] T faa2bd14eeaa42a694038e3c39746918 P 87bedf03b5c5491499dbbc5de1e30750 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b76d2721edd8410aa89b03448e5e2d99 in term 1.
I20260808 14:45:19.493388 6419 leader_election.cc:302] T faa2bd14eeaa42a694038e3c39746918 P b76d2721edd8410aa89b03448e5e2d99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87bedf03b5c5491499dbbc5de1e30750, b76d2721edd8410aa89b03448e5e2d99; no voters:
I20260808 14:45:19.493433 6328 raft_consensus.cc:2454] T faa2bd14eeaa42a694038e3c39746918 P a95d6ac2458a4b4aa375292cb7f4bd63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b76d2721edd8410aa89b03448e5e2d99 in term 1.
I20260808 14:45:19.493496 6831 raft_consensus.cc:2781] T faa2bd14eeaa42a694038e3c39746918 P b76d2721edd8410aa89b03448e5e2d99 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:45:19.493652 6831 raft_consensus.cc:686] T faa2bd14eeaa42a694038e3c39746918 P b76d2721edd8410aa89b03448e5e2d99 [term 1 LEADER]: Becoming Leader. State: Replica: b76d2721edd8410aa89b03448e5e2d99, State: Running, Role: LEADER
I20260808 14:45:19.493748 6831 consensus_queue.cc:237] T faa2bd14eeaa42a694038e3c39746918 P b76d2721edd8410aa89b03448e5e2d99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a95d6ac2458a4b4aa375292cb7f4bd63" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 45037 } } peers { permanent_uuid: "b76d2721edd8410aa89b03448e5e2d99" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 39457 } } peers { permanent_uuid: "87bedf03b5c5491499dbbc5de1e30750" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44603 } }
I20260808 14:45:19.494566 6101 catalog_manager.cc:5495] T faa2bd14eeaa42a694038e3c39746918 P b76d2721edd8410aa89b03448e5e2d99 reported cstate change: term changed from 0 to 1, leader changed from <none> to b76d2721edd8410aa89b03448e5e2d99 (127.30.214.130). New cstate: current_term: 1 leader_uuid: "b76d2721edd8410aa89b03448e5e2d99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a95d6ac2458a4b4aa375292cb7f4bd63" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 45037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b76d2721edd8410aa89b03448e5e2d99" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 39457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "87bedf03b5c5491499dbbc5de1e30750" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44603 } health_report { overall_health: UNKNOWN } } }
I20260808 14:45:19.510150 6824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:19.509189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56670 (local address 127.30.214.130:39457)
0808 14:45:19.509253 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:19.509256 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:19.509276 (+ 20us) server_negotiation.cc:407] Connection header received
0808 14:45:19.509321 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:19.509322 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:19.509338 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:19.509407 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:19.509928 (+ 521us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:19.509929 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:19.509929 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:45:19.509933 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:19.509950 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:45:19.509954 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:19.510004 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:19.510057 (+ 53us) server_negotiation.cc:299] Negotiation successful
0808 14:45:19.510070 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 14:45:19.511898 6328 raft_consensus.cc:1261] T faa2bd14eeaa42a694038e3c39746918 P a95d6ac2458a4b4aa375292cb7f4bd63 [term 1 FOLLOWER]: Refusing update from remote peer b76d2721edd8410aa89b03448e5e2d99: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:45:19.511904 6736 raft_consensus.cc:1261] T faa2bd14eeaa42a694038e3c39746918 P 87bedf03b5c5491499dbbc5de1e30750 [term 1 FOLLOWER]: Refusing update from remote peer b76d2721edd8410aa89b03448e5e2d99: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:45:19.512274 6841 consensus_queue.cc:1035] T faa2bd14eeaa42a694038e3c39746918 P b76d2721edd8410aa89b03448e5e2d99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a95d6ac2458a4b4aa375292cb7f4bd63" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:45:19.512403 6831 consensus_queue.cc:1035] T faa2bd14eeaa42a694038e3c39746918 P b76d2721edd8410aa89b03448e5e2d99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87bedf03b5c5491499dbbc5de1e30750" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:45:19.514973 6848 mvcc.cc:205] Tried to move back new op lower bound from 7316276508718219264 to 7316276508646989824. Current Snapshot: MvccSnapshot[applied={T|T < 7316276508718219264}]
I20260808 14:45:19.515048 6847 mvcc.cc:205] Tried to move back new op lower bound from 7316276508718219264 to 7316276508646989824. Current Snapshot: MvccSnapshot[applied={T|T < 7316276508718219264}]
I20260808 14:45:19.517083 6101 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42474:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:45:19.517194 6101 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42474:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:45:19.517941 6101 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2b0823881f9f4e14a503940502ffcd43: Sending DeleteTablet for 3 replicas of tablet faa2bd14eeaa42a694038e3c39746918
I20260808 14:45:19.518285 6487 tablet_service.cc:1514] Processing DeleteTablet for tablet faa2bd14eeaa42a694038e3c39746918 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:45:19 UTC) from {username='slave'} at 127.0.0.1:56658
I20260808 14:45:19.518313 6296 tablet_service.cc:1514] Processing DeleteTablet for tablet faa2bd14eeaa42a694038e3c39746918 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:45:19 UTC) from {username='slave'} at 127.0.0.1:57656
I20260808 14:45:19.518549 6857 tablet_replica.cc:330] T faa2bd14eeaa42a694038e3c39746918 P a95d6ac2458a4b4aa375292cb7f4bd63: stopping tablet replica
I20260808 14:45:19.518559 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 6200
I20260808 14:45:19.518659 6857 raft_consensus.cc:2229] T faa2bd14eeaa42a694038e3c39746918 P a95d6ac2458a4b4aa375292cb7f4bd63 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:45:19.518707 6700 tablet_service.cc:1514] Processing DeleteTablet for tablet faa2bd14eeaa42a694038e3c39746918 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:45:19 UTC) from {username='slave'} at 127.0.0.1:34322
I20260808 14:45:19.518752 6857 raft_consensus.cc:2258] T faa2bd14eeaa42a694038e3c39746918 P a95d6ac2458a4b4aa375292cb7f4bd63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:45:19.519109 6859 tablet_replica.cc:330] T faa2bd14eeaa42a694038e3c39746918 P 87bedf03b5c5491499dbbc5de1e30750: stopping tablet replica
I20260808 14:45:19.519258 6859 raft_consensus.cc:2229] T faa2bd14eeaa42a694038e3c39746918 P 87bedf03b5c5491499dbbc5de1e30750 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:45:19.519425 6859 raft_consensus.cc:2258] T faa2bd14eeaa42a694038e3c39746918 P 87bedf03b5c5491499dbbc5de1e30750 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:45:19.519668 6856 tablet_replica.cc:330] T faa2bd14eeaa42a694038e3c39746918 P b76d2721edd8410aa89b03448e5e2d99: stopping tablet replica
I20260808 14:45:19.521909 6859 ts_tablet_manager.cc:1905] T faa2bd14eeaa42a694038e3c39746918 P 87bedf03b5c5491499dbbc5de1e30750: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:45:19.523761 6859 ts_tablet_manager.cc:1918] T faa2bd14eeaa42a694038e3c39746918 P 87bedf03b5c5491499dbbc5de1e30750: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:45:19.523847 6859 log.cc:1196] T faa2bd14eeaa42a694038e3c39746918 P 87bedf03b5c5491499dbbc5de1e30750: Deleting WAL directory at /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200295877777-31578-0/minicluster-data/ts-2/wal/wals/faa2bd14eeaa42a694038e3c39746918
I20260808 14:45:19.524111 6859 ts_tablet_manager.cc:1939] T faa2bd14eeaa42a694038e3c39746918 P 87bedf03b5c5491499dbbc5de1e30750: Deleting consensus metadata
I20260808 14:45:19.524114 6856 raft_consensus.cc:2229] T faa2bd14eeaa42a694038e3c39746918 P b76d2721edd8410aa89b03448e5e2d99 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:45:19.524366 6856 raft_consensus.cc:2258] T faa2bd14eeaa42a694038e3c39746918 P b76d2721edd8410aa89b03448e5e2d99 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:45:19.524542 6082 catalog_manager.cc:4841] TS 87bedf03b5c5491499dbbc5de1e30750 (127.30.214.131:44603): tablet faa2bd14eeaa42a694038e3c39746918 (table test-table [id=26019b8cbc3341a29d65ab6f531b370a]) successfully deleted
I20260808 14:45:19.525825 6856 ts_tablet_manager.cc:1905] T faa2bd14eeaa42a694038e3c39746918 P b76d2721edd8410aa89b03448e5e2d99: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:45:19.527498 6856 ts_tablet_manager.cc:1918] T faa2bd14eeaa42a694038e3c39746918 P b76d2721edd8410aa89b03448e5e2d99: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:45:19.527597 6856 log.cc:1196] T faa2bd14eeaa42a694038e3c39746918 P b76d2721edd8410aa89b03448e5e2d99: Deleting WAL directory at /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786200295877777-31578-0/minicluster-data/ts-1/wal/wals/faa2bd14eeaa42a694038e3c39746918
I20260808 14:45:19.527877 6856 ts_tablet_manager.cc:1939] T faa2bd14eeaa42a694038e3c39746918 P b76d2721edd8410aa89b03448e5e2d99: Deleting consensus metadata
I20260808 14:45:19.528407 6081 catalog_manager.cc:4841] TS b76d2721edd8410aa89b03448e5e2d99 (127.30.214.130:39457): tablet faa2bd14eeaa42a694038e3c39746918 (table test-table [id=26019b8cbc3341a29d65ab6f531b370a]) successfully deleted
W20260808 14:45:19.528714 6083 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.30.214.129:45037 (error 108)
I20260808 14:45:19.529242 6820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:19.529098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.129:45037 (local address 127.0.0.1:57662)
0808 14:45:19.529154 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:19.529204 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.129:45037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260808 14:45:19.529255 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 6391
W20260808 14:45:19.540429 6083 catalog_manager.cc:4584] TS a95d6ac2458a4b4aa375292cb7f4bd63 (127.30.214.129:45037): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet faa2bd14eeaa42a694038e3c39746918: Network error: Client connection negotiation failed: client connection to 127.30.214.129:45037: connect: Connection refused (error 111)
I20260808 14:45:19.561216 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 6603
I20260808 14:45:19.570358 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 6054
2026-08-08T14:45:19Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (818 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260808 14:45:19.599285 31578 mini_oidc.cc:152] Starting JWKS server
I20260808 14:45:19.600443 31578 webserver.cc:460] Webserver started at https://127.0.0.1:40429/ using document root <none> and password file <none>
I20260808 14:45:19.600544 31578 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 14:45:19.600721 31578 webserver.cc:460] Webserver started at http://127.0.0.1:44821/ using document root <none> and password file <none>
2026-08-08T14:45:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:45:19Z Disabled control of system clock
I20260808 14:45:19.609297 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200295877777-31578-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200295877777-31578-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200295877777-31578-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:33667
--webserver_interface=127.30.214.190
--webserver_port=0
--builtin_ntp_servers=127.30.214.148:36473
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.214.190:33667
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40429/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200295877777-31578-0/testchainca.cert with env {}
W20260808 14:45:19.691123 6870 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:45:19.691387 6870 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:45:19.691419 6870 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:45:19.692715 6870 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:45:19.692764 6870 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:45:19.692775 6870 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:45:19.692787 6870 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:45:19.692801 6870 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 14:45:19.692826 6870 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 14:45:19.692847 6870 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:40429/jwks.json
I20260808 14:45:19.694628 6870 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:36473
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200295877777-31578-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200295877777-31578-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.214.190:33667
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:33667
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40429/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.214.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200295877777-31578-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6870
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200295877777-31578-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:45:19.694916 6870 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:45:19.695140 6870 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:45:19.700022 6876 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:19.700016 6877 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:19.700047 6879 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:19.700289 6870 server_base.cc:1034] running on GCE node
I20260808 14:45:19.700546 6870 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:45:19.700842 6870 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:45:19.701997 6870 hybrid_clock.cc:648] HybridClock initialized: now 1786200319701984 us; error 29 us; skew 500 ppm
I20260808 14:45:19.703224 6870 webserver.cc:460] Webserver started at http://127.30.214.190:34271/ using document root <none> and password file <none>
I20260808 14:45:19.703472 6870 fs_manager.cc:359] Metadata directory not provided
I20260808 14:45:19.703518 6870 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:45:19.703634 6870 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:45:19.704708 6870 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200295877777-31578-0/minicluster-data/master-0/data/instance:
uuid: "c35daca438f74c8fa52dca48ac7eeb4d"
format_stamp: "Formatted at 2026-08-08 14:45:19 on dist-test-slave-42z9"
server_key: "1174559fa286a168e28bd671f67e58ae"
server_key_iv: "3eb6a776825a103d8e8db6c61594f461"
server_key_version: "encryptionkey@0"
I20260808 14:45:19.705055 6870 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200295877777-31578-0/minicluster-data/master-0/wal/instance:
uuid: "c35daca438f74c8fa52dca48ac7eeb4d"
format_stamp: "Formatted at 2026-08-08 14:45:19 on dist-test-slave-42z9"
server_key: "1174559fa286a168e28bd671f67e58ae"
server_key_iv: "3eb6a776825a103d8e8db6c61594f461"
server_key_version: "encryptionkey@0"
I20260808 14:45:19.706380 6870 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 14:45:19.707132 6886 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:19.707301 6870 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:45:19.707386 6870 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200295877777-31578-0/minicluster-data/master-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200295877777-31578-0/minicluster-data/master-0/wal
uuid: "c35daca438f74c8fa52dca48ac7eeb4d"
format_stamp: "Formatted at 2026-08-08 14:45:19 on dist-test-slave-42z9"
server_key: "1174559fa286a168e28bd671f67e58ae"
server_key_iv: "3eb6a776825a103d8e8db6c61594f461"
server_key_version: "encryptionkey@0"
I20260808 14:45:19.707461 6870 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200295877777-31578-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200295877777-31578-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200295877777-31578-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:45:19.725901 6870 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:45:19.726255 6870 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:45:19.726395 6870 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:45:19.730351 6870 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.190:33667
I20260808 14:45:19.730396 6970 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.190:33667 every 8 connection(s)
I20260808 14:45:19.730727 6870 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
I20260808 14:45:19.731989 6971 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:45:19.733973 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 6870
I20260808 14:45:19.734097 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200295877777-31578-0/minicluster-data/master-0/wal/instance
I20260808 14:45:19.734269 31578 external_mini_cluster.cc:1428] Setting key 3b5e7fb588ac8b42c8a1fc5bdc547284
I20260808 14:45:19.734818 6971 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c35daca438f74c8fa52dca48ac7eeb4d: Bootstrap starting.
I20260808 14:45:19.735577 6971 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c35daca438f74c8fa52dca48ac7eeb4d: Neither blocks nor log segments found. Creating new log.
I20260808 14:45:19.735908 6971 log.cc:824] T 00000000000000000000000000000000 P c35daca438f74c8fa52dca48ac7eeb4d: Log is configured to *not* fsync() on all Append() calls
I20260808 14:45:19.736686 6971 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c35daca438f74c8fa52dca48ac7eeb4d: No bootstrap required, opened a new log
I20260808 14:45:19.738902 6971 raft_consensus.cc:348] T 00000000000000000000000000000000 P c35daca438f74c8fa52dca48ac7eeb4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c35daca438f74c8fa52dca48ac7eeb4d" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 33667 } }
I20260808 14:45:19.739089 6971 raft_consensus.cc:374] T 00000000000000000000000000000000 P c35daca438f74c8fa52dca48ac7eeb4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:45:19.739125 6971 raft_consensus.cc:729] T 00000000000000000000000000000000 P c35daca438f74c8fa52dca48ac7eeb4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c35daca438f74c8fa52dca48ac7eeb4d, State: Initialized, Role: FOLLOWER
I20260808 14:45:19.739528 6971 consensus_queue.cc:260] T 00000000000000000000000000000000 P c35daca438f74c8fa52dca48ac7eeb4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c35daca438f74c8fa52dca48ac7eeb4d" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 33667 } }
I20260808 14:45:19.739626 6971 raft_consensus.cc:388] T 00000000000000000000000000000000 P c35daca438f74c8fa52dca48ac7eeb4d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:45:19.739661 6971 raft_consensus.cc:482] T 00000000000000000000000000000000 P c35daca438f74c8fa52dca48ac7eeb4d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:45:19.739710 6971 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c35daca438f74c8fa52dca48ac7eeb4d [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:19.740345 6974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:19.734816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37394 (local address 127.30.214.190:33667)
0808 14:45:19.735048 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:19.735057 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:19.735085 (+ 28us) server_negotiation.cc:407] Connection header received
0808 14:45:19.735633 (+ 548us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:19.735643 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:19.735746 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:19.735899 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:19.736132 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:19.737410 (+ 1278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:19.738218 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:19.738862 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:19.739001 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:19.739639 (+ 638us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:19.739643 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:19.739644 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:45:19.739857 (+ 213us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:19.739901 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:45:19.739915 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:19.739993 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:19.740051 (+ 58us) server_negotiation.cc:299] Negotiation successful
0808 14:45:19.740136 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":95,"threads_started":1}
I20260808 14:45:19.740469 6971 raft_consensus.cc:504] T 00000000000000000000000000000000 P c35daca438f74c8fa52dca48ac7eeb4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c35daca438f74c8fa52dca48ac7eeb4d" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 33667 } }
I20260808 14:45:19.740561 6971 leader_election.cc:302] T 00000000000000000000000000000000 P c35daca438f74c8fa52dca48ac7eeb4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c35daca438f74c8fa52dca48ac7eeb4d; no voters:
I20260808 14:45:19.740694 6971 leader_election.cc:288] T 00000000000000000000000000000000 P c35daca438f74c8fa52dca48ac7eeb4d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:45:19.740751 6977 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c35daca438f74c8fa52dca48ac7eeb4d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:45:19.740850 6977 raft_consensus.cc:686] T 00000000000000000000000000000000 P c35daca438f74c8fa52dca48ac7eeb4d [term 1 LEADER]: Becoming Leader. State: Replica: c35daca438f74c8fa52dca48ac7eeb4d, State: Running, Role: LEADER
I20260808 14:45:19.740926 6977 consensus_queue.cc:237] T 00000000000000000000000000000000 P c35daca438f74c8fa52dca48ac7eeb4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c35daca438f74c8fa52dca48ac7eeb4d" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 33667 } }
I20260808 14:45:19.740962 6971 sys_catalog.cc:564] T 00000000000000000000000000000000 P c35daca438f74c8fa52dca48ac7eeb4d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:45:19.741258 6977 sys_catalog.cc:455] T 00000000000000000000000000000000 P c35daca438f74c8fa52dca48ac7eeb4d [sys.catalog]: SysCatalogTable state changed. Reason: New leader c35daca438f74c8fa52dca48ac7eeb4d. Latest consensus state: current_term: 1 leader_uuid: "c35daca438f74c8fa52dca48ac7eeb4d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c35daca438f74c8fa52dca48ac7eeb4d" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 33667 } } }
I20260808 14:45:19.741277 6980 sys_catalog.cc:455] T 00000000000000000000000000000000 P c35daca438f74c8fa52dca48ac7eeb4d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c35daca438f74c8fa52dca48ac7eeb4d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c35daca438f74c8fa52dca48ac7eeb4d" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 33667 } } }
I20260808 14:45:19.741333 6977 sys_catalog.cc:458] T 00000000000000000000000000000000 P c35daca438f74c8fa52dca48ac7eeb4d [sys.catalog]: This master's current role is: LEADER
I20260808 14:45:19.741354 6980 sys_catalog.cc:458] T 00000000000000000000000000000000 P c35daca438f74c8fa52dca48ac7eeb4d [sys.catalog]: This master's current role is: LEADER
I20260808 14:45:19.741384 31578 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260808 14:45:19.743139 7003 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c35daca438f74c8fa52dca48ac7eeb4d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:45:19.743191 7003 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:45:19.743250 6983 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:45:19.743396 6983 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:45:19.744776 6983 catalog_manager.cc:1347] Generated new cluster ID: b183a0d299ab400c8156b3c5c6b4582a
I20260808 14:45:19.744827 6983 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:45:19.760285 6983 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:45:19.760812 6983 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:45:19.771061 6983 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c35daca438f74c8fa52dca48ac7eeb4d: Generated new TSK 0
I20260808 14:45:19.771262 6983 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260808 14:45:19.795702 7018 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260808 14:45:19.795805 7018 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260808 14:45:19.796154 6974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:19.780289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37398 (local address 127.30.214.190:33667)
0808 14:45:19.780339 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:19.780341 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:19.780477 (+ 136us) server_negotiation.cc:407] Connection header received
0808 14:45:19.780569 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:19.780570 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:19.780584 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:19.780668 (+ 84us) server_negotiation.cc:226] Negotiated authn=JWT
0808 14:45:19.780804 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:19.781608 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:19.782351 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:19.782667 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:19.782731 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:19.782915 (+ 184us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 14:45:19.795848 (+ 12933us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40429/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0808 14:45:19.796079 (+ 231us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:37398: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40429/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":23}
W20260808 14:45:19.796209 6974 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:37398: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40429/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260808 14:45:19.796571 7017 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:45:19.780205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:33667 (local address 127.0.0.1:37398)
0808 14:45:19.780410 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:19.780420 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:19.780489 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:19.780673 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:19.780674 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:19.780676 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0808 14:45:19.780751 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:19.780753 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:19.781703 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:19.781704 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:19.782279 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:19.782280 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:19.782737 (+ 457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:19.782737 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:19.782788 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:19.782811 (+ 23us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 14:45:19.796041 (+ 13230us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40429/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0808 14:45:19.796151 (+ 110us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.30.214.190:33667: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40429/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":90,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.30.214.190:33667: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40429/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260808 14:45:19.797101 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 6870
2026-08-08T14:45:19Z chronyd exiting
I20260808 14:45:19.847229 31578 test_util.cc:175] -----------------------------------------------
I20260808 14:45:19.847319 31578 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786200295877777-31578-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (249 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260808 14:45:19.848110 31578 mini_oidc.cc:152] Starting JWKS server
I20260808 14:45:19.848799 31578 webserver.cc:460] Webserver started at https://127.0.0.1:38603/ using document root <none> and password file <none>
I20260808 14:45:19.848846 31578 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 14:45:19.848984 31578 webserver.cc:460] Webserver started at http://127.0.0.1:43455/ using document root <none> and password file <none>
2026-08-08T14:45:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:45:19Z Disabled control of system clock
I20260808 14:45:19.857327 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200295877777-31578-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200295877777-31578-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200295877777-31578-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:43267
--webserver_interface=127.30.214.190
--webserver_port=0
--builtin_ntp_servers=127.30.214.148:39737
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.214.190:43267
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38603/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200295877777-31578-0/testchainca.cert with env {}
W20260808 14:45:19.938434 7025 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:45:19.938659 7025 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:45:19.938683 7025 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:45:19.939863 7025 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:45:19.939910 7025 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:45:19.939921 7025 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:45:19.939934 7025 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:45:19.939944 7025 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 14:45:19.939955 7025 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 14:45:19.939965 7025 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:38603/jwks.json
I20260808 14:45:19.941511 7025 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:39737
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200295877777-31578-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200295877777-31578-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.214.190:43267
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:43267
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38603/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.214.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200295877777-31578-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7025
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200295877777-31578-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:45:19.941735 7025 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:45:19.941902 7025 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:45:19.946650 7030 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:19.946730 7025 server_base.cc:1034] running on GCE node
W20260808 14:45:19.946656 7031 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:19.946633 7033 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:19.947062 7025 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:45:19.947371 7025 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:45:19.948542 7025 hybrid_clock.cc:648] HybridClock initialized: now 1786200319948526 us; error 34 us; skew 500 ppm
I20260808 14:45:19.949807 7025 webserver.cc:460] Webserver started at http://127.30.214.190:42703/ using document root <none> and password file <none>
I20260808 14:45:19.950022 7025 fs_manager.cc:359] Metadata directory not provided
I20260808 14:45:19.950073 7025 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:45:19.950194 7025 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:45:19.951242 7025 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200295877777-31578-0/minicluster-data/master-0/data/instance:
uuid: "d1aeb75d902f45fc999e4317fb26f982"
format_stamp: "Formatted at 2026-08-08 14:45:19 on dist-test-slave-42z9"
server_key: "a0ccf337ebecd73db2c5e284b78ec594"
server_key_iv: "b940999d745ae28eb786b1be76fd7101"
server_key_version: "encryptionkey@0"
I20260808 14:45:19.951612 7025 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200295877777-31578-0/minicluster-data/master-0/wal/instance:
uuid: "d1aeb75d902f45fc999e4317fb26f982"
format_stamp: "Formatted at 2026-08-08 14:45:19 on dist-test-slave-42z9"
server_key: "a0ccf337ebecd73db2c5e284b78ec594"
server_key_iv: "b940999d745ae28eb786b1be76fd7101"
server_key_version: "encryptionkey@0"
I20260808 14:45:19.952811 7025 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 14:45:19.953483 7040 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:19.953642 7025 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:45:19.953727 7025 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200295877777-31578-0/minicluster-data/master-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200295877777-31578-0/minicluster-data/master-0/wal
uuid: "d1aeb75d902f45fc999e4317fb26f982"
format_stamp: "Formatted at 2026-08-08 14:45:19 on dist-test-slave-42z9"
server_key: "a0ccf337ebecd73db2c5e284b78ec594"
server_key_iv: "b940999d745ae28eb786b1be76fd7101"
server_key_version: "encryptionkey@0"
I20260808 14:45:19.953795 7025 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200295877777-31578-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200295877777-31578-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200295877777-31578-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:45:19.966500 7025 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:45:19.966832 7025 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:45:19.966970 7025 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:45:19.970892 7025 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.190:43267
I20260808 14:45:19.970939 7117 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.190:43267 every 8 connection(s)
I20260808 14:45:19.971263 7025 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
I20260808 14:45:19.971760 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 7025
I20260808 14:45:19.971875 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786200295877777-31578-0/minicluster-data/master-0/wal/instance
I20260808 14:45:19.972077 31578 external_mini_cluster.cc:1428] Setting key 8ae6d91dc1c6fd1798efc8ae9da4efbe
I20260808 14:45:19.972075 7120 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:45:19.975760 7120 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d1aeb75d902f45fc999e4317fb26f982: Bootstrap starting.
I20260808 14:45:19.976454 7120 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d1aeb75d902f45fc999e4317fb26f982: Neither blocks nor log segments found. Creating new log.
I20260808 14:45:19.976751 7120 log.cc:824] T 00000000000000000000000000000000 P d1aeb75d902f45fc999e4317fb26f982: Log is configured to *not* fsync() on all Append() calls
I20260808 14:45:19.977527 7120 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d1aeb75d902f45fc999e4317fb26f982: No bootstrap required, opened a new log
I20260808 14:45:19.977581 7124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:19.972623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55736 (local address 127.30.214.190:43267)
0808 14:45:19.972811 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:19.972818 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:19.972843 (+ 25us) server_negotiation.cc:407] Connection header received
0808 14:45:19.973278 (+ 435us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:19.973284 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:19.973346 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:19.973496 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:19.973720 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:19.974602 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:19.975677 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:19.976143 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:19.976241 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:19.976920 (+ 679us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:19.976924 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:19.976924 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:45:19.977084 (+ 160us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:19.977116 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:45:19.977126 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:19.977184 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:19.977271 (+ 87us) server_negotiation.cc:299] Negotiation successful
0808 14:45:19.977353 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":71,"threads_started":1}
I20260808 14:45:19.978520 31578 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:45:19.979585 7120 raft_consensus.cc:348] T 00000000000000000000000000000000 P d1aeb75d902f45fc999e4317fb26f982 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1aeb75d902f45fc999e4317fb26f982" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 43267 } }
I20260808 14:45:19.979729 7120 raft_consensus.cc:374] T 00000000000000000000000000000000 P d1aeb75d902f45fc999e4317fb26f982 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:45:19.979751 7120 raft_consensus.cc:729] T 00000000000000000000000000000000 P d1aeb75d902f45fc999e4317fb26f982 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1aeb75d902f45fc999e4317fb26f982, State: Initialized, Role: FOLLOWER
I20260808 14:45:19.979871 7120 consensus_queue.cc:260] T 00000000000000000000000000000000 P d1aeb75d902f45fc999e4317fb26f982 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1aeb75d902f45fc999e4317fb26f982" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 43267 } }
I20260808 14:45:19.979941 7120 raft_consensus.cc:388] T 00000000000000000000000000000000 P d1aeb75d902f45fc999e4317fb26f982 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:45:19.979964 7120 raft_consensus.cc:482] T 00000000000000000000000000000000 P d1aeb75d902f45fc999e4317fb26f982 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:45:19.980010 7120 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d1aeb75d902f45fc999e4317fb26f982 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:19.980585 7120 raft_consensus.cc:504] T 00000000000000000000000000000000 P d1aeb75d902f45fc999e4317fb26f982 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1aeb75d902f45fc999e4317fb26f982" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 43267 } }
I20260808 14:45:19.980695 7120 leader_election.cc:302] T 00000000000000000000000000000000 P d1aeb75d902f45fc999e4317fb26f982 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d1aeb75d902f45fc999e4317fb26f982; no voters:
I20260808 14:45:19.980867 7120 leader_election.cc:288] T 00000000000000000000000000000000 P d1aeb75d902f45fc999e4317fb26f982 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:45:19.980921 7126 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d1aeb75d902f45fc999e4317fb26f982 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:45:19.981091 7126 raft_consensus.cc:686] T 00000000000000000000000000000000 P d1aeb75d902f45fc999e4317fb26f982 [term 1 LEADER]: Becoming Leader. State: Replica: d1aeb75d902f45fc999e4317fb26f982, State: Running, Role: LEADER
I20260808 14:45:19.981141 7120 sys_catalog.cc:564] T 00000000000000000000000000000000 P d1aeb75d902f45fc999e4317fb26f982 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:45:19.981192 7126 consensus_queue.cc:237] T 00000000000000000000000000000000 P d1aeb75d902f45fc999e4317fb26f982 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1aeb75d902f45fc999e4317fb26f982" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 43267 } }
I20260808 14:45:19.981559 7128 sys_catalog.cc:455] T 00000000000000000000000000000000 P d1aeb75d902f45fc999e4317fb26f982 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d1aeb75d902f45fc999e4317fb26f982. Latest consensus state: current_term: 1 leader_uuid: "d1aeb75d902f45fc999e4317fb26f982" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1aeb75d902f45fc999e4317fb26f982" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 43267 } } }
I20260808 14:45:19.981563 7127 sys_catalog.cc:455] T 00000000000000000000000000000000 P d1aeb75d902f45fc999e4317fb26f982 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d1aeb75d902f45fc999e4317fb26f982" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1aeb75d902f45fc999e4317fb26f982" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 43267 } } }
I20260808 14:45:19.981653 7128 sys_catalog.cc:458] T 00000000000000000000000000000000 P d1aeb75d902f45fc999e4317fb26f982 [sys.catalog]: This master's current role is: LEADER
I20260808 14:45:19.981658 7127 sys_catalog.cc:458] T 00000000000000000000000000000000 P d1aeb75d902f45fc999e4317fb26f982 [sys.catalog]: This master's current role is: LEADER
W20260808 14:45:19.982825 7146 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d1aeb75d902f45fc999e4317fb26f982: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:45:19.982872 7146 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:45:19.982934 7133 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:45:19.983117 7133 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:45:19.984489 7133 catalog_manager.cc:1347] Generated new cluster ID: c4587a44476b41eea13a869b41d3d4bb
I20260808 14:45:19.984541 7133 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:45:19.998713 7133 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:45:19.999218 7133 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:45:20.002068 7133 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d1aeb75d902f45fc999e4317fb26f982: Generated new TSK 0
I20260808 14:45:20.002259 7133 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260808 14:45:20.037358 7159 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260808 14:45:20.037477 7159 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260808 14:45:20.037765 7124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:20.015248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55752 (local address 127.30.214.190:43267)
0808 14:45:20.015298 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:20.015300 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:20.015382 (+ 82us) server_negotiation.cc:407] Connection header received
0808 14:45:20.015463 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:20.015464 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:20.015475 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:20.015541 (+ 66us) server_negotiation.cc:226] Negotiated authn=JWT
0808 14:45:20.015662 (+ 121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:20.016153 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:20.017243 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:20.017459 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:20.017519 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:20.017683 (+ 164us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 14:45:20.037532 (+ 19849us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38603/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0808 14:45:20.037705 (+ 173us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:55752: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38603/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":27}
W20260808 14:45:20.037818 7124 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:55752: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38603/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260808 14:45:20.037897 7158 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:45:20.015146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:43267 (local address 127.0.0.1:55752)
0808 14:45:20.015309 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:20.015321 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:20.015389 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:20.015549 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:20.015549 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:20.015551 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0808 14:45:20.015609 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:20.015611 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:20.016220 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:20.016221 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:20.017169 (+ 948us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:20.017172 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:20.017525 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:20.017526 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:20.017588 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:20.017594 (+ 6us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 14:45:20.037674 (+ 20080us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38603/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0808 14:45:20.037795 (+ 121us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.30.214.190:43267: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38603/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":99,"threads_started":1}
I20260808 14:45:20.038220 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 7025
2026-08-08T14:45:20Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (233 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260808 14:45:20.081241 31578 mini_oidc.cc:152] Starting JWKS server
I20260808 14:45:20.081993 31578 webserver.cc:460] Webserver started at https://127.0.0.1:38333/ using document root <none> and password file <none>
I20260808 14:45:20.082041 31578 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 14:45:20.082177 31578 webserver.cc:460] Webserver started at http://127.0.0.1:39559/ using document root <none> and password file <none>
2026-08-08T14:45:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:45:20Z Disabled control of system clock
I20260808 14:45:20.091013 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786200295877777-31578-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786200295877777-31578-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786200295877777-31578-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:38947
--webserver_interface=127.30.214.190
--webserver_port=0
--builtin_ntp_servers=127.30.214.148:42767
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.214.190:38947
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38333/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260808 14:45:20.173658 7167 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:45:20.173890 7167 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:45:20.173913 7167 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:45:20.175158 7167 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:45:20.175204 7167 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:45:20.175215 7167 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:45:20.175226 7167 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:45:20.175237 7167 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 14:45:20.175254 7167 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 14:45:20.175264 7167 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:38333/jwks.json
I20260808 14:45:20.176713 7167 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:42767
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786200295877777-31578-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786200295877777-31578-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.214.190:38947
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:38947
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38333/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7167
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786200295877777-31578-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:45:20.176944 7167 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:45:20.177217 7167 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:45:20.182659 7178 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:20.182790 7174 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:20.182794 7176 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:20.183065 7167 server_base.cc:1034] running on GCE node
I20260808 14:45:20.183323 7167 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:45:20.183620 7167 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:45:20.184764 7167 hybrid_clock.cc:648] HybridClock initialized: now 1786200320184749 us; error 32 us; skew 500 ppm
I20260808 14:45:20.186075 7167 webserver.cc:460] Webserver started at http://127.30.214.190:42387/ using document root <none> and password file <none>
I20260808 14:45:20.186301 7167 fs_manager.cc:359] Metadata directory not provided
I20260808 14:45:20.186347 7167 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:45:20.186482 7167 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:45:20.187601 7167 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786200295877777-31578-0/minicluster-data/master-0/data/instance:
uuid: "54db2ef0071a46dcbbbf2f5747cc08d4"
format_stamp: "Formatted at 2026-08-08 14:45:20 on dist-test-slave-42z9"
server_key: "81062e31506296fad6ab54295e78b56f"
server_key_iv: "934bc703b275eb8a659d5efcf86159c0"
server_key_version: "encryptionkey@0"
I20260808 14:45:20.187938 7167 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786200295877777-31578-0/minicluster-data/master-0/wal/instance:
uuid: "54db2ef0071a46dcbbbf2f5747cc08d4"
format_stamp: "Formatted at 2026-08-08 14:45:20 on dist-test-slave-42z9"
server_key: "81062e31506296fad6ab54295e78b56f"
server_key_iv: "934bc703b275eb8a659d5efcf86159c0"
server_key_version: "encryptionkey@0"
I20260808 14:45:20.189294 7167 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 14:45:20.190062 7186 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:20.190212 7167 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:20.190299 7167 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786200295877777-31578-0/minicluster-data/master-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786200295877777-31578-0/minicluster-data/master-0/wal
uuid: "54db2ef0071a46dcbbbf2f5747cc08d4"
format_stamp: "Formatted at 2026-08-08 14:45:20 on dist-test-slave-42z9"
server_key: "81062e31506296fad6ab54295e78b56f"
server_key_iv: "934bc703b275eb8a659d5efcf86159c0"
server_key_version: "encryptionkey@0"
I20260808 14:45:20.190374 7167 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786200295877777-31578-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786200295877777-31578-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786200295877777-31578-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:45:20.203810 7167 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:45:20.204156 7167 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:45:20.204290 7167 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:45:20.208130 7167 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.190:38947
I20260808 14:45:20.208177 7253 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.190:38947 every 8 connection(s)
I20260808 14:45:20.208503 7167 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
I20260808 14:45:20.209219 7255 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:45:20.211959 7255 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 54db2ef0071a46dcbbbf2f5747cc08d4: Bootstrap starting.
I20260808 14:45:20.212558 7255 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 54db2ef0071a46dcbbbf2f5747cc08d4: Neither blocks nor log segments found. Creating new log.
I20260808 14:45:20.212787 7255 log.cc:824] T 00000000000000000000000000000000 P 54db2ef0071a46dcbbbf2f5747cc08d4: Log is configured to *not* fsync() on all Append() calls
I20260808 14:45:20.213490 7255 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 54db2ef0071a46dcbbbf2f5747cc08d4: No bootstrap required, opened a new log
I20260808 14:45:20.215094 7255 raft_consensus.cc:348] T 00000000000000000000000000000000 P 54db2ef0071a46dcbbbf2f5747cc08d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54db2ef0071a46dcbbbf2f5747cc08d4" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 38947 } }
I20260808 14:45:20.215240 7255 raft_consensus.cc:374] T 00000000000000000000000000000000 P 54db2ef0071a46dcbbbf2f5747cc08d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:45:20.215269 7255 raft_consensus.cc:729] T 00000000000000000000000000000000 P 54db2ef0071a46dcbbbf2f5747cc08d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54db2ef0071a46dcbbbf2f5747cc08d4, State: Initialized, Role: FOLLOWER
I20260808 14:45:20.215379 7255 consensus_queue.cc:260] T 00000000000000000000000000000000 P 54db2ef0071a46dcbbbf2f5747cc08d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54db2ef0071a46dcbbbf2f5747cc08d4" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 38947 } }
I20260808 14:45:20.215457 7255 raft_consensus.cc:388] T 00000000000000000000000000000000 P 54db2ef0071a46dcbbbf2f5747cc08d4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:45:20.215488 7255 raft_consensus.cc:482] T 00000000000000000000000000000000 P 54db2ef0071a46dcbbbf2f5747cc08d4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:45:20.215520 7255 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 54db2ef0071a46dcbbbf2f5747cc08d4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:20.215741 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 7167
I20260808 14:45:20.215838 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786200295877777-31578-0/minicluster-data/master-0/wal/instance
I20260808 14:45:20.216010 31578 external_mini_cluster.cc:1428] Setting key ab2c041b7a48bcd0fc817e0374529f45
I20260808 14:45:20.216248 7255 raft_consensus.cc:504] T 00000000000000000000000000000000 P 54db2ef0071a46dcbbbf2f5747cc08d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54db2ef0071a46dcbbbf2f5747cc08d4" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 38947 } }
I20260808 14:45:20.216357 7255 leader_election.cc:302] T 00000000000000000000000000000000 P 54db2ef0071a46dcbbbf2f5747cc08d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 54db2ef0071a46dcbbbf2f5747cc08d4; no voters:
I20260808 14:45:20.216596 7255 leader_election.cc:288] T 00000000000000000000000000000000 P 54db2ef0071a46dcbbbf2f5747cc08d4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:45:20.216629 7260 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 54db2ef0071a46dcbbbf2f5747cc08d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:45:20.216789 7260 raft_consensus.cc:686] T 00000000000000000000000000000000 P 54db2ef0071a46dcbbbf2f5747cc08d4 [term 1 LEADER]: Becoming Leader. State: Replica: 54db2ef0071a46dcbbbf2f5747cc08d4, State: Running, Role: LEADER
I20260808 14:45:20.216900 7260 consensus_queue.cc:237] T 00000000000000000000000000000000 P 54db2ef0071a46dcbbbf2f5747cc08d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54db2ef0071a46dcbbbf2f5747cc08d4" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 38947 } }
I20260808 14:45:20.216948 7255 sys_catalog.cc:564] T 00000000000000000000000000000000 P 54db2ef0071a46dcbbbf2f5747cc08d4 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:45:20.217240 7266 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54db2ef0071a46dcbbbf2f5747cc08d4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "54db2ef0071a46dcbbbf2f5747cc08d4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54db2ef0071a46dcbbbf2f5747cc08d4" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 38947 } } }
I20260808 14:45:20.217319 7266 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54db2ef0071a46dcbbbf2f5747cc08d4 [sys.catalog]: This master's current role is: LEADER
I20260808 14:45:20.217564 7264 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54db2ef0071a46dcbbbf2f5747cc08d4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 54db2ef0071a46dcbbbf2f5747cc08d4. Latest consensus state: current_term: 1 leader_uuid: "54db2ef0071a46dcbbbf2f5747cc08d4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54db2ef0071a46dcbbbf2f5747cc08d4" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 38947 } } }
I20260808 14:45:20.217710 7264 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54db2ef0071a46dcbbbf2f5747cc08d4 [sys.catalog]: This master's current role is: LEADER
I20260808 14:45:20.217819 7275 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:45:20.218331 7275 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:45:20.220158 7275 catalog_manager.cc:1347] Generated new cluster ID: e23e74bbce224c56ba4fc2414de10813
I20260808 14:45:20.220207 7275 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:45:20.222163 7263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:20.216518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45632 (local address 127.30.214.190:38947)
0808 14:45:20.216764 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:20.216773 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:20.216815 (+ 42us) server_negotiation.cc:407] Connection header received
0808 14:45:20.216938 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:20.216945 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:20.217031 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:20.217179 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:20.217432 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:20.218907 (+ 1475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:20.219971 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:20.220565 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:20.220703 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:20.221391 (+ 688us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:20.221395 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:20.221396 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:45:20.221645 (+ 249us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:20.221690 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:45:20.221706 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:20.221780 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:20.221855 (+ 75us) server_negotiation.cc:299] Negotiation successful
0808 14:45:20.221940 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":80,"threads_started":1}
I20260808 14:45:20.223093 31578 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:45:20.243119 7275 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:45:20.243875 7275 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:45:20.247875 7275 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 54db2ef0071a46dcbbbf2f5747cc08d4: Generated new TSK 0
I20260808 14:45:20.248086 7275 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:45:20.257800 7263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:20.254044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45646 (local address 127.30.214.190:38947)
0808 14:45:20.254110 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:20.254113 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:20.254204 (+ 91us) server_negotiation.cc:407] Connection header received
0808 14:45:20.254292 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:20.254293 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:20.254306 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:20.254370 (+ 64us) server_negotiation.cc:226] Negotiated authn=JWT
0808 14:45:20.254526 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:20.255045 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:20.256194 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:20.256403 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:20.256459 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:20.256649 (+ 190us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 14:45:20.257589 (+ 940us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38333/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0808 14:45:20.257723 (+ 134us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:45646: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38333/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":37}
W20260808 14:45:20.257866 7263 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:45646: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38333/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260808 14:45:20.257925 7300 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:45:20.253964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:38947 (local address 127.0.0.1:45646)
0808 14:45:20.254130 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:20.254141 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:20.254214 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:20.254384 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:20.254384 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:20.254386 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0808 14:45:20.254455 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:20.254458 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:20.255123 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:20.255124 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:20.256110 (+ 986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:20.256113 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:20.256479 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:20.256480 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:20.256551 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:20.256557 (+ 6us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 14:45:20.257702 (+ 1145us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38333/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0808 14:45:20.257809 (+ 107us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.30.214.190:38947: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38333/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":111,"threads_started":1}
I20260808 14:45:20.258162 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 7167
E20260808 14:45:20.277467 7301 webserver.cc:533] Webserver: sslize failed:
E20260808 14:45:20.277580 7301 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-08T14:45:20Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (223 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-08T14:45:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:45:20Z Disabled control of system clock
I20260808 14:45:20.312959 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200295877777-31578-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200295877777-31578-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200295877777-31578-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:36013
--webserver_interface=127.30.214.190
--webserver_port=0
--builtin_ntp_servers=127.30.214.148:35543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.214.190:36013
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200295877777-31578-0/testchainca.cert with env {}
W20260808 14:45:20.396355 7305 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:45:20.396584 7305 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:45:20.396617 7305 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:45:20.397838 7305 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:45:20.397890 7305 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:45:20.397907 7305 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:45:20.397924 7305 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:45:20.397938 7305 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 14:45:20.397954 7305 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 14:45:20.397970 7305 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260808 14:45:20.399658 7305 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:35543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200295877777-31578-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200295877777-31578-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.214.190:36013
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:36013
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.214.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200295877777-31578-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7305
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200295877777-31578-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:45:20.399931 7305 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:45:20.400151 7305 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:45:20.404963 7314 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:20.404963 7316 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:20.405035 7313 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:20.405192 7305 server_base.cc:1034] running on GCE node
I20260808 14:45:20.405485 7305 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:45:20.405812 7305 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:45:20.406957 7305 hybrid_clock.cc:648] HybridClock initialized: now 1786200320406945 us; error 29 us; skew 500 ppm
I20260808 14:45:20.408162 7305 webserver.cc:460] Webserver started at http://127.30.214.190:39661/ using document root <none> and password file <none>
I20260808 14:45:20.408407 7305 fs_manager.cc:359] Metadata directory not provided
I20260808 14:45:20.408458 7305 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:45:20.408603 7305 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:45:20.409725 7305 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200295877777-31578-0/minicluster-data/master-0/data/instance:
uuid: "fea78a9612854beba89ef1139ac2be3d"
format_stamp: "Formatted at 2026-08-08 14:45:20 on dist-test-slave-42z9"
server_key: "0fa2d0a7cefbb6749699a3542110a58c"
server_key_iv: "a0dc42be0bde3bb6a1a6263111e90703"
server_key_version: "encryptionkey@0"
I20260808 14:45:20.410054 7305 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200295877777-31578-0/minicluster-data/master-0/wal/instance:
uuid: "fea78a9612854beba89ef1139ac2be3d"
format_stamp: "Formatted at 2026-08-08 14:45:20 on dist-test-slave-42z9"
server_key: "0fa2d0a7cefbb6749699a3542110a58c"
server_key_iv: "a0dc42be0bde3bb6a1a6263111e90703"
server_key_version: "encryptionkey@0"
I20260808 14:45:20.411278 7305 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 14:45:20.411949 7325 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:20.412103 7305 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:45:20.412189 7305 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200295877777-31578-0/minicluster-data/master-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200295877777-31578-0/minicluster-data/master-0/wal
uuid: "fea78a9612854beba89ef1139ac2be3d"
format_stamp: "Formatted at 2026-08-08 14:45:20 on dist-test-slave-42z9"
server_key: "0fa2d0a7cefbb6749699a3542110a58c"
server_key_iv: "a0dc42be0bde3bb6a1a6263111e90703"
server_key_version: "encryptionkey@0"
I20260808 14:45:20.412250 7305 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200295877777-31578-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200295877777-31578-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200295877777-31578-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:45:20.427619 7305 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:45:20.427959 7305 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:45:20.428108 7305 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:45:20.432085 7305 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.190:36013
I20260808 14:45:20.432132 7395 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.190:36013 every 8 connection(s)
I20260808 14:45:20.432471 7305 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
I20260808 14:45:20.433524 7396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:45:20.435977 7396 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fea78a9612854beba89ef1139ac2be3d: Bootstrap starting.
I20260808 14:45:20.436651 7396 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fea78a9612854beba89ef1139ac2be3d: Neither blocks nor log segments found. Creating new log.
I20260808 14:45:20.436897 7396 log.cc:824] T 00000000000000000000000000000000 P fea78a9612854beba89ef1139ac2be3d: Log is configured to *not* fsync() on all Append() calls
I20260808 14:45:20.437633 7396 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fea78a9612854beba89ef1139ac2be3d: No bootstrap required, opened a new log
I20260808 14:45:20.437963 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 7305
I20260808 14:45:20.438053 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786200295877777-31578-0/minicluster-data/master-0/wal/instance
I20260808 14:45:20.438246 31578 external_mini_cluster.cc:1428] Setting key 2588fa8de4d19c5ebcb3897e0b3a8fa6
I20260808 14:45:20.439992 7396 raft_consensus.cc:348] T 00000000000000000000000000000000 P fea78a9612854beba89ef1139ac2be3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fea78a9612854beba89ef1139ac2be3d" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 36013 } }
I20260808 14:45:20.440196 7396 raft_consensus.cc:374] T 00000000000000000000000000000000 P fea78a9612854beba89ef1139ac2be3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:45:20.440228 7396 raft_consensus.cc:729] T 00000000000000000000000000000000 P fea78a9612854beba89ef1139ac2be3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fea78a9612854beba89ef1139ac2be3d, State: Initialized, Role: FOLLOWER
I20260808 14:45:20.440367 7396 consensus_queue.cc:260] T 00000000000000000000000000000000 P fea78a9612854beba89ef1139ac2be3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fea78a9612854beba89ef1139ac2be3d" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 36013 } }
I20260808 14:45:20.440449 7396 raft_consensus.cc:388] T 00000000000000000000000000000000 P fea78a9612854beba89ef1139ac2be3d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:45:20.440486 7396 raft_consensus.cc:482] T 00000000000000000000000000000000 P fea78a9612854beba89ef1139ac2be3d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:45:20.440531 7396 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fea78a9612854beba89ef1139ac2be3d [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:20.441308 7396 raft_consensus.cc:504] T 00000000000000000000000000000000 P fea78a9612854beba89ef1139ac2be3d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fea78a9612854beba89ef1139ac2be3d" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 36013 } }
I20260808 14:45:20.441421 7396 leader_election.cc:302] T 00000000000000000000000000000000 P fea78a9612854beba89ef1139ac2be3d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fea78a9612854beba89ef1139ac2be3d; no voters:
I20260808 14:45:20.441612 7396 leader_election.cc:288] T 00000000000000000000000000000000 P fea78a9612854beba89ef1139ac2be3d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:45:20.441654 7405 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fea78a9612854beba89ef1139ac2be3d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:45:20.441823 7405 raft_consensus.cc:686] T 00000000000000000000000000000000 P fea78a9612854beba89ef1139ac2be3d [term 1 LEADER]: Becoming Leader. State: Replica: fea78a9612854beba89ef1139ac2be3d, State: Running, Role: LEADER
I20260808 14:45:20.441902 7396 sys_catalog.cc:564] T 00000000000000000000000000000000 P fea78a9612854beba89ef1139ac2be3d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:45:20.441968 7405 consensus_queue.cc:237] T 00000000000000000000000000000000 P fea78a9612854beba89ef1139ac2be3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fea78a9612854beba89ef1139ac2be3d" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 36013 } }
I20260808 14:45:20.442417 7408 sys_catalog.cc:455] T 00000000000000000000000000000000 P fea78a9612854beba89ef1139ac2be3d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fea78a9612854beba89ef1139ac2be3d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fea78a9612854beba89ef1139ac2be3d" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 36013 } } }
I20260808 14:45:20.442497 7408 sys_catalog.cc:458] T 00000000000000000000000000000000 P fea78a9612854beba89ef1139ac2be3d [sys.catalog]: This master's current role is: LEADER
I20260808 14:45:20.442695 7409 sys_catalog.cc:455] T 00000000000000000000000000000000 P fea78a9612854beba89ef1139ac2be3d [sys.catalog]: SysCatalogTable state changed. Reason: New leader fea78a9612854beba89ef1139ac2be3d. Latest consensus state: current_term: 1 leader_uuid: "fea78a9612854beba89ef1139ac2be3d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fea78a9612854beba89ef1139ac2be3d" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 36013 } } }
I20260808 14:45:20.442812 7409 sys_catalog.cc:458] T 00000000000000000000000000000000 P fea78a9612854beba89ef1139ac2be3d [sys.catalog]: This master's current role is: LEADER
I20260808 14:45:20.443228 7417 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:45:20.443763 7417 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:45:20.445060 7404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:20.438803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53982 (local address 127.30.214.190:36013)
0808 14:45:20.439021 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:20.439031 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:20.439064 (+ 33us) server_negotiation.cc:407] Connection header received
0808 14:45:20.439555 (+ 491us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:20.439565 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:20.439650 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:20.439815 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:20.440018 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:20.441680 (+ 1662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:20.442786 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:20.443433 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:20.443561 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:20.444285 (+ 724us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:20.444289 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:20.444290 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:45:20.444518 (+ 228us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:20.444560 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:45:20.444575 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:20.444640 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:20.444753 (+ 113us) server_negotiation.cc:299] Negotiation successful
0808 14:45:20.444838 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":100,"threads_started":1}
I20260808 14:45:20.445252 7417 catalog_manager.cc:1347] Generated new cluster ID: 39ab1c47d145482882cafac369c3f109
I20260808 14:45:20.445304 7417 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:45:20.446092 31578 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:45:20.453156 7417 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:45:20.453886 7417 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:45:20.458082 7417 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fea78a9612854beba89ef1139ac2be3d: Generated new TSK 0
I20260808 14:45:20.458318 7417 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:45:20.475653 7404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:20.463649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53998 (local address 127.30.214.190:36013)
0808 14:45:20.463697 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:20.463699 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:20.463787 (+ 88us) server_negotiation.cc:407] Connection header received
0808 14:45:20.463848 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:20.463849 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:20.463862 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:20.463957 (+ 95us) server_negotiation.cc:226] Negotiated authn=JWT
0808 14:45:20.464132 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:20.464932 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:20.465786 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:20.466106 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:20.466179 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:20.466358 (+ 179us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 14:45:20.475340 (+ 8982us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0808 14:45:20.475570 (+ 230us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:53998: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":27}
W20260808 14:45:20.475736 7404 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:53998: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260808 14:45:20.475778 7437 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:45:20.463569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:36013 (local address 127.0.0.1:53998)
0808 14:45:20.463717 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:20.463728 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:20.463786 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:20.463996 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:20.463997 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:20.463999 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0808 14:45:20.464058 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:20.464060 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:20.465054 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:20.465055 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:20.465715 (+ 660us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:20.465717 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:20.466193 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:20.466194 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:20.466248 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:20.466254 (+ 6us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 14:45:20.475545 (+ 9291us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0808 14:45:20.475678 (+ 133us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.30.214.190:36013: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":89,"threads_started":1}
I20260808 14:45:20.476181 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 7305
2026-08-08T14:45:20Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (204 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (93 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (91 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:45:20 dist-test-slave-42z9 krb5kdc[7458](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:45:20 dist-test-slave-42z9 krb5kdc[7458](info): set up 2 sockets
Aug 08 14:45:20 dist-test-slave-42z9 krb5kdc[7458](info): commencing operation
krb5kdc: starting...
W20260808 14:45:21.826031 31578 mini_kdc.cc:121] Time spent starting KDC: real 1.132s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
W20260808 14:45:21.972414 31578 mini_kdc.cc:253] Time spent creating user principal test-admin: real 0.146s user 0.000s sys 0.002s
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
W20260808 14:45:22.073909 31578 mini_kdc.cc:253] Time spent creating user principal test-user: real 0.101s user 0.000s sys 0.002s
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
W20260808 14:45:22.198323 31578 mini_kdc.cc:253] Time spent creating user principal joe-interloper: real 0.124s user 0.000s sys 0.002s
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/krb5kdc/test-user.keytab.
W20260808 14:45:22.836894 31578 mini_kdc.cc:302] Time spent creating keytab for test-user: real 0.638s user 0.000s sys 0.001s
Aug 08 14:45:22 dist-test-slave-42z9 krb5kdc[7458](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200322, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:45:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:45:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.214.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab.
Entry for principal kudu/127.30.214.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab.
I20260808 14:45:22.884366 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:41903
--webserver_interface=127.30.214.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab
--principal=kudu/127.30.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:38519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.214.190:41903
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:45:22.969236 7477 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:45:22.969494 7477 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:45:22.969530 7477 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:45:22.970778 7477 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:45:22.970826 7477 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:45:22.970846 7477 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:45:22.970863 7477 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:45:22.970880 7477 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:45:22.972766 7477 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:38519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.214.190:41903
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab
--principal=kudu/127.30.214.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:41903
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7477
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:45:22.973204 7477 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:45:22.973487 7477 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:45:22.978478 7487 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:22.978495 7488 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:22.978478 7490 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:22.978714 7477 server_base.cc:1034] running on GCE node
I20260808 14:45:22.978996 7477 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:45:22.979308 7477 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:45:22.980473 7477 hybrid_clock.cc:648] HybridClock initialized: now 1786200322980432 us; error 61 us; skew 500 ppm
Aug 08 14:45:22 dist-test-slave-42z9 krb5kdc[7458](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200322, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:45:22.983052 7477 init.cc:377] Logged in from keytab as kudu/127.30.214.190@KRBTEST.COM (short username kudu)
I20260808 14:45:22.983531 7477 webserver.cc:460] Webserver started at http://127.30.214.190:34529/ using document root <none> and password file <none>
I20260808 14:45:22.983762 7477 fs_manager.cc:359] Metadata directory not provided
I20260808 14:45:22.983814 7477 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:45:22.983953 7477 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:45:22.985062 7477 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/minicluster-data/master-0/data/instance:
uuid: "7bb932c073274b4ca7cdbc4ff968c088"
format_stamp: "Formatted at 2026-08-08 14:45:22 on dist-test-slave-42z9"
server_key: "8124559ead5b1b36830bf7ea55a7f722"
server_key_iv: "e4a314cfffdc3f5c6b296a16b921d49a"
server_key_version: "encryptionkey@0"
I20260808 14:45:22.985415 7477 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/minicluster-data/master-0/wal/instance:
uuid: "7bb932c073274b4ca7cdbc4ff968c088"
format_stamp: "Formatted at 2026-08-08 14:45:22 on dist-test-slave-42z9"
server_key: "8124559ead5b1b36830bf7ea55a7f722"
server_key_iv: "e4a314cfffdc3f5c6b296a16b921d49a"
server_key_version: "encryptionkey@0"
I20260808 14:45:22.986819 7477 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:45:22.987659 7500 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:22.987815 7477 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:45:22.987910 7477 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/minicluster-data/master-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/minicluster-data/master-0/wal
uuid: "7bb932c073274b4ca7cdbc4ff968c088"
format_stamp: "Formatted at 2026-08-08 14:45:22 on dist-test-slave-42z9"
server_key: "8124559ead5b1b36830bf7ea55a7f722"
server_key_iv: "e4a314cfffdc3f5c6b296a16b921d49a"
server_key_version: "encryptionkey@0"
I20260808 14:45:22.987979 7477 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:45:23.009896 7477 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:45:23.011849 7477 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:45:23.012003 7477 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:45:23.015970 7477 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.190:41903
I20260808 14:45:23.016011 7582 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.190:41903 every 8 connection(s)
I20260808 14:45:23.016353 7477 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
I20260808 14:45:23.017239 7587 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:45:23.019685 7587 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7bb932c073274b4ca7cdbc4ff968c088: Bootstrap starting.
I20260808 14:45:23.020340 7587 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7bb932c073274b4ca7cdbc4ff968c088: Neither blocks nor log segments found. Creating new log.
I20260808 14:45:23.020344 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 7477
I20260808 14:45:23.020439 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/minicluster-data/master-0/wal/instance
I20260808 14:45:23.020648 31578 external_mini_cluster.cc:1428] Setting key ab0e7fb48771311ca921ddc07f8ddd08
I20260808 14:45:23.020718 7587 log.cc:824] T 00000000000000000000000000000000 P 7bb932c073274b4ca7cdbc4ff968c088: Log is configured to *not* fsync() on all Append() calls
I20260808 14:45:23.021675 7587 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7bb932c073274b4ca7cdbc4ff968c088: No bootstrap required, opened a new log
I20260808 14:45:23.024143 7587 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7bb932c073274b4ca7cdbc4ff968c088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bb932c073274b4ca7cdbc4ff968c088" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41903 } }
I20260808 14:45:23.024322 7587 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7bb932c073274b4ca7cdbc4ff968c088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:45:23.024360 7587 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7bb932c073274b4ca7cdbc4ff968c088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bb932c073274b4ca7cdbc4ff968c088, State: Initialized, Role: FOLLOWER
I20260808 14:45:23.024524 7587 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7bb932c073274b4ca7cdbc4ff968c088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bb932c073274b4ca7cdbc4ff968c088" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41903 } }
I20260808 14:45:23.024606 7587 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7bb932c073274b4ca7cdbc4ff968c088 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:45:23.024629 7587 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7bb932c073274b4ca7cdbc4ff968c088 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:45:23.024662 7587 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7bb932c073274b4ca7cdbc4ff968c088 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:23.025275 7587 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7bb932c073274b4ca7cdbc4ff968c088 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bb932c073274b4ca7cdbc4ff968c088" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41903 } }
I20260808 14:45:23.025393 7587 leader_election.cc:302] T 00000000000000000000000000000000 P 7bb932c073274b4ca7cdbc4ff968c088 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7bb932c073274b4ca7cdbc4ff968c088; no voters:
I20260808 14:45:23.025600 7587 leader_election.cc:288] T 00000000000000000000000000000000 P 7bb932c073274b4ca7cdbc4ff968c088 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:45:23.025655 7593 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7bb932c073274b4ca7cdbc4ff968c088 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:45:23.025856 7593 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7bb932c073274b4ca7cdbc4ff968c088 [term 1 LEADER]: Becoming Leader. State: Replica: 7bb932c073274b4ca7cdbc4ff968c088, State: Running, Role: LEADER
I20260808 14:45:23.025895 7587 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7bb932c073274b4ca7cdbc4ff968c088 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:45:23.026023 7593 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7bb932c073274b4ca7cdbc4ff968c088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bb932c073274b4ca7cdbc4ff968c088" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41903 } }
I20260808 14:45:23.026361 7593 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7bb932c073274b4ca7cdbc4ff968c088 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7bb932c073274b4ca7cdbc4ff968c088. Latest consensus state: current_term: 1 leader_uuid: "7bb932c073274b4ca7cdbc4ff968c088" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bb932c073274b4ca7cdbc4ff968c088" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41903 } } }
I20260808 14:45:23.026508 7593 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7bb932c073274b4ca7cdbc4ff968c088 [sys.catalog]: This master's current role is: LEADER
I20260808 14:45:23.026791 7604 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:45:23.027346 7604 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 08 14:45:23 dist-test-slave-42z9 krb5kdc[7458](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200322, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:45:23.026397 7594 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7bb932c073274b4ca7cdbc4ff968c088 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7bb932c073274b4ca7cdbc4ff968c088" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bb932c073274b4ca7cdbc4ff968c088" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41903 } } }
I20260808 14:45:23.028648 7594 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7bb932c073274b4ca7cdbc4ff968c088 [sys.catalog]: This master's current role is: LEADER
I20260808 14:45:23.029224 7604 catalog_manager.cc:1347] Generated new cluster ID: 651a93cc34524623922471c3815c02ed
I20260808 14:45:23.029301 7604 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:45:23.036135 7592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:23.021186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46116 (local address 127.30.214.190:41903)
0808 14:45:23.021340 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:23.021350 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:23.021385 (+ 35us) server_negotiation.cc:407] Connection header received
0808 14:45:23.022012 (+ 627us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:23.022022 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:23.022089 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:23.022248 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:23.022886 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:23.024290 (+ 1404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:23.025144 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:23.025778 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:23.025904 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:23.028754 (+ 2850us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:23.028758 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:23.028758 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:23.028771 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:23.034322 (+ 5551us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:23.034786 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:23.034790 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:23.034790 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:23.034919 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:23.035131 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:23.035132 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:23.035132 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:23.035473 (+ 341us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:23.035635 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:23.035725 (+ 90us) server_negotiation.cc:299] Negotiation successful
0808 14:45:23.035878 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106,"thread_start_us":64,"threads_started":1}
I20260808 14:45:23.054483 7604 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:45:23.055259 7604 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:45:23.067308 7604 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7bb932c073274b4ca7cdbc4ff968c088: Generated new TSK 0
I20260808 14:45:23.067543 7604 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.214.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab.
Entry for principal kudu/127.30.214.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab.
I20260808 14:45:23.098603 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.129:0
--local_ip_for_outbound_sockets=127.30.214.129
--webserver_interface=127.30.214.129
--webserver_port=0
--tserver_master_addrs=127.30.214.190:41903
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab
--principal=kudu/127.30.214.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:38519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:45:23.187222 7623 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:45:23.187451 7623 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:45:23.187477 7623 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:45:23.188716 7623 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:45:23.188771 7623 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:45:23.188798 7623 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.129
I20260808 14:45:23.190443 7623 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:38519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab
--principal=kudu/127.30.214.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.214.129
--webserver_port=0
--tserver_master_addrs=127.30.214.190:41903
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7623
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.129
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:45:23.190694 7623 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:45:23.190937 7623 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:45:23.196081 7635 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:23.196147 7631 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:23.196166 7623 server_base.cc:1034] running on GCE node
W20260808 14:45:23.196081 7633 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:23.196537 7623 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:45:23.196770 7623 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:45:23.197921 7623 hybrid_clock.cc:648] HybridClock initialized: now 1786200323197903 us; error 35 us; skew 500 ppm
Aug 08 14:45:23 dist-test-slave-42z9 krb5kdc[7458](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200323, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:45:23.200549 7623 init.cc:377] Logged in from keytab as kudu/127.30.214.129@KRBTEST.COM (short username kudu)
I20260808 14:45:23.200986 7623 webserver.cc:460] Webserver started at http://127.30.214.129:40783/ using document root <none> and password file <none>
I20260808 14:45:23.201170 7623 fs_manager.cc:359] Metadata directory not provided
I20260808 14:45:23.201210 7623 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:45:23.201301 7623 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:45:23.202477 7623 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/minicluster-data/ts-0/data/instance:
uuid: "de7c3432a4df4d2fac34860076f126c4"
format_stamp: "Formatted at 2026-08-08 14:45:23 on dist-test-slave-42z9"
server_key: "3c03cbb8296af9104d2c7b5898faa599"
server_key_iv: "1fa6947421b4a31f0570fb68a70d9838"
server_key_version: "encryptionkey@0"
I20260808 14:45:23.202783 7623 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/minicluster-data/ts-0/wal/instance:
uuid: "de7c3432a4df4d2fac34860076f126c4"
format_stamp: "Formatted at 2026-08-08 14:45:23 on dist-test-slave-42z9"
server_key: "3c03cbb8296af9104d2c7b5898faa599"
server_key_iv: "1fa6947421b4a31f0570fb68a70d9838"
server_key_version: "encryptionkey@0"
I20260808 14:45:23.204028 7623 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:45:23.204722 7649 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:23.204880 7623 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:45:23.204957 7623 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/minicluster-data/ts-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/minicluster-data/ts-0/wal
uuid: "de7c3432a4df4d2fac34860076f126c4"
format_stamp: "Formatted at 2026-08-08 14:45:23 on dist-test-slave-42z9"
server_key: "3c03cbb8296af9104d2c7b5898faa599"
server_key_iv: "1fa6947421b4a31f0570fb68a70d9838"
server_key_version: "encryptionkey@0"
I20260808 14:45:23.205032 7623 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:45:23.230695 7623 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:45:23.232712 7623 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:45:23.232841 7623 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:45:23.233187 7623 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:45:23.233601 7623 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:45:23.233641 7623 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:23.233665 7623 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:45:23.233676 7623 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:23.239315 7623 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.129:43081
I20260808 14:45:23.239368 7815 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.129:43081 every 8 connection(s)
I20260808 14:45:23.239701 7623 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
Aug 08 14:45:23 dist-test-slave-42z9 krb5kdc[7458](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200323, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.129@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:45:23.246670 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 7623
I20260808 14:45:23.246779 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/minicluster-data/ts-0/wal/instance
I20260808 14:45:23.247008 31578 external_mini_cluster.cc:1428] Setting key 1629e1920340d33a67065172b2d08fb3
I20260808 14:45:23.249106 7592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:23.240515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.129:38733 (local address 127.30.214.190:41903)
0808 14:45:23.240596 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:23.240598 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:23.240732 (+ 134us) server_negotiation.cc:407] Connection header received
0808 14:45:23.241727 (+ 995us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:23.241728 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:23.241739 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:23.241781 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:23.242398 (+ 617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:23.242914 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:23.243938 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:23.244132 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:23.244178 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:23.246337 (+ 2159us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:23.246338 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:23.246339 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:23.246345 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:23.247796 (+ 1451us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:23.248193 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:23.248194 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:23.248195 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:23.248252 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:23.248483 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:23.248484 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:23.248484 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:23.248602 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:23.248658 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:23.248920 (+ 262us) server_negotiation.cc:299] Negotiation successful
0808 14:45:23.249012 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 14:45:23.249289 7820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:23.240428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:41903 (local address 127.30.214.129:38733)
0808 14:45:23.240604 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:23.240644 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:23.241622 (+ 978us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:23.241852 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:23.241855 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:23.242130 (+ 275us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:23.242328 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:23.242332 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:23.243036 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:23.243037 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:23.243867 (+ 830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:23.243869 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:23.244196 (+ 327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:23.244197 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:23.244302 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:23.244832 (+ 530us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:23.244840 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:23.246225 (+ 1385us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:23.247873 (+ 1648us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:23.247883 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:23.247885 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:23.248120 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:23.248310 (+ 190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:23.248310 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:23.248311 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:23.248416 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:23.248659 (+ 243us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:23.248666 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:23.248800 (+ 134us) client_negotiation.cc:769] Sending connection context
0808 14:45:23.248892 (+ 92us) client_negotiation.cc:240] Negotiation successful
0808 14:45:23.249067 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":80,"threads_started":1}
I20260808 14:45:23.249854 7818 heartbeater.cc:347] Connected to a master server at 127.30.214.190:41903
I20260808 14:45:23.249966 7818 heartbeater.cc:464] Registering TS with master...
I20260808 14:45:23.250169 7818 heartbeater.cc:511] Master 127.30.214.190:41903 requested a full tablet report, sending...
I20260808 14:45:23.250677 7527 ts_manager.cc:194] Registered new tserver with Master: de7c3432a4df4d2fac34860076f126c4 (127.30.214.129:43081)
I20260808 14:45:23.251297 7527 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.214.129@KRBTEST.COM'} at 127.30.214.129:38733
WARNING: no policy specified for kudu/127.30.214.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab.
Entry for principal kudu/127.30.214.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab.
I20260808 14:45:23.274413 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.130:0
--local_ip_for_outbound_sockets=127.30.214.130
--webserver_interface=127.30.214.130
--webserver_port=0
--tserver_master_addrs=127.30.214.190:41903
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab
--principal=kudu/127.30.214.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:38519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:45:23.358232 7824 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:45:23.358453 7824 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:45:23.358477 7824 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:45:23.359639 7824 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:45:23.359689 7824 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:45:23.359724 7824 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.130
I20260808 14:45:23.361276 7824 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:38519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab
--principal=kudu/127.30.214.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.214.130
--webserver_port=0
--tserver_master_addrs=127.30.214.190:41903
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7824
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.130
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:45:23.361560 7824 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:45:23.361804 7824 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:45:23.366885 7835 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:23.366853 7837 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:23.366892 7824 server_base.cc:1034] running on GCE node
W20260808 14:45:23.366849 7834 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:23.367378 7824 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:45:23.367640 7824 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:45:23.368800 7824 hybrid_clock.cc:648] HybridClock initialized: now 1786200323368785 us; error 32 us; skew 500 ppm
Aug 08 14:45:23 dist-test-slave-42z9 krb5kdc[7458](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200323, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:45:23.371280 7824 init.cc:377] Logged in from keytab as kudu/127.30.214.130@KRBTEST.COM (short username kudu)
I20260808 14:45:23.371769 7824 webserver.cc:460] Webserver started at http://127.30.214.130:41439/ using document root <none> and password file <none>
I20260808 14:45:23.371997 7824 fs_manager.cc:359] Metadata directory not provided
I20260808 14:45:23.372048 7824 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:45:23.372174 7824 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:45:23.373251 7824 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/minicluster-data/ts-1/data/instance:
uuid: "70b515d0315e4c5992fa37521b56f963"
format_stamp: "Formatted at 2026-08-08 14:45:23 on dist-test-slave-42z9"
server_key: "2105abb8bc9a7b878c618bfc49ac11ad"
server_key_iv: "5222596851ed9280905ceb17ab0e39ff"
server_key_version: "encryptionkey@0"
I20260808 14:45:23.373608 7824 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/minicluster-data/ts-1/wal/instance:
uuid: "70b515d0315e4c5992fa37521b56f963"
format_stamp: "Formatted at 2026-08-08 14:45:23 on dist-test-slave-42z9"
server_key: "2105abb8bc9a7b878c618bfc49ac11ad"
server_key_iv: "5222596851ed9280905ceb17ab0e39ff"
server_key_version: "encryptionkey@0"
I20260808 14:45:23.374887 7824 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:45:23.375622 7846 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:23.375771 7824 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:45:23.375859 7824 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/minicluster-data/ts-1/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/minicluster-data/ts-1/wal
uuid: "70b515d0315e4c5992fa37521b56f963"
format_stamp: "Formatted at 2026-08-08 14:45:23 on dist-test-slave-42z9"
server_key: "2105abb8bc9a7b878c618bfc49ac11ad"
server_key_iv: "5222596851ed9280905ceb17ab0e39ff"
server_key_version: "encryptionkey@0"
I20260808 14:45:23.375923 7824 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:45:23.386830 7824 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:45:23.388618 7824 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:45:23.388769 7824 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:45:23.389016 7824 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:45:23.389321 7824 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:45:23.389356 7824 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:23.389386 7824 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:45:23.389403 7824 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:23.395444 7824 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.130:34825
I20260808 14:45:23.395502 8011 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.130:34825 every 8 connection(s)
I20260808 14:45:23.395810 7824 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
I20260808 14:45:23.400431 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 7824
I20260808 14:45:23.400550 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/minicluster-data/ts-1/wal/instance
I20260808 14:45:23.400722 31578 external_mini_cluster.cc:1428] Setting key 0b2f819296b051ada64ba1d663863b87
Aug 08 14:45:23 dist-test-slave-42z9 krb5kdc[7458](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200323, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.130@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:45:23.405236 7592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:23.396516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.130:36955 (local address 127.30.214.190:41903)
0808 14:45:23.396579 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:23.396582 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:23.396797 (+ 215us) server_negotiation.cc:407] Connection header received
0808 14:45:23.397761 (+ 964us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:23.397762 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:23.397772 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:23.397828 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:23.398446 (+ 618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:23.398947 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:23.399944 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:23.400137 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:23.400186 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:23.402463 (+ 2277us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:23.402465 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:23.402465 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:23.402474 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:23.403795 (+ 1321us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:23.404274 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:23.404274 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:23.404275 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:23.404323 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:23.404573 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:23.404574 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:23.404575 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:23.404707 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:23.404769 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:23.405050 (+ 281us) server_negotiation.cc:299] Negotiation successful
0808 14:45:23.405144 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 14:45:23.405395 8018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:23.396507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:41903 (local address 127.30.214.130:36955)
0808 14:45:23.396679 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:23.396718 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:23.397668 (+ 950us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:23.397894 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:23.397897 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:23.398158 (+ 261us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:23.398355 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:23.398359 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:23.399027 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:23.399027 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:23.399871 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:23.399874 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:23.400196 (+ 322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:23.400197 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:23.400303 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:23.400887 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:23.400897 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:23.402370 (+ 1473us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:23.403877 (+ 1507us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:23.403886 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:23.403888 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:23.404201 (+ 313us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:23.404376 (+ 175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:23.404376 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:23.404377 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:23.404504 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:23.404767 (+ 263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:23.404774 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:23.404918 (+ 144us) client_negotiation.cc:769] Sending connection context
0808 14:45:23.405009 (+ 91us) client_negotiation.cc:240] Negotiation successful
0808 14:45:23.405172 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":94,"threads_started":1}
I20260808 14:45:23.405930 8016 heartbeater.cc:347] Connected to a master server at 127.30.214.190:41903
I20260808 14:45:23.406051 8016 heartbeater.cc:464] Registering TS with master...
I20260808 14:45:23.406263 8016 heartbeater.cc:511] Master 127.30.214.190:41903 requested a full tablet report, sending...
I20260808 14:45:23.406635 7527 ts_manager.cc:194] Registered new tserver with Master: 70b515d0315e4c5992fa37521b56f963 (127.30.214.130:34825)
I20260808 14:45:23.407015 7527 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.214.130@KRBTEST.COM'} at 127.30.214.130:36955
WARNING: no policy specified for kudu/127.30.214.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab.
Entry for principal kudu/127.30.214.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab.
I20260808 14:45:23.429100 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.131:0
--local_ip_for_outbound_sockets=127.30.214.131
--webserver_interface=127.30.214.131
--webserver_port=0
--tserver_master_addrs=127.30.214.190:41903
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab
--principal=kudu/127.30.214.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:38519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:45:23.515785 8021 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:45:23.516009 8021 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:45:23.516033 8021 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:45:23.517268 8021 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:45:23.517318 8021 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:45:23.517346 8021 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.131
I20260808 14:45:23.518988 8021 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:38519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab
--principal=kudu/127.30.214.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.214.131
--webserver_port=0
--tserver_master_addrs=127.30.214.190:41903
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8021
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.131
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:45:23.519246 8021 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:45:23.519526 8021 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:45:23.524717 8030 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:23.524714 8027 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:23.524807 8021 server_base.cc:1034] running on GCE node
W20260808 14:45:23.524755 8032 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:23.525209 8021 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:45:23.525506 8021 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:45:23.526677 8021 hybrid_clock.cc:648] HybridClock initialized: now 1786200323526657 us; error 33 us; skew 500 ppm
Aug 08 14:45:23 dist-test-slave-42z9 krb5kdc[7458](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200323, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:45:23.529331 8021 init.cc:377] Logged in from keytab as kudu/127.30.214.131@KRBTEST.COM (short username kudu)
I20260808 14:45:23.529844 8021 webserver.cc:460] Webserver started at http://127.30.214.131:35475/ using document root <none> and password file <none>
I20260808 14:45:23.530086 8021 fs_manager.cc:359] Metadata directory not provided
I20260808 14:45:23.530138 8021 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:45:23.530263 8021 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:45:23.531325 8021 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/minicluster-data/ts-2/data/instance:
uuid: "1a1b911f645749198210bc46b3b6a01a"
format_stamp: "Formatted at 2026-08-08 14:45:23 on dist-test-slave-42z9"
server_key: "f17b322b0a3c3b503ec2cdf98847b663"
server_key_iv: "c85dd95699e2a24b552457164a2e1c5a"
server_key_version: "encryptionkey@0"
I20260808 14:45:23.531662 8021 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/minicluster-data/ts-2/wal/instance:
uuid: "1a1b911f645749198210bc46b3b6a01a"
format_stamp: "Formatted at 2026-08-08 14:45:23 on dist-test-slave-42z9"
server_key: "f17b322b0a3c3b503ec2cdf98847b663"
server_key_iv: "c85dd95699e2a24b552457164a2e1c5a"
server_key_version: "encryptionkey@0"
I20260808 14:45:23.532932 8021 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 14:45:23.533710 8041 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:23.533878 8021 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:45:23.533993 8021 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/minicluster-data/ts-2/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/minicluster-data/ts-2/wal
uuid: "1a1b911f645749198210bc46b3b6a01a"
format_stamp: "Formatted at 2026-08-08 14:45:23 on dist-test-slave-42z9"
server_key: "f17b322b0a3c3b503ec2cdf98847b663"
server_key_iv: "c85dd95699e2a24b552457164a2e1c5a"
server_key_version: "encryptionkey@0"
I20260808 14:45:23.534057 8021 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:45:23.550470 8021 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:45:23.552304 8021 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:45:23.552449 8021 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:45:23.552685 8021 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:45:23.553009 8021 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:45:23.553042 8021 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:23.553071 8021 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:45:23.553095 8021 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:23.558950 8021 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.131:38489
I20260808 14:45:23.559079 8200 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.131:38489 every 8 connection(s)
I20260808 14:45:23.559337 8021 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
I20260808 14:45:23.565263 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 8021
I20260808 14:45:23.565356 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/minicluster-data/ts-2/wal/instance
Aug 08 14:45:23 dist-test-slave-42z9 krb5kdc[7458](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200323, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.131@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:45:23.565573 31578 external_mini_cluster.cc:1428] Setting key db5118012016117a14e8e7d3a26d9c49
I20260808 14:45:23.568493 7592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:23.560062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:46613 (local address 127.30.214.190:41903)
0808 14:45:23.560120 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:23.560122 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:23.560326 (+ 204us) server_negotiation.cc:407] Connection header received
0808 14:45:23.561285 (+ 959us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:23.561286 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:23.561300 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:23.561348 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:23.562082 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:23.562589 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:23.563566 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:23.563760 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:23.563816 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:23.565963 (+ 2147us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:23.565964 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:23.565965 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:23.565973 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:23.567245 (+ 1272us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:23.567683 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:23.567684 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:23.567685 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:23.567741 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:23.567952 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:23.567952 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:23.567953 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:23.568074 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:23.568130 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:23.568353 (+ 223us) server_negotiation.cc:299] Negotiation successful
0808 14:45:23.568426 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 14:45:23.568683 8204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:23.560033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:41903 (local address 127.30.214.131:46613)
0808 14:45:23.560192 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:23.560232 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:23.561174 (+ 942us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:23.561429 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:23.561433 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:23.561743 (+ 310us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:23.561982 (+ 239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:23.561987 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:23.562672 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:23.562673 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:23.563481 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:23.563483 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:23.563830 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:23.563831 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:23.563962 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:23.564411 (+ 449us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:23.564418 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:23.565856 (+ 1438us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:23.567364 (+ 1508us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:23.567372 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:23.567374 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:23.567616 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:23.567801 (+ 185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:23.567802 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:23.567802 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:23.567900 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:23.568126 (+ 226us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:23.568130 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:23.568252 (+ 122us) client_negotiation.cc:769] Sending connection context
0808 14:45:23.568335 (+ 83us) client_negotiation.cc:240] Negotiation successful
0808 14:45:23.568465 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":80,"threads_started":1}
I20260808 14:45:23.569132 8201 heartbeater.cc:347] Connected to a master server at 127.30.214.190:41903
I20260808 14:45:23.569232 8201 heartbeater.cc:464] Registering TS with master...
I20260808 14:45:23.569410 8201 heartbeater.cc:511] Master 127.30.214.190:41903 requested a full tablet report, sending...
I20260808 14:45:23.569818 7527 ts_manager.cc:194] Registered new tserver with Master: 1a1b911f645749198210bc46b3b6a01a (127.30.214.131:38489)
I20260808 14:45:23.570199 7527 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.214.131@KRBTEST.COM'} at 127.30.214.131:46613
I20260808 14:45:23.577374 31578 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/krb5kdc/test-admin.keytab.
Aug 08 14:45:23 dist-test-slave-42z9 krb5kdc[7458](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200323, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:45:23.594978 31578 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260808 14:45:23.596714 8209 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:45:23.595925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52532 (local address 127.30.214.129:43081)
0808 14:45:23.596100 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:23.596105 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:23.596114 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:45:23.596140 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:23.596141 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:23.596156 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:23.596223 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:23.596627 (+ 404us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52532: BlockingRecv error: recv got EOF from 127.0.0.1:52532 (error 108)
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":83,"threads_started":1}
W20260808 14:45:23.596859 31578 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/krb5kdc/krb5cc' of type FILE
Aug 08 14:45:23 dist-test-slave-42z9 krb5kdc[7458](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200323, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:45:23.597922 31578 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 14:45:23 dist-test-slave-42z9 krb5kdc[7458](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200323, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:45:23.598784 31578 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 14:45:23 dist-test-slave-42z9 krb5kdc[7458](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200323, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.214.129@KRBTEST.COM
I20260808 14:45:23.606226 8209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:23.599318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52542 (local address 127.30.214.129:43081)
0808 14:45:23.599367 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:23.599368 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:23.599399 (+ 31us) server_negotiation.cc:407] Connection header received
0808 14:45:23.599454 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:23.599455 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:23.599481 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:23.599535 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:23.599893 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:23.600647 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:23.601316 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:23.601691 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:23.601744 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:23.603782 (+ 2038us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:23.603791 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:23.603792 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:23.603799 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:23.605135 (+ 1336us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:23.605541 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:23.605543 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:23.605544 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:23.605599 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:23.605779 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:23.605780 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:23.605780 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:23.605926 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:23.606049 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:23.606089 (+ 40us) server_negotiation.cc:299] Negotiation successful
0808 14:45:23.606151 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
W20260808 14:45:23.608330 8209 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:45:23.607806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52554 (local address 127.30.214.129:43081)
0808 14:45:23.607878 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:23.607879 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:23.607889 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:45:23.607950 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:23.607951 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:23.607961 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:23.608007 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:23.608282 (+ 275us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52554: BlockingRecv error: recv got EOF from 127.0.0.1:52554 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260808 14:45:23.608470 31578 init.cc:244] Error while opening credential cache '/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/krb5kdc/krb5cc' of type FILE: Runtime error: End of credential cache reached (filename: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/krb5kdc/krb5cc)
Aug 08 14:45:23 dist-test-slave-42z9 krb5kdc[7458](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200323, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:45:23.609468 31578 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 14:45:23 dist-test-slave-42z9 krb5kdc[7458](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200323, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:45:23.610278 31578 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 14:45:23 dist-test-slave-42z9 krb5kdc[7458](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200323, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.214.129@KRBTEST.COM
I20260808 14:45:23.616843 8209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:23.610795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52558 (local address 127.30.214.129:43081)
0808 14:45:23.610863 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:23.610865 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:23.610874 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:45:23.610923 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:23.610923 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:23.610933 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:23.610980 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:23.611320 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:23.611802 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:23.612479 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:23.612683 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:23.612739 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:23.614749 (+ 2010us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:23.614751 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:23.614751 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:23.614759 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:23.615827 (+ 1068us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:23.616142 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:23.616143 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:23.616143 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:23.616195 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:23.616354 (+ 159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:23.616355 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:23.616355 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:23.616455 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:23.616542 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:23.616658 (+ 116us) server_negotiation.cc:299] Negotiation successful
0808 14:45:23.616744 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
W20260808 14:45:23.618253 8209 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:45:23.617790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52570 (local address 127.30.214.129:43081)
0808 14:45:23.617830 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:23.617832 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:23.617860 (+ 28us) server_negotiation.cc:407] Connection header received
0808 14:45:23.617921 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:23.617922 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:23.617930 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:23.617984 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:23.618203 (+ 219us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52570: BlockingRecv error: recv got EOF from 127.0.0.1:52570 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260808 14:45:23.618355 31578 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786200295877777-31578-0/krb5kdc/krb5cc' of type FILE
Aug 08 14:45:23 dist-test-slave-42z9 krb5kdc[7458](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200323, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:45:23.619268 31578 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 14:45:23 dist-test-slave-42z9 krb5kdc[7458](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200323, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:45:23.620038 31578 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 14:45:23 dist-test-slave-42z9 krb5kdc[7458](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200323, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.214.129@KRBTEST.COM
I20260808 14:45:23.626544 8209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:23.620503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52582 (local address 127.30.214.129:43081)
0808 14:45:23.620544 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:23.620546 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:23.620593 (+ 47us) server_negotiation.cc:407] Connection header received
0808 14:45:23.620666 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:23.620667 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:23.620675 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:23.620719 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:23.621064 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:23.621557 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:23.622209 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:23.622393 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:23.622445 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:23.624375 (+ 1930us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:23.624377 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:23.624377 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:23.624386 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:23.625467 (+ 1081us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:23.625768 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:23.625769 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:23.625770 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:23.625844 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:23.626069 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:23.626070 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:23.626070 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:23.626174 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:23.626262 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:23.626374 (+ 112us) server_negotiation.cc:299] Negotiation successful
0808 14:45:23.626450 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 14:45:23.627269 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 7623
I20260808 14:45:23.643612 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 7824
I20260808 14:45:23.664389 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 8021
I20260808 14:45:23.674536 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 7477
2026-08-08T14:45:23Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (3005 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:45:23 dist-test-slave-42z9 krb5kdc[8225](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:45:23 dist-test-slave-42z9 krb5kdc[8225](info): set up 2 sockets
Aug 08 14:45:23 dist-test-slave-42z9 krb5kdc[8225](info): commencing operation
krb5kdc: starting...
W20260808 14:45:24.805516 31578 mini_kdc.cc:121] Time spent starting KDC: real 1.106s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Aug 08 14:45:24 dist-test-slave-42z9 krb5kdc[8225](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200324, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:45:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:45:24Z Disabled control of system clock
WARNING: no policy specified for oryx/127.30.214.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.30.214.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.30.214.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/krb5kdc/oryx_127.30.214.190.keytab.
Entry for principal oryx/127.30.214.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/krb5kdc/oryx_127.30.214.190.keytab.
I20260808 14:45:24.928784 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:41515
--webserver_interface=127.30.214.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/krb5kdc/oryx_127.30.214.190.keytab
--principal=oryx/127.30.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:34681
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.214.190:41515
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:45:25.013949 8246 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:45:25.014168 8246 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:45:25.014194 8246 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:45:25.015398 8246 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:45:25.015452 8246 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:45:25.015466 8246 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:45:25.015494 8246 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:45:25.015517 8246 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:45:25.017086 8246 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:34681
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.214.190:41515
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/krb5kdc/oryx_127.30.214.190.keytab
--principal=oryx/127.30.214.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:41515
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8246
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:45:25.017357 8246 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:45:25.017623 8246 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:45:25.022660 8256 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:25.022665 8257 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:25.022629 8259 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:25.022838 8246 server_base.cc:1034] running on GCE node
I20260808 14:45:25.023113 8246 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:45:25.023442 8246 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:45:25.024585 8246 hybrid_clock.cc:648] HybridClock initialized: now 1786200325024567 us; error 35 us; skew 500 ppm
Aug 08 14:45:25 dist-test-slave-42z9 krb5kdc[8225](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200325, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:45:25.027251 8246 init.cc:377] Logged in from keytab as oryx/127.30.214.190@KRBTEST.COM (short username oryx)
I20260808 14:45:25.027704 8246 webserver.cc:460] Webserver started at http://127.30.214.190:37079/ using document root <none> and password file <none>
I20260808 14:45:25.027926 8246 fs_manager.cc:359] Metadata directory not provided
I20260808 14:45:25.027979 8246 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:45:25.028090 8246 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:45:25.029145 8246 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/master-0/data/instance:
uuid: "03221342f77f4ccb9c0a4d58bae5a5ad"
format_stamp: "Formatted at 2026-08-08 14:45:25 on dist-test-slave-42z9"
server_key: "62fca7b80d9e84474a8bc0d88143793a"
server_key_iv: "7116facbf54ac300be42921528af680f"
server_key_version: "encryptionkey@0"
I20260808 14:45:25.029522 8246 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/master-0/wal/instance:
uuid: "03221342f77f4ccb9c0a4d58bae5a5ad"
format_stamp: "Formatted at 2026-08-08 14:45:25 on dist-test-slave-42z9"
server_key: "62fca7b80d9e84474a8bc0d88143793a"
server_key_iv: "7116facbf54ac300be42921528af680f"
server_key_version: "encryptionkey@0"
I20260808 14:45:25.030844 8246 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:45:25.031553 8268 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:25.031725 8246 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:45:25.031811 8246 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/master-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/master-0/wal
uuid: "03221342f77f4ccb9c0a4d58bae5a5ad"
format_stamp: "Formatted at 2026-08-08 14:45:25 on dist-test-slave-42z9"
server_key: "62fca7b80d9e84474a8bc0d88143793a"
server_key_iv: "7116facbf54ac300be42921528af680f"
server_key_version: "encryptionkey@0"
I20260808 14:45:25.031873 8246 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:45:25.049015 8246 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:45:25.050999 8246 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:45:25.051290 8246 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:45:25.055282 8246 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.190:41515
I20260808 14:45:25.055323 8346 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.190:41515 every 8 connection(s)
I20260808 14:45:25.055665 8246 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
I20260808 14:45:25.056675 8347 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:45:25.059087 8347 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 03221342f77f4ccb9c0a4d58bae5a5ad: Bootstrap starting.
I20260808 14:45:25.059715 8347 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 03221342f77f4ccb9c0a4d58bae5a5ad: Neither blocks nor log segments found. Creating new log.
I20260808 14:45:25.059996 8347 log.cc:824] T 00000000000000000000000000000000 P 03221342f77f4ccb9c0a4d58bae5a5ad: Log is configured to *not* fsync() on all Append() calls
I20260808 14:45:25.060803 8347 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 03221342f77f4ccb9c0a4d58bae5a5ad: No bootstrap required, opened a new log
I20260808 14:45:25.062489 8347 raft_consensus.cc:348] T 00000000000000000000000000000000 P 03221342f77f4ccb9c0a4d58bae5a5ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41515 } }
I20260808 14:45:25.062642 8347 raft_consensus.cc:374] T 00000000000000000000000000000000 P 03221342f77f4ccb9c0a4d58bae5a5ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:45:25.062665 8347 raft_consensus.cc:729] T 00000000000000000000000000000000 P 03221342f77f4ccb9c0a4d58bae5a5ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03221342f77f4ccb9c0a4d58bae5a5ad, State: Initialized, Role: FOLLOWER
I20260808 14:45:25.062795 8347 consensus_queue.cc:260] T 00000000000000000000000000000000 P 03221342f77f4ccb9c0a4d58bae5a5ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41515 } }
I20260808 14:45:25.062871 8347 raft_consensus.cc:388] T 00000000000000000000000000000000 P 03221342f77f4ccb9c0a4d58bae5a5ad [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:45:25.062899 8347 raft_consensus.cc:482] T 00000000000000000000000000000000 P 03221342f77f4ccb9c0a4d58bae5a5ad [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:45:25.062956 8347 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 03221342f77f4ccb9c0a4d58bae5a5ad [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:25.063838 8347 raft_consensus.cc:504] T 00000000000000000000000000000000 P 03221342f77f4ccb9c0a4d58bae5a5ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41515 } }
I20260808 14:45:25.063936 8347 leader_election.cc:302] T 00000000000000000000000000000000 P 03221342f77f4ccb9c0a4d58bae5a5ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 03221342f77f4ccb9c0a4d58bae5a5ad; no voters:
I20260808 14:45:25.064122 8347 leader_election.cc:288] T 00000000000000000000000000000000 P 03221342f77f4ccb9c0a4d58bae5a5ad [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:45:25.064164 8352 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 03221342f77f4ccb9c0a4d58bae5a5ad [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:45:25.064314 8352 raft_consensus.cc:686] T 00000000000000000000000000000000 P 03221342f77f4ccb9c0a4d58bae5a5ad [term 1 LEADER]: Becoming Leader. State: Replica: 03221342f77f4ccb9c0a4d58bae5a5ad, State: Running, Role: LEADER
I20260808 14:45:25.064388 8347 sys_catalog.cc:564] T 00000000000000000000000000000000 P 03221342f77f4ccb9c0a4d58bae5a5ad [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:45:25.064409 8352 consensus_queue.cc:237] T 00000000000000000000000000000000 P 03221342f77f4ccb9c0a4d58bae5a5ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41515 } }
I20260808 14:45:25.064605 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 8246
I20260808 14:45:25.064699 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/master-0/wal/instance
I20260808 14:45:25.064738 8353 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03221342f77f4ccb9c0a4d58bae5a5ad [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41515 } } }
I20260808 14:45:25.064771 8354 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03221342f77f4ccb9c0a4d58bae5a5ad [sys.catalog]: SysCatalogTable state changed. Reason: New leader 03221342f77f4ccb9c0a4d58bae5a5ad. Latest consensus state: current_term: 1 leader_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41515 } } }
I20260808 14:45:25.064863 8354 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03221342f77f4ccb9c0a4d58bae5a5ad [sys.catalog]: This master's current role is: LEADER
I20260808 14:45:25.064806 8353 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03221342f77f4ccb9c0a4d58bae5a5ad [sys.catalog]: This master's current role is: LEADER
I20260808 14:45:25.065017 31578 external_mini_cluster.cc:1428] Setting key 48d68d9227b4ae6d60a1eaf2ab695310
I20260808 14:45:25.065486 8357 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:45:25.066052 8357 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:45:25.067574 8357 catalog_manager.cc:1347] Generated new cluster ID: 3961a3df3910444ea5c53097ccd0ff75
I20260808 14:45:25.067637 8357 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 14:45:25 dist-test-slave-42z9 krb5kdc[8225](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200324, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM
I20260808 14:45:25.074892 8360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:25.065545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45936 (local address 127.30.214.190:41515)
0808 14:45:25.065697 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:25.065707 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:25.065742 (+ 35us) server_negotiation.cc:407] Connection header received
0808 14:45:25.065876 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:25.065885 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:25.065949 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:25.066891 (+ 942us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:25.066998 (+ 107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:25.068155 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:25.068882 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:25.069318 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:25.069425 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:25.071725 (+ 2300us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:25.071730 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:25.071730 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:25.071745 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:25.073365 (+ 1620us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:25.073725 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:25.073728 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:25.073728 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:25.073833 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:25.074020 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:25.074021 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:25.074021 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:25.074284 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:25.074436 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:25.074551 (+ 115us) server_negotiation.cc:299] Negotiation successful
0808 14:45:25.074696 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102,"thread_start_us":69,"threads_started":1}
I20260808 14:45:25.088562 8357 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:45:25.089459 8357 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:45:25.099241 8357 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 03221342f77f4ccb9c0a4d58bae5a5ad: Generated new TSK 0
I20260808 14:45:25.099470 8357 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.30.214.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.30.214.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.30.214.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/krb5kdc/oryx_127.30.214.129.keytab.
Entry for principal oryx/127.30.214.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/krb5kdc/oryx_127.30.214.129.keytab.
I20260808 14:45:25.128415 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.129:0
--local_ip_for_outbound_sockets=127.30.214.129
--webserver_interface=127.30.214.129
--webserver_port=0
--tserver_master_addrs=127.30.214.190:41515
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/krb5kdc/oryx_127.30.214.129.keytab
--principal=oryx/127.30.214.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:34681
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:45:25.218161 8382 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:45:25.218396 8382 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:45:25.218421 8382 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:45:25.219713 8382 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:45:25.219767 8382 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:45:25.219795 8382 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.129
I20260808 14:45:25.221421 8382 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:34681
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/krb5kdc/oryx_127.30.214.129.keytab
--principal=oryx/127.30.214.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.214.129
--webserver_port=0
--tserver_master_addrs=127.30.214.190:41515
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8382
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.129
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:45:25.221725 8382 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:45:25.221967 8382 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:45:25.227279 8399 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:25.227392 8396 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:25.227392 8394 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:25.227936 8382 server_base.cc:1034] running on GCE node
I20260808 14:45:25.228127 8382 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:45:25.228629 8382 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:45:25.229804 8382 hybrid_clock.cc:648] HybridClock initialized: now 1786200325229755 us; error 72 us; skew 500 ppm
Aug 08 14:45:25 dist-test-slave-42z9 krb5kdc[8225](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200325, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.214.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:45:25.233218 8382 init.cc:377] Logged in from keytab as oryx/127.30.214.129@KRBTEST.COM (short username oryx)
I20260808 14:45:25.233809 8382 webserver.cc:460] Webserver started at http://127.30.214.129:39673/ using document root <none> and password file <none>
I20260808 14:45:25.234045 8382 fs_manager.cc:359] Metadata directory not provided
I20260808 14:45:25.234130 8382 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:45:25.234247 8382 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:45:25.235580 8382 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-0/data/instance:
uuid: "21687c84bf824598aa839f0615f15623"
format_stamp: "Formatted at 2026-08-08 14:45:25 on dist-test-slave-42z9"
server_key: "0b58f396406b72e756b1f16bdafc2ce8"
server_key_iv: "ea54503f14c574783c9147d26e7345c9"
server_key_version: "encryptionkey@0"
I20260808 14:45:25.235930 8382 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-0/wal/instance:
uuid: "21687c84bf824598aa839f0615f15623"
format_stamp: "Formatted at 2026-08-08 14:45:25 on dist-test-slave-42z9"
server_key: "0b58f396406b72e756b1f16bdafc2ce8"
server_key_iv: "ea54503f14c574783c9147d26e7345c9"
server_key_version: "encryptionkey@0"
I20260808 14:45:25.237416 8382 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:45:25.238423 8408 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:25.238673 8382 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:45:25.238766 8382 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-0/wal
uuid: "21687c84bf824598aa839f0615f15623"
format_stamp: "Formatted at 2026-08-08 14:45:25 on dist-test-slave-42z9"
server_key: "0b58f396406b72e756b1f16bdafc2ce8"
server_key_iv: "ea54503f14c574783c9147d26e7345c9"
server_key_version: "encryptionkey@0"
I20260808 14:45:25.238848 8382 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:45:25.246511 8382 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:45:25.249544 8382 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:45:25.249943 8382 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:45:25.250260 8382 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:45:25.250628 8382 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:45:25.250665 8382 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:25.250689 8382 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:45:25.250715 8382 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:25.256672 8382 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.129:33035
I20260808 14:45:25.256731 8572 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.129:33035 every 8 connection(s)
I20260808 14:45:25.257378 8382 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
Aug 08 14:45:25 dist-test-slave-42z9 krb5kdc[8225](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200325, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.214.129@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM
I20260808 14:45:25.264824 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 8382
I20260808 14:45:25.264953 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-0/wal/instance
I20260808 14:45:25.265338 31578 external_mini_cluster.cc:1428] Setting key 2172d9bc6a4158cd7c9bdb41f0d606c2
I20260808 14:45:25.268551 8360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:25.258472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.129:42471 (local address 127.30.214.190:41515)
0808 14:45:25.258550 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:25.258553 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:25.258756 (+ 203us) server_negotiation.cc:407] Connection header received
0808 14:45:25.259313 (+ 557us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:25.259315 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:25.259332 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:25.259399 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:25.260446 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:25.260969 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:25.262025 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:25.262230 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:25.262289 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:25.265188 (+ 2899us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:25.265191 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:25.265191 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:25.265204 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:25.266926 (+ 1722us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:25.267473 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:25.267474 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:25.267475 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:25.267543 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:25.267794 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:25.267795 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:25.267795 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:25.267942 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:25.268006 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:25.268333 (+ 327us) server_negotiation.cc:299] Negotiation successful
0808 14:45:25.268441 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 14:45:25.268803 8576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:25.258424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:41515 (local address 127.30.214.129:42471)
0808 14:45:25.258623 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:25.258665 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:25.259202 (+ 537us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:25.259486 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:25.259491 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:25.260118 (+ 627us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:25.260328 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:25.260333 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:25.261064 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:25.261066 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:25.261934 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:25.261938 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:25.262307 (+ 369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:25.262308 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:25.262435 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:25.262967 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:25.262976 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:25.264951 (+ 1975us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:25.267032 (+ 2081us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:25.267045 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:25.267048 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:25.267391 (+ 343us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:25.267601 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:25.267602 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:25.267603 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:25.267730 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:25.268002 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:25.268010 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:25.268193 (+ 183us) client_negotiation.cc:769] Sending connection context
0808 14:45:25.268299 (+ 106us) client_negotiation.cc:240] Negotiation successful
0808 14:45:25.268536 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":101,"threads_started":1}
I20260808 14:45:25.269659 8573 heartbeater.cc:347] Connected to a master server at 127.30.214.190:41515
I20260808 14:45:25.269843 8573 heartbeater.cc:464] Registering TS with master...
I20260808 14:45:25.270123 8573 heartbeater.cc:511] Master 127.30.214.190:41515 requested a full tablet report, sending...
I20260808 14:45:25.270820 8296 ts_manager.cc:194] Registered new tserver with Master: 21687c84bf824598aa839f0615f15623 (127.30.214.129:33035)
I20260808 14:45:25.271548 8296 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.30.214.129@KRBTEST.COM'} at 127.30.214.129:42471
WARNING: no policy specified for oryx/127.30.214.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.30.214.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.30.214.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/krb5kdc/oryx_127.30.214.130.keytab.
Entry for principal oryx/127.30.214.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/krb5kdc/oryx_127.30.214.130.keytab.
I20260808 14:45:25.294667 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.130:0
--local_ip_for_outbound_sockets=127.30.214.130
--webserver_interface=127.30.214.130
--webserver_port=0
--tserver_master_addrs=127.30.214.190:41515
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/krb5kdc/oryx_127.30.214.130.keytab
--principal=oryx/127.30.214.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:34681
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:45:25.379722 8579 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:45:25.379948 8579 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:45:25.379972 8579 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:45:25.381121 8579 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:45:25.381163 8579 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:45:25.381189 8579 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.130
I20260808 14:45:25.382690 8579 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:34681
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/krb5kdc/oryx_127.30.214.130.keytab
--principal=oryx/127.30.214.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.214.130
--webserver_port=0
--tserver_master_addrs=127.30.214.190:41515
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8579
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.130
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:45:25.382898 8579 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:45:25.383100 8579 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:45:25.388345 8585 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:25.388375 8586 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:25.388484 8579 server_base.cc:1034] running on GCE node
W20260808 14:45:25.388363 8588 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:25.388934 8579 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:45:25.389212 8579 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:45:25.390383 8579 hybrid_clock.cc:648] HybridClock initialized: now 1786200325390355 us; error 59 us; skew 500 ppm
Aug 08 14:45:25 dist-test-slave-42z9 krb5kdc[8225](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200325, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.214.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:45:25.393015 8579 init.cc:377] Logged in from keytab as oryx/127.30.214.130@KRBTEST.COM (short username oryx)
I20260808 14:45:25.393537 8579 webserver.cc:460] Webserver started at http://127.30.214.130:36087/ using document root <none> and password file <none>
I20260808 14:45:25.393772 8579 fs_manager.cc:359] Metadata directory not provided
I20260808 14:45:25.393822 8579 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:45:25.393962 8579 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:45:25.395006 8579 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-1/data/instance:
uuid: "005d6a0684f14786a93ab24b32ae0e59"
format_stamp: "Formatted at 2026-08-08 14:45:25 on dist-test-slave-42z9"
server_key: "56ff7883f2de4d08d9111523fd28bdd1"
server_key_iv: "6db353457e61a79734614f12a5266d52"
server_key_version: "encryptionkey@0"
I20260808 14:45:25.395331 8579 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-1/wal/instance:
uuid: "005d6a0684f14786a93ab24b32ae0e59"
format_stamp: "Formatted at 2026-08-08 14:45:25 on dist-test-slave-42z9"
server_key: "56ff7883f2de4d08d9111523fd28bdd1"
server_key_iv: "6db353457e61a79734614f12a5266d52"
server_key_version: "encryptionkey@0"
I20260808 14:45:25.396709 8579 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:45:25.397514 8596 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:25.397657 8579 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:45:25.397745 8579 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-1/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-1/wal
uuid: "005d6a0684f14786a93ab24b32ae0e59"
format_stamp: "Formatted at 2026-08-08 14:45:25 on dist-test-slave-42z9"
server_key: "56ff7883f2de4d08d9111523fd28bdd1"
server_key_iv: "6db353457e61a79734614f12a5266d52"
server_key_version: "encryptionkey@0"
I20260808 14:45:25.397817 8579 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:45:25.410135 8579 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:45:25.412444 8579 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:45:25.412595 8579 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:45:25.412837 8579 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:45:25.413158 8579 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:45:25.413192 8579 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:25.413223 8579 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:45:25.413241 8579 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:25.418969 8579 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.130:41721
I20260808 14:45:25.419015 8757 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.130:41721 every 8 connection(s)
I20260808 14:45:25.419395 8579 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
I20260808 14:45:25.420722 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 8579
I20260808 14:45:25.420806 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-1/wal/instance
I20260808 14:45:25.421022 31578 external_mini_cluster.cc:1428] Setting key 7cd552a9d8f46722f33b3f09d70297fb
Aug 08 14:45:25 dist-test-slave-42z9 krb5kdc[8225](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200325, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.214.130@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM
I20260808 14:45:25.429024 8360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:25.420139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.130:55505 (local address 127.30.214.190:41515)
0808 14:45:25.420211 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:25.420213 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:25.420426 (+ 213us) server_negotiation.cc:407] Connection header received
0808 14:45:25.420962 (+ 536us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:25.420963 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:25.420978 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:25.421054 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:25.422145 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:25.422822 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:25.424003 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:25.424209 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:25.424270 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:25.426409 (+ 2139us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:25.426410 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:25.426411 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:25.426419 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:25.427704 (+ 1285us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:25.428096 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:25.428097 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:25.428097 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:25.428152 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:25.428369 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:25.428370 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:25.428370 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:25.428498 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:25.428556 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:25.428828 (+ 272us) server_negotiation.cc:299] Negotiation successful
0808 14:45:25.428923 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
WARNING: no policy specified for oryx/127.30.214.131@KRBTEST.COM; defaulting to no policy
I20260808 14:45:25.429207 8763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:25.420125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:41515 (local address 127.30.214.130:55505)
0808 14:45:25.420298 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:25.420336 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:25.420863 (+ 527us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:25.421128 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:25.421133 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:25.421852 (+ 719us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:25.422058 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:25.422063 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:25.422967 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:25.422969 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:25.423906 (+ 937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:25.423910 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:25.424285 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:25.424286 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:25.424418 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:25.424926 (+ 508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:25.424935 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:25.426310 (+ 1375us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:25.427787 (+ 1477us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:25.427794 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:25.427796 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:25.428025 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:25.428207 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:25.428207 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:25.428208 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:25.428313 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:25.428556 (+ 243us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:25.428563 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:25.428705 (+ 142us) client_negotiation.cc:769] Sending connection context
0808 14:45:25.428797 (+ 92us) client_negotiation.cc:240] Negotiation successful
0808 14:45:25.428976 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":95,"threads_started":1}
I20260808 14:45:25.429690 8761 heartbeater.cc:347] Connected to a master server at 127.30.214.190:41515
I20260808 14:45:25.429790 8761 heartbeater.cc:464] Registering TS with master...
I20260808 14:45:25.429967 8761 heartbeater.cc:511] Master 127.30.214.190:41515 requested a full tablet report, sending...
I20260808 14:45:25.430500 8296 ts_manager.cc:194] Registered new tserver with Master: 005d6a0684f14786a93ab24b32ae0e59 (127.30.214.130:41721)
I20260808 14:45:25.430984 8296 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.30.214.130@KRBTEST.COM'} at 127.30.214.130:55505
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.30.214.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.30.214.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/krb5kdc/oryx_127.30.214.131.keytab.
Entry for principal oryx/127.30.214.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/krb5kdc/oryx_127.30.214.131.keytab.
I20260808 14:45:25.449748 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.131:0
--local_ip_for_outbound_sockets=127.30.214.131
--webserver_interface=127.30.214.131
--webserver_port=0
--tserver_master_addrs=127.30.214.190:41515
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/krb5kdc/oryx_127.30.214.131.keytab
--principal=oryx/127.30.214.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:34681
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:45:25.535202 8767 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:45:25.535451 8767 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:45:25.535486 8767 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:45:25.536788 8767 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:45:25.536849 8767 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:45:25.536877 8767 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.131
I20260808 14:45:25.538546 8767 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:34681
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/krb5kdc/oryx_127.30.214.131.keytab
--principal=oryx/127.30.214.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.214.131
--webserver_port=0
--tserver_master_addrs=127.30.214.190:41515
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8767
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.131
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:45:25.538821 8767 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:45:25.539053 8767 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:45:25.544358 8773 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:25.544461 8772 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:25.544358 8775 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:25.544644 8767 server_base.cc:1034] running on GCE node
I20260808 14:45:25.544927 8767 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:45:25.545274 8767 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:45:25.546483 8767 hybrid_clock.cc:648] HybridClock initialized: now 1786200325546450 us; error 48 us; skew 500 ppm
Aug 08 14:45:25 dist-test-slave-42z9 krb5kdc[8225](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200325, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.214.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:45:25.549331 8767 init.cc:377] Logged in from keytab as oryx/127.30.214.131@KRBTEST.COM (short username oryx)
I20260808 14:45:25.549894 8767 webserver.cc:460] Webserver started at http://127.30.214.131:43765/ using document root <none> and password file <none>
I20260808 14:45:25.550153 8767 fs_manager.cc:359] Metadata directory not provided
I20260808 14:45:25.550205 8767 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:45:25.550336 8767 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:45:25.551409 8767 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-2/data/instance:
uuid: "afc1660c6a3f4cd695128351c5507cbb"
format_stamp: "Formatted at 2026-08-08 14:45:25 on dist-test-slave-42z9"
server_key: "7e6c1a5c3de88eebdb8869ee6d5e21f6"
server_key_iv: "296d138949c03e5390383244fa3c9f86"
server_key_version: "encryptionkey@0"
I20260808 14:45:25.551756 8767 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-2/wal/instance:
uuid: "afc1660c6a3f4cd695128351c5507cbb"
format_stamp: "Formatted at 2026-08-08 14:45:25 on dist-test-slave-42z9"
server_key: "7e6c1a5c3de88eebdb8869ee6d5e21f6"
server_key_iv: "296d138949c03e5390383244fa3c9f86"
server_key_version: "encryptionkey@0"
I20260808 14:45:25.553085 8767 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:45:25.553946 8784 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:25.554113 8767 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 14:45:25.554205 8767 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-2/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-2/wal
uuid: "afc1660c6a3f4cd695128351c5507cbb"
format_stamp: "Formatted at 2026-08-08 14:45:25 on dist-test-slave-42z9"
server_key: "7e6c1a5c3de88eebdb8869ee6d5e21f6"
server_key_iv: "296d138949c03e5390383244fa3c9f86"
server_key_version: "encryptionkey@0"
I20260808 14:45:25.554272 8767 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:45:25.567647 8767 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:45:25.569588 8767 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:45:25.569739 8767 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:45:25.569972 8767 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:45:25.570281 8767 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:45:25.570315 8767 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:25.570345 8767 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:45:25.570370 8767 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:25.576573 8767 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.131:34441
I20260808 14:45:25.576627 8944 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.131:34441 every 8 connection(s)
I20260808 14:45:25.576951 8767 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
Aug 08 14:45:25 dist-test-slave-42z9 krb5kdc[8225](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200325, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.214.131@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM
I20260808 14:45:25.586607 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 8767
I20260808 14:45:25.586730 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-2/wal/instance
I20260808 14:45:25.586933 31578 external_mini_cluster.cc:1428] Setting key 5446307617c2a4c1f1a243c447740bdc
I20260808 14:45:25.587067 8360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:25.577802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:43543 (local address 127.30.214.190:41515)
0808 14:45:25.577883 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:25.577886 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:25.577989 (+ 103us) server_negotiation.cc:407] Connection header received
0808 14:45:25.578508 (+ 519us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:25.578510 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:25.578521 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:25.578581 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:25.579537 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:25.580035 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:25.581031 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:25.581228 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:25.581292 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:25.583919 (+ 2627us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:25.583922 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:25.583923 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:25.583934 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:25.585753 (+ 1819us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:25.586138 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:25.586139 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:25.586139 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:25.586201 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:25.586394 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:25.586395 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:25.586395 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:25.586501 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:25.586548 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:25.586893 (+ 345us) server_negotiation.cc:299] Negotiation successful
0808 14:45:25.586970 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 14:45:25.587301 8948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:25.577700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:41515 (local address 127.30.214.131:43543)
0808 14:45:25.577869 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:25.577909 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:25.578398 (+ 489us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:25.578645 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:25.578648 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:25.579248 (+ 600us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:25.579468 (+ 220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:25.579472 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:25.580101 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:25.580102 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:25.580904 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:25.580907 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:25.581415 (+ 508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:25.581417 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:25.581781 (+ 364us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:25.582327 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:25.582337 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:25.583757 (+ 1420us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:25.585834 (+ 2077us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:25.585840 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:25.585842 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:25.586071 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:25.586250 (+ 179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:25.586251 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:25.586251 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:25.586343 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:25.586562 (+ 219us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:25.586569 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:25.586752 (+ 183us) client_negotiation.cc:769] Sending connection context
0808 14:45:25.586873 (+ 121us) client_negotiation.cc:240] Negotiation successful
0808 14:45:25.587058 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":77,"threads_started":1}
I20260808 14:45:25.587730 8946 heartbeater.cc:347] Connected to a master server at 127.30.214.190:41515
I20260808 14:45:25.587833 8946 heartbeater.cc:464] Registering TS with master...
I20260808 14:45:25.588003 8946 heartbeater.cc:511] Master 127.30.214.190:41515 requested a full tablet report, sending...
I20260808 14:45:25.588326 8296 ts_manager.cc:194] Registered new tserver with Master: afc1660c6a3f4cd695128351c5507cbb (127.30.214.131:34441)
I20260808 14:45:25.588706 8296 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.30.214.131@KRBTEST.COM'} at 127.30.214.131:43543
I20260808 14:45:25.598811 31578 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.30.214.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.30.214.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.30.214.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/krb5kdc/oryx_127.30.214.189.keytab.
Entry for principal oryx/127.30.214.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/krb5kdc/oryx_127.30.214.189.keytab.
I20260808 14:45:25.626420 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.189:41969
--webserver_interface=127.30.214.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/krb5kdc/oryx_127.30.214.189.keytab
--principal=oryx/127.30.214.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:34681
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.214.190:41515,127.30.214.189:41969
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:45:25.709466 8954 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:45:25.709704 8954 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:45:25.709728 8954 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:45:25.710856 8954 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:45:25.710894 8954 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:45:25.710906 8954 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:45:25.710918 8954 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:45:25.710929 8954 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:45:25.712390 8954 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:34681
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.30.214.190:41515,127.30.214.189:41969
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/krb5kdc/oryx_127.30.214.189.keytab
--principal=oryx/127.30.214.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.189:41969
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.30.214.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8954
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
W20260808 14:45:25.712505 8954 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.30.214.190:41515,127.30.214.189:41969'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260808 14:45:25.712632 8954 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:45:25.712817 8954 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:45:25.718204 8964 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:25.718326 8966 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:25.718391 8954 server_base.cc:1034] running on GCE node
W20260808 14:45:25.718210 8963 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:25.718737 8954 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:45:25.719058 8954 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:45:25.720222 8954 hybrid_clock.cc:648] HybridClock initialized: now 1786200325720201 us; error 38 us; skew 500 ppm
Aug 08 14:45:25 dist-test-slave-42z9 krb5kdc[8225](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200325, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.214.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:45:25.722870 8954 init.cc:377] Logged in from keytab as oryx/127.30.214.189@KRBTEST.COM (short username oryx)
I20260808 14:45:25.723377 8954 webserver.cc:460] Webserver started at http://127.30.214.189:41411/ using document root <none> and password file <none>
I20260808 14:45:25.723593 8954 fs_manager.cc:359] Metadata directory not provided
I20260808 14:45:25.723645 8954 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:45:25.723779 8954 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:45:25.724872 8954 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/master-1/data/instance:
uuid: "2956799a475441f0b2676c39eb812451"
format_stamp: "Formatted at 2026-08-08 14:45:25 on dist-test-slave-42z9"
server_key: "58dd8e79ccdad25c685170d3f57f31b3"
server_key_iv: "0eb884260a2577844d2e43f229b1f929"
server_key_version: "encryptionkey@0"
I20260808 14:45:25.725231 8954 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/master-1/wal/instance:
uuid: "2956799a475441f0b2676c39eb812451"
format_stamp: "Formatted at 2026-08-08 14:45:25 on dist-test-slave-42z9"
server_key: "58dd8e79ccdad25c685170d3f57f31b3"
server_key_iv: "0eb884260a2577844d2e43f229b1f929"
server_key_version: "encryptionkey@0"
I20260808 14:45:25.726625 8954 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:45:25.727351 8977 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:25.727512 8954 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:45:25.727600 8954 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/master-1/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/master-1/wal
uuid: "2956799a475441f0b2676c39eb812451"
format_stamp: "Formatted at 2026-08-08 14:45:25 on dist-test-slave-42z9"
server_key: "58dd8e79ccdad25c685170d3f57f31b3"
server_key_iv: "0eb884260a2577844d2e43f229b1f929"
server_key_version: "encryptionkey@0"
I20260808 14:45:25.727671 8954 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:45:25.745939 8954 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:45:25.751515 8954 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:45:25.751667 8954 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:45:25.755972 8954 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.189:41969
I20260808 14:45:25.756009 9064 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.189:41969 every 8 connection(s)
I20260808 14:45:25.756354 8954 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/master-1/data/info.pb
I20260808 14:45:25.757391 9065 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:45:25.759043 9065 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41515 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:45:25.763201 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 8954
Aug 08 14:45:25 dist-test-slave-42z9 krb5kdc[8225](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200325, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.214.189@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM
Aug 08 14:45:25 dist-test-slave-42z9 krb5kdc[8225](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200324, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.30.214.189@KRBTEST.COM
I20260808 14:45:25.769042 8360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:25.759729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45946 (local address 127.30.214.190:41515)
0808 14:45:25.759785 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:25.759787 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:25.759977 (+ 190us) server_negotiation.cc:407] Connection header received
0808 14:45:25.760449 (+ 472us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:25.760450 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:25.760462 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:25.760516 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:25.761132 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:25.761680 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:25.762682 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:25.762870 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:25.762927 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:25.765971 (+ 3044us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:25.765973 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:25.765973 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:25.765982 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:25.767512 (+ 1530us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:25.768022 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:25.768023 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:25.768024 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:25.768076 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:25.768331 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:25.768332 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:25.768333 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:25.768498 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:25.768560 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:25.768889 (+ 329us) server_negotiation.cc:299] Negotiation successful
0808 14:45:25.768963 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 14:45:25.769285 9068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:25.759698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:41515 (local address 127.0.0.1:45946)
0808 14:45:25.759861 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:25.759897 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:25.760355 (+ 458us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:25.760587 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:25.760590 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:25.760847 (+ 257us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:25.761044 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:25.761047 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:25.761767 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:25.761768 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:25.762598 (+ 830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:25.762600 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:25.762942 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:25.762943 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:25.763071 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:25.763636 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:25.763647 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:25.765839 (+ 2192us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:25.767604 (+ 1765us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:25.767612 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:25.767614 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:25.767947 (+ 333us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:25.768151 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:25.768152 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:25.768153 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:25.768270 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:25.768567 (+ 297us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:25.768574 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:25.768734 (+ 160us) client_negotiation.cc:769] Sending connection context
0808 14:45:25.768855 (+ 121us) client_negotiation.cc:240] Negotiation successful
0808 14:45:25.769043 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":83,"threads_started":1}
I20260808 14:45:25.770128 9065 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.214.189" port: 41969 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:45:25.771837 9074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:25.763729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58988 (local address 127.30.214.189:41969)
0808 14:45:25.763882 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:25.763887 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:25.763962 (+ 75us) server_negotiation.cc:407] Connection header received
0808 14:45:25.763986 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:25.763989 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:25.764010 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:25.764088 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:25.764640 (+ 552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:25.765428 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:25.766358 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:25.766731 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:25.766794 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:25.769141 (+ 2347us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:25.769147 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:25.769148 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:25.769154 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:25.770728 (+ 1574us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:25.771108 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:25.771111 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:25.771112 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:25.771171 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:25.771357 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:25.771358 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:25.771358 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:25.771494 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:25.771618 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:25.771710 (+ 92us) server_negotiation.cc:299] Negotiation successful
0808 14:45:25.771771 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":89,"threads_started":1}
Aug 08 14:45:25 dist-test-slave-42z9 krb5kdc[8225](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200325, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.214.189@KRBTEST.COM for oryx/127.30.214.189@KRBTEST.COM
I20260808 14:45:25.777539 9068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:25.770545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.189:41969 (local address 127.0.0.1:59000)
0808 14:45:25.770619 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:25.770633 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:25.770684 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:25.770985 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:25.770986 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:25.771125 (+ 139us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:25.771184 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:25.771186 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:25.772281 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:25.772282 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:25.772817 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:25.772819 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:25.773141 (+ 322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:25.773142 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:25.773196 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:25.773609 (+ 413us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:25.773613 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:25.774767 (+ 1154us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:25.776673 (+ 1906us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:25.776674 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:25.776674 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:25.776836 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:25.777008 (+ 172us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:25.777008 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:25.777009 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:25.777059 (+ 50us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:25.777238 (+ 179us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:25.777238 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:25.777273 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 14:45:25.777318 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 14:45:25.777399 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51}
I20260808 14:45:25.777637 9075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:25.770582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59000 (local address 127.30.214.189:41969)
0808 14:45:25.770893 (+ 311us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:25.770895 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:25.770899 (+ 4us) server_negotiation.cc:407] Connection header received
0808 14:45:25.770913 (+ 14us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:25.770913 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:25.770922 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:25.770971 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:25.771262 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:25.772212 (+ 950us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:25.772886 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:25.773089 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:25.773139 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:25.774840 (+ 1701us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:25.774842 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:25.774842 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:25.774848 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:25.776585 (+ 1737us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:25.776894 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:25.776895 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:25.776895 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:25.776942 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:25.777101 (+ 159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:25.777101 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:25.777102 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:25.777198 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:25.777241 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:25.777340 (+ 99us) server_negotiation.cc:299] Negotiation successful
0808 14:45:25.777473 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":52,"server-negotiator.queue_time_us":293,"thread_start_us":264,"threads_started":1}
I20260808 14:45:25.778870 9065 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451: Bootstrap starting.
I20260808 14:45:25.779520 9065 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451: Neither blocks nor log segments found. Creating new log.
I20260808 14:45:25.779789 9065 log.cc:824] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451: Log is configured to *not* fsync() on all Append() calls
I20260808 14:45:25.780525 9065 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451: No bootstrap required, opened a new log
I20260808 14:45:25.781996 9065 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41515 } } peers { permanent_uuid: "2956799a475441f0b2676c39eb812451" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 41969 } }
I20260808 14:45:25.782125 9065 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:45:25.782158 9065 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2956799a475441f0b2676c39eb812451, State: Initialized, Role: FOLLOWER
I20260808 14:45:25.782284 9065 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41515 } } peers { permanent_uuid: "2956799a475441f0b2676c39eb812451" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 41969 } }
I20260808 14:45:25.782547 9080 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41515 } } peers { permanent_uuid: "2956799a475441f0b2676c39eb812451" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 41969 } } }
I20260808 14:45:25.782635 9065 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:45:25.782644 9080 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451 [sys.catalog]: This master's current role is: FOLLOWER
W20260808 14:45:25.784224 9096 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:45:25.784322 9096 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:45:25.785995 8954 master_runner.cc:428] Detected that this master 2956799a475441f0b2676c39eb812451 is joining an existing cluster
I20260808 14:45:25.786048 8954 master_runner.cc:432] Initiating AddMaster RPC to add 127.30.214.189:41969
I20260808 14:45:25.793540 8360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:25.787321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45958 (local address 127.30.214.190:41515)
0808 14:45:25.787365 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:25.787367 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:25.787576 (+ 209us) server_negotiation.cc:407] Connection header received
0808 14:45:25.787623 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:25.787624 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:25.787635 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:25.787691 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:25.787985 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:25.788468 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:25.789538 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:25.789837 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:25.789910 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:25.791065 (+ 1155us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:25.791066 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:25.791066 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:25.791074 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:25.792341 (+ 1267us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:25.792730 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:25.792731 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:25.792732 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:25.792790 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:25.792977 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:25.792978 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:25.792978 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:25.793121 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:25.793155 (+ 34us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:25.793335 (+ 180us) server_negotiation.cc:299] Negotiation successful
0808 14:45:25.793420 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 14:45:25.793618 9104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:25.787008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.189:41969 (local address 127.0.0.1:59004)
0808 14:45:25.787199 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:25.787209 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:25.787288 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:25.787423 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:25.787424 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:25.787648 (+ 224us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:25.787735 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:25.787736 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:25.788646 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:25.788646 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:25.789426 (+ 780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:25.789428 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:25.789845 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:25.789846 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:25.789884 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:25.790309 (+ 425us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:25.790315 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:25.790708 (+ 393us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:25.792552 (+ 1844us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:25.792553 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:25.792553 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:25.792746 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:25.792933 (+ 187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:25.792933 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:25.792934 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:25.792985 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:25.793254 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:25.793255 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:25.793294 (+ 39us) client_negotiation.cc:769] Sending connection context
0808 14:45:25.793359 (+ 65us) client_negotiation.cc:240] Negotiation successful
0808 14:45:25.793489 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"mutex_wait_us":2,"thread_start_us":95,"threads_started":1}
I20260808 14:45:25.793682 9075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:25.787083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59004 (local address 127.30.214.189:41969)
0808 14:45:25.787139 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:25.787141 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:25.787254 (+ 113us) server_negotiation.cc:407] Connection header received
0808 14:45:25.787345 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:25.787346 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:25.787356 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:25.787416 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:25.787805 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:25.788573 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:25.789550 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:25.789746 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:25.789773 (+ 27us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:25.790796 (+ 1023us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:25.790798 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:25.790798 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:25.790807 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:25.792471 (+ 1664us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:25.792809 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:25.792810 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:25.792811 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:25.792870 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:25.793041 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:25.793041 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:25.793042 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:25.793188 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:25.793256 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:25.793390 (+ 134us) server_negotiation.cc:299] Negotiation successful
0808 14:45:25.793555 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":78,"server-negotiator.queue_time_us":32}
I20260808 14:45:25.794341 9107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:25.787264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:41515 (local address 127.0.0.1:45958)
0808 14:45:25.787504 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:25.787513 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:25.787568 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:25.787718 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:25.787719 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:25.787874 (+ 155us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:25.787918 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:25.787919 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:25.788537 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:25.788538 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:25.789477 (+ 939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:25.789479 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:25.789915 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:25.789916 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:25.789969 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:25.790651 (+ 682us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:25.790656 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:25.790991 (+ 335us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:25.792420 (+ 1429us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:25.792421 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:25.792422 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:25.792641 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:25.792858 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:25.792859 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:25.792859 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:25.792910 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:25.793191 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:25.793191 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:25.793226 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 14:45:25.794157 (+ 931us) client_negotiation.cc:240] Negotiation successful
0808 14:45:25.794249 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":226,"mutex_wait_us":1,"thread_start_us":182,"threads_started":1}
Aug 08 14:45:25 dist-test-slave-42z9 krb5kdc[8225](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200325, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.214.190@KRBTEST.COM for oryx/127.30.214.189@KRBTEST.COM
I20260808 14:45:25.804106 9075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:25.796667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59010 (local address 127.30.214.189:41969)
0808 14:45:25.796705 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:25.796707 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:25.796865 (+ 158us) server_negotiation.cc:407] Connection header received
0808 14:45:25.796924 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:25.796925 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:25.796936 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:25.796999 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:25.797365 (+ 366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:25.798152 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:25.798887 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:25.799194 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:25.799261 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:25.801597 (+ 2336us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:25.801598 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:25.801598 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:25.801605 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:25.802866 (+ 1261us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:25.803316 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:25.803317 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:25.803317 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:25.803361 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:25.803562 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:25.803563 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:25.803563 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:25.803701 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:25.803774 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:25.803963 (+ 189us) server_negotiation.cc:299] Negotiation successful
0808 14:45:25.804031 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 14:45:25.804194 9109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:25.796625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.189:41969 (local address 127.0.0.1:59010)
0808 14:45:25.796768 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:25.796801 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:25.796865 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:25.797002 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:25.797004 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:25.797252 (+ 248us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:25.797305 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:25.797308 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:25.798223 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:25.798223 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:25.798815 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:25.798817 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:25.799259 (+ 442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:25.799259 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:25.799317 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:25.799812 (+ 495us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:25.799817 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:25.801513 (+ 1696us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:25.802950 (+ 1437us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:25.802959 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:25.802961 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:25.803248 (+ 287us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:25.803414 (+ 166us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:25.803414 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:25.803415 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:25.803480 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:25.803778 (+ 298us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:25.803785 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:25.803845 (+ 60us) client_negotiation.cc:769] Sending connection context
0808 14:45:25.803933 (+ 88us) client_negotiation.cc:240] Negotiation successful
0808 14:45:25.804075 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":68,"threads_started":1}
I20260808 14:45:25.804833 8296 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.30.214.189:41969: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "2956799a475441f0b2676c39eb812451"
member_type: NON_VOTER
last_known_addr {
host: "127.30.214.189"
port: 41969
}
attrs {
promote: true
}
}
dest_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad"
cas_config_opid_index: -1
I20260808 14:45:25.805210 8296 consensus_queue.cc:237] T 00000000000000000000000000000000 P 03221342f77f4ccb9c0a4d58bae5a5ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41515 } } peers { permanent_uuid: "2956799a475441f0b2676c39eb812451" member_type: NON_VOTER last_known_addr { host: "127.30.214.189" port: 41969 } attrs { promote: true } }
I20260808 14:45:25.805734 9113 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 03221342f77f4ccb9c0a4d58bae5a5ad [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 2956799a475441f0b2676c39eb812451 (127.30.214.189) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41515 } } peers { permanent_uuid: "2956799a475441f0b2676c39eb812451" member_type: NON_VOTER last_known_addr { host: "127.30.214.189" port: 41969 } attrs { promote: true } } }
I20260808 14:45:25.806084 9025 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:25.806638 9113 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.30.214.189:41969
I20260808 14:45:25.806831 9112 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03221342f77f4ccb9c0a4d58bae5a5ad [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41515 } } peers { permanent_uuid: "2956799a475441f0b2676c39eb812451" member_type: NON_VOTER last_known_addr { host: "127.30.214.189" port: 41969 } attrs { promote: true } } }
I20260808 14:45:25.806898 9025 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451 [term 1 FOLLOWER]: Refusing update from remote peer 03221342f77f4ccb9c0a4d58bae5a5ad: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260808 14:45:25.806916 9112 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03221342f77f4ccb9c0a4d58bae5a5ad [sys.catalog]: This master's current role is: LEADER
I20260808 14:45:25.806967 8954 master.cc:537] Master@127.30.214.189:41969 shutting down...
I20260808 14:45:25.807310 9112 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 03221342f77f4ccb9c0a4d58bae5a5ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "2956799a475441f0b2676c39eb812451" member_type: NON_VOTER last_known_addr { host: "127.30.214.189" port: 41969 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 14:45:25.808089 8269 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260808 14:45:25.808533 8269 consensus_peers.cc:487] T 00000000000000000000000000000000 P 03221342f77f4ccb9c0a4d58bae5a5ad -> Peer 2956799a475441f0b2676c39eb812451 (127.30.214.189:41969): Couldn't send request to peer 2956799a475441f0b2676c39eb812451. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260808 14:45:25.810191 8954 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:45:25.810271 8954 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:45:25.810307 8954 tablet_replica.cc:330] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451: stopping tablet replica
I20260808 14:45:25.823746 8954 master.cc:552] Master@127.30.214.189:41969 shutdown complete.
I20260808 14:45:25.823797 8954 master_runner.cc:305] Clearing existing system tablet
I20260808 14:45:25.823917 8954 fs_manager.cc:359] Metadata directory not provided
I20260808 14:45:25.823963 8954 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:45:25.824566 8954 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.002s sys 0.000s
I20260808 14:45:25.825012 9119 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:25.825131 8954 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:45:25.825182 8954 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:25.825198 8954 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/master-1/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/master-1/wal
uuid: "2956799a475441f0b2676c39eb812451"
format_stamp: "Formatted at 2026-08-08 14:45:25 on dist-test-slave-42z9"
server_key: "58dd8e79ccdad25c685170d3f57f31b3"
server_key_iv: "0eb884260a2577844d2e43f229b1f929"
server_key_version: "encryptionkey@0"
I20260808 14:45:25.826028 8954 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:45:25.827276 8954 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260808 14:45:25.827337 8954 log.cc:1196] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451: Deleting WAL directory at /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260808 14:45:25.827529 8954 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451: Deleting consensus metadata
I20260808 14:45:25.827639 8954 master_runner.cc:315] Copying system tablet from 127.30.214.190:41515
I20260808 14:45:25.828235 8954 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451: tablet copy: Beginning tablet copy session from remote peer at address 127.30.214.190:41515
I20260808 14:45:25.834683 8360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:25.828674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45974 (local address 127.30.214.190:41515)
0808 14:45:25.828728 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:25.828730 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:25.828787 (+ 57us) server_negotiation.cc:407] Connection header received
0808 14:45:25.828868 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:25.828869 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:25.828878 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:25.828926 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:25.829322 (+ 396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:25.829878 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:25.830951 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:25.831127 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:25.831173 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:25.832238 (+ 1065us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:25.832239 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:25.832240 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:25.832246 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:25.833579 (+ 1333us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:25.833964 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:25.833965 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:25.833965 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:25.834020 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:25.834196 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:25.834197 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:25.834197 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:25.834303 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:25.834368 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:25.834518 (+ 150us) server_negotiation.cc:299] Negotiation successful
0808 14:45:25.834592 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 14:45:25.834723 9125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:25.828580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:41515 (local address 127.0.0.1:45974)
0808 14:45:25.828715 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:25.828728 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:25.828804 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:25.828943 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:25.828944 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:25.829175 (+ 231us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:25.829248 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:25.829250 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:25.829953 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:25.829954 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:25.830867 (+ 913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:25.830871 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:25.831190 (+ 319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:25.831192 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:25.831262 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:25.831723 (+ 461us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:25.831728 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:25.832137 (+ 409us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:25.833652 (+ 1515us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:25.833653 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:25.833653 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:25.833885 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:25.834072 (+ 187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:25.834073 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:25.834073 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:25.834139 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:25.834357 (+ 218us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:25.834358 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:25.834416 (+ 58us) client_negotiation.cc:769] Sending connection context
0808 14:45:25.834497 (+ 81us) client_negotiation.cc:240] Negotiation successful
0808 14:45:25.834611 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":73,"threads_started":1}
I20260808 14:45:25.835156 8325 tablet_copy_service.cc:140] P 03221342f77f4ccb9c0a4d58bae5a5ad: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 2956799a475441f0b2676c39eb812451 ({username='oryx', principal='oryx/127.30.214.189@KRBTEST.COM'} at 127.0.0.1:45974)
I20260808 14:45:25.835325 8325 tablet_copy_service.cc:161] P 03221342f77f4ccb9c0a4d58bae5a5ad: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 2956799a475441f0b2676c39eb812451 at {username='oryx', principal='oryx/127.30.214.189@KRBTEST.COM'} at 127.0.0.1:45974: session id = 2956799a475441f0b2676c39eb812451-00000000000000000000000000000000
I20260808 14:45:25.836277 8325 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 03221342f77f4ccb9c0a4d58bae5a5ad: Tablet Copy: opened 0 blocks and 1 log segments
I20260808 14:45:25.837016 8954 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260808 14:45:25.838063 8954 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451: tablet copy: Starting download of 0 data blocks...
I20260808 14:45:25.838214 8954 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451: tablet copy: Starting download of 1 WAL segments...
I20260808 14:45:25.839290 8954 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260808 14:45:25.840121 8325 tablet_copy_service.cc:342] P 03221342f77f4ccb9c0a4d58bae5a5ad: Request end of tablet copy session 2956799a475441f0b2676c39eb812451-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.30.214.189@KRBTEST.COM'} at 127.0.0.1:45974
I20260808 14:45:25.840173 8325 tablet_copy_service.cc:433] P 03221342f77f4ccb9c0a4d58bae5a5ad: ending tablet copy session 2956799a475441f0b2676c39eb812451-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 2956799a475441f0b2676c39eb812451
I20260808 14:45:25.842841 8954 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:45:25.844071 9127 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:25.844194 8954 server_base.cc:1034] running on GCE node
W20260808 14:45:25.844221 9126 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:25.844355 9129 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:25.844527 8954 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:45:25.844669 8954 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:45:25.845780 8954 hybrid_clock.cc:648] HybridClock initialized: now 1786200325845764 us; error 34 us; skew 500 ppm
Aug 08 14:45:25 dist-test-slave-42z9 krb5kdc[8225](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200325, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.214.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:45:25.847008 8954 init.cc:377] Logged in from keytab as oryx/127.30.214.189@KRBTEST.COM (short username oryx)
I20260808 14:45:25.847256 8954 webserver.cc:460] Webserver started at http://127.30.214.189:46183/ using document root <none> and password file <none>
I20260808 14:45:25.847362 8954 fs_manager.cc:359] Metadata directory not provided
I20260808 14:45:25.847389 8954 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:45:25.847958 8954 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:45:25.848443 9140 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:25.848543 8954 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:25.848587 8954 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/master-1/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/master-1/wal
uuid: "2956799a475441f0b2676c39eb812451"
format_stamp: "Formatted at 2026-08-08 14:45:25 on dist-test-slave-42z9"
server_key: "58dd8e79ccdad25c685170d3f57f31b3"
server_key_iv: "0eb884260a2577844d2e43f229b1f929"
server_key_version: "encryptionkey@0"
I20260808 14:45:25.848644 8954 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:45:25.853052 8954 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:45:25.854570 8954 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:45:25.857676 8954 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.189:41969
I20260808 14:45:25.858088 9216 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.189:41969 every 8 connection(s)
I20260808 14:45:25.858108 8954 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/master-1/data/info.pb
I20260808 14:45:25.858946 9217 sys_catalog.cc:263] Verifying existing consensus state
I20260808 14:45:25.859390 9217 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451: Bootstrap starting.
I20260808 14:45:25.861809 9217 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 14:45:25.862020 9217 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451: Bootstrap complete.
I20260808 14:45:25.862213 9217 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41515 } } peers { permanent_uuid: "2956799a475441f0b2676c39eb812451" member_type: NON_VOTER last_known_addr { host: "127.30.214.189" port: 41969 } attrs { promote: true } }
I20260808 14:45:25.862283 9217 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2956799a475441f0b2676c39eb812451, State: Initialized, Role: LEARNER
I20260808 14:45:25.862309 9217 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41515 } } peers { permanent_uuid: "2956799a475441f0b2676c39eb812451" member_type: NON_VOTER last_known_addr { host: "127.30.214.189" port: 41969 } attrs { promote: true } }
I20260808 14:45:25.862495 9217 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:45:25.862499 9221 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41515 } } peers { permanent_uuid: "2956799a475441f0b2676c39eb812451" member_type: NON_VOTER last_known_addr { host: "127.30.214.189" port: 41969 } attrs { promote: true } } }
I20260808 14:45:25.862628 9221 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451 [sys.catalog]: This master's current role is: LEARNER
I20260808 14:45:25.863862 9238 catalog_manager.cc:1259] Loaded cluster ID: 3961a3df3910444ea5c53097ccd0ff75
I20260808 14:45:25.863916 9238 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451: loading cluster ID for follower catalog manager: success
I20260808 14:45:25.864897 9238 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451: acquiring CA information for follower catalog manager: success
I20260808 14:45:25.865178 9238 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 14:45:25.881173 9239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:25.873567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59026 (local address 127.30.214.189:41969)
0808 14:45:25.873728 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:25.873730 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:25.873742 (+ 12us) server_negotiation.cc:407] Connection header received
0808 14:45:25.873771 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:25.873772 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:25.873785 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:25.873870 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:25.874482 (+ 612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:25.875522 (+ 1040us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:25.876607 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:25.876916 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:25.877012 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:25.878336 (+ 1324us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:25.878338 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:25.878338 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:25.878347 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:25.879897 (+ 1550us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:25.880221 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:25.880223 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:25.880223 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:25.880292 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:25.880451 (+ 159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:25.880452 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:25.880453 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:25.880596 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:25.880707 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:25.880875 (+ 168us) server_negotiation.cc:299] Negotiation successful
0808 14:45:25.881053 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":77,"threads_started":1}
WARNING: no policy specified for oryx/127.30.214.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.30.214.188@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.30.214.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/krb5kdc/oryx_127.30.214.188.keytab.
Entry for principal oryx/127.30.214.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/krb5kdc/oryx_127.30.214.188.keytab.
I20260808 14:45:25.909263 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.188:33797
--webserver_interface=127.30.214.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/krb5kdc/oryx_127.30.214.188.keytab
--principal=oryx/127.30.214.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:34681
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.214.190:41515,127.30.214.189:41969,127.30.214.188:33797
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:45:25.993824 9244 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:45:25.994057 9244 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:45:25.994081 9244 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:45:25.995313 9244 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:45:25.995361 9244 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:45:25.995374 9244 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:45:25.995386 9244 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:45:25.995396 9244 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:45:25.996959 9244 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:34681
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.30.214.190:41515,127.30.214.189:41969,127.30.214.188:33797
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/krb5kdc/oryx_127.30.214.188.keytab
--principal=oryx/127.30.214.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.188:33797
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.30.214.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9244
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:45:25.997206 9244 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:45:25.997466 9244 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:45:26.002313 9252 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:26.002305 9249 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:26.002305 9250 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:26.002506 9244 server_base.cc:1034] running on GCE node
I20260808 14:45:26.002799 9244 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:45:26.003099 9244 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:45:26.004238 9244 hybrid_clock.cc:648] HybridClock initialized: now 1786200326004224 us; error 36 us; skew 500 ppm
Aug 08 14:45:26 dist-test-slave-42z9 krb5kdc[8225](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200326, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.214.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:45:26.006824 9244 init.cc:377] Logged in from keytab as oryx/127.30.214.188@KRBTEST.COM (short username oryx)
I20260808 14:45:26.007277 9244 webserver.cc:460] Webserver started at http://127.30.214.188:36749/ using document root <none> and password file <none>
I20260808 14:45:26.007484 9244 fs_manager.cc:359] Metadata directory not provided
I20260808 14:45:26.007534 9244 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:45:26.007664 9244 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:45:26.008730 9244 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/master-2/data/instance:
uuid: "3835d4d282c54ce8b02f7780f2d12695"
format_stamp: "Formatted at 2026-08-08 14:45:26 on dist-test-slave-42z9"
server_key: "53bc0d143dacfd5e63377cba64da2ae9"
server_key_iv: "3ead05fd52f8a5ba76daf043fb20167d"
server_key_version: "encryptionkey@0"
I20260808 14:45:26.009087 9244 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/master-2/wal/instance:
uuid: "3835d4d282c54ce8b02f7780f2d12695"
format_stamp: "Formatted at 2026-08-08 14:45:26 on dist-test-slave-42z9"
server_key: "53bc0d143dacfd5e63377cba64da2ae9"
server_key_iv: "3ead05fd52f8a5ba76daf043fb20167d"
server_key_version: "encryptionkey@0"
I20260808 14:45:26.010442 9244 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 14:45:26.011155 9260 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:26.011313 9244 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:45:26.011401 9244 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/master-2/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/master-2/wal
uuid: "3835d4d282c54ce8b02f7780f2d12695"
format_stamp: "Formatted at 2026-08-08 14:45:26 on dist-test-slave-42z9"
server_key: "53bc0d143dacfd5e63377cba64da2ae9"
server_key_iv: "3ead05fd52f8a5ba76daf043fb20167d"
server_key_version: "encryptionkey@0"
I20260808 14:45:26.011467 9244 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:45:26.022856 9244 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:45:26.024852 9244 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:45:26.025000 9244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:45:26.029057 9244 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.188:33797
I20260808 14:45:26.029100 9340 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.188:33797 every 8 connection(s)
I20260808 14:45:26.029718 9244 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/master-2/data/info.pb
I20260808 14:45:26.030476 9343 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:45:26.032027 9343 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41515 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:45:26.035194 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 9244
Aug 08 14:45:26 dist-test-slave-42z9 krb5kdc[8225](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200326, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.214.188@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM
Aug 08 14:45:26 dist-test-slave-42z9 krb5kdc[8225](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200324, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.30.214.188@KRBTEST.COM
I20260808 14:45:26.041890 8360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:26.032869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45978 (local address 127.30.214.190:41515)
0808 14:45:26.032933 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:26.032935 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:26.033031 (+ 96us) server_negotiation.cc:407] Connection header received
0808 14:45:26.033558 (+ 527us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:26.033559 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:26.033573 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:26.033624 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:26.034269 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.034818 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.036092 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.036290 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.036336 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:26.038709 (+ 2373us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:26.038711 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:26.038711 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:26.038720 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:26.040269 (+ 1549us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:26.040778 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:26.040779 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:26.040779 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:26.040830 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:26.041133 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:26.041134 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:26.041134 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:26.041283 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:26.041355 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:26.041700 (+ 345us) server_negotiation.cc:299] Negotiation successful
0808 14:45:26.041789 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 14:45:26.042059 9345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:26.032707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:41515 (local address 127.0.0.1:45978)
0808 14:45:26.032898 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:26.032948 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:26.033423 (+ 475us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:26.033708 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:26.033711 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:26.033980 (+ 269us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:26.034178 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:26.034183 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.034922 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.034923 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:26.036019 (+ 1096us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:26.036022 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.036381 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.036382 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:26.036528 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:26.037055 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:26.037064 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:26.038593 (+ 1529us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:26.040354 (+ 1761us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:26.040363 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:26.040366 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:26.040703 (+ 337us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:26.040936 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:26.040937 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:26.040937 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:26.041072 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:26.041350 (+ 278us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:26.041355 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:26.041537 (+ 182us) client_negotiation.cc:769] Sending connection context
0808 14:45:26.041670 (+ 133us) client_negotiation.cc:240] Negotiation successful
0808 14:45:26.041817 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":90,"threads_started":1}
I20260808 14:45:26.042620 9343 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.214.189" port: 41969 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:45:26.044252 9346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:26.035718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33256 (local address 127.30.214.188:33797)
0808 14:45:26.035872 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:26.035876 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:26.035892 (+ 16us) server_negotiation.cc:407] Connection header received
0808 14:45:26.035910 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:26.035912 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:26.035928 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:26.036000 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:26.036663 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.037341 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.038177 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.038629 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.038697 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:26.041416 (+ 2719us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:26.041422 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:26.041422 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:26.041429 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:26.043135 (+ 1706us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:26.043493 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:26.043496 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:26.043496 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:26.043566 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:26.043727 (+ 161us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:26.043727 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:26.043727 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:26.043894 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:26.044025 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:26.044065 (+ 40us) server_negotiation.cc:299] Negotiation successful
0808 14:45:26.044142 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":88,"threads_started":1}
Aug 08 14:45:26 dist-test-slave-42z9 krb5kdc[8225](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200326, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.214.188@KRBTEST.COM for oryx/127.30.214.189@KRBTEST.COM
I20260808 14:45:26.049078 9345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:26.042875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.189:41969 (local address 127.0.0.1:59042)
0808 14:45:26.042921 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:26.042931 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:26.042969 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:26.043128 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:26.043130 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:26.043278 (+ 148us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:26.043340 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:26.043342 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.044207 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.044209 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:26.045129 (+ 920us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:26.045131 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.045486 (+ 355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.045487 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:26.045548 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:26.045903 (+ 355us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:26.045908 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:26.046984 (+ 1076us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:26.048320 (+ 1336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:26.048321 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:26.048321 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:26.048482 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:26.048636 (+ 154us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:26.048636 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:26.048636 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:26.048681 (+ 45us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:26.048849 (+ 168us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:26.048850 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:26.048892 (+ 42us) client_negotiation.cc:769] Sending connection context
0808 14:45:26.048935 (+ 43us) client_negotiation.cc:240] Negotiation successful
0808 14:45:26.049009 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260808 14:45:26.049118 9239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:26.042961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59042 (local address 127.30.214.189:41969)
0808 14:45:26.043027 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:26.043029 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:26.043036 (+ 7us) server_negotiation.cc:407] Connection header received
0808 14:45:26.043063 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:26.043064 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:26.043077 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:26.043121 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:26.043410 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.044119 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.045199 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.045402 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.045492 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:26.047068 (+ 1576us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:26.047069 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:26.047070 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:26.047077 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:26.048245 (+ 1168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:26.048540 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:26.048540 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:26.048541 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:26.048592 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:26.048715 (+ 123us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:26.048715 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:26.048716 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:26.048811 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:26.048853 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:26.048953 (+ 100us) server_negotiation.cc:299] Negotiation successful
0808 14:45:26.049029 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 14:45:26.049660 9343 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.214.188" port: 33797 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 14:45:26 dist-test-slave-42z9 krb5kdc[8225](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200326, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.214.188@KRBTEST.COM for oryx/127.30.214.188@KRBTEST.COM
I20260808 14:45:26.056102 9345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:26.049914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.188:33797 (local address 127.0.0.1:33272)
0808 14:45:26.049957 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:26.049967 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:26.050010 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:26.050101 (+ 91us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:26.050102 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:26.050209 (+ 107us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:26.050245 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:26.050246 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.050919 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.050920 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:26.051376 (+ 456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:26.051377 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.051900 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.051901 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:26.051944 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:26.052341 (+ 397us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:26.052346 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:26.053612 (+ 1266us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:26.055137 (+ 1525us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:26.055138 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:26.055138 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:26.055292 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:26.055528 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:26.055529 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:26.055529 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:26.055595 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:26.055857 (+ 262us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:26.055857 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:26.055894 (+ 37us) client_negotiation.cc:769] Sending connection context
0808 14:45:26.055947 (+ 53us) client_negotiation.cc:240] Negotiation successful
0808 14:45:26.056034 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26}
I20260808 14:45:26.056205 9346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:26.049971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33272 (local address 127.30.214.188:33797)
0808 14:45:26.050005 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:26.050006 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:26.050014 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:45:26.050040 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:26.050041 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:26.050051 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:26.050097 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:26.050292 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.050754 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.051490 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.051698 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.051767 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:26.053692 (+ 1925us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:26.053693 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:26.053694 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:26.053700 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:26.055060 (+ 1360us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:26.055349 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:26.055350 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:26.055351 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:26.055417 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:26.055659 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:26.055659 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:26.055660 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:26.055795 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:26.055864 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:26.055982 (+ 118us) server_negotiation.cc:299] Negotiation successful
0808 14:45:26.056102 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":31,"server-negotiator.queue_time_us":16}
I20260808 14:45:26.058207 9343 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695: Bootstrap starting.
I20260808 14:45:26.059130 9343 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695: Neither blocks nor log segments found. Creating new log.
I20260808 14:45:26.059382 9343 log.cc:824] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695: Log is configured to *not* fsync() on all Append() calls
I20260808 14:45:26.060124 9343 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695: No bootstrap required, opened a new log
I20260808 14:45:26.061638 9343 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41515 } } peers { permanent_uuid: "2956799a475441f0b2676c39eb812451" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 41969 } } peers { permanent_uuid: "3835d4d282c54ce8b02f7780f2d12695" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 33797 } }
I20260808 14:45:26.061779 9343 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:45:26.061801 9343 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3835d4d282c54ce8b02f7780f2d12695, State: Initialized, Role: FOLLOWER
I20260808 14:45:26.061908 9343 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41515 } } peers { permanent_uuid: "2956799a475441f0b2676c39eb812451" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 41969 } } peers { permanent_uuid: "3835d4d282c54ce8b02f7780f2d12695" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 33797 } }
I20260808 14:45:26.062245 9343 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:45:26.062331 9348 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41515 } } peers { permanent_uuid: "2956799a475441f0b2676c39eb812451" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 41969 } } peers { permanent_uuid: "3835d4d282c54ce8b02f7780f2d12695" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 33797 } } }
I20260808 14:45:26.062506 9348 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695 [sys.catalog]: This master's current role is: FOLLOWER
W20260808 14:45:26.064155 9361 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:45:26.064229 9361 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:45:26.066893 9244 master_runner.cc:428] Detected that this master 3835d4d282c54ce8b02f7780f2d12695 is joining an existing cluster
I20260808 14:45:26.066952 9244 master_runner.cc:432] Initiating AddMaster RPC to add 127.30.214.188:33797
I20260808 14:45:26.075022 9239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:26.068276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59058 (local address 127.30.214.189:41969)
0808 14:45:26.068337 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:26.068340 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:26.068347 (+ 7us) server_negotiation.cc:407] Connection header received
0808 14:45:26.068369 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:26.068370 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:26.068378 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:26.068425 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:26.068929 (+ 504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.069751 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.070900 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.071196 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.071241 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:26.072454 (+ 1213us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:26.072455 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:26.072456 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:26.072463 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:26.073902 (+ 1439us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:26.074325 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:26.074326 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:26.074326 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:26.074376 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:26.074562 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:26.074563 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:26.074563 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:26.074667 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:26.074714 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:26.074881 (+ 167us) server_negotiation.cc:299] Negotiation successful
0808 14:45:26.074944 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 14:45:26.075162 9372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:26.067924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.189:41969 (local address 127.0.0.1:59058)
0808 14:45:26.068090 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:26.068100 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:26.068155 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:26.068435 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:26.068436 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:26.068738 (+ 302us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:26.068841 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:26.068844 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.069851 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.069852 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:26.070791 (+ 939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:26.070794 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.071337 (+ 543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.071338 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:26.071405 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:26.071859 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:26.071865 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:26.072344 (+ 479us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:26.073979 (+ 1635us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:26.073980 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:26.073980 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:26.074253 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:26.074433 (+ 180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:26.074434 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:26.074434 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:26.074510 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:26.074722 (+ 212us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:26.074723 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:26.074790 (+ 67us) client_negotiation.cc:769] Sending connection context
0808 14:45:26.074865 (+ 75us) client_negotiation.cc:240] Negotiation successful
0808 14:45:26.074981 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":95,"threads_started":1}
I20260808 14:45:26.090122 8360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:26.068652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45994 (local address 127.30.214.190:41515)
0808 14:45:26.068699 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:26.068701 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:26.068892 (+ 191us) server_negotiation.cc:407] Connection header received
0808 14:45:26.068996 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:26.068997 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:26.069010 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:26.069039 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:26.069385 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.070169 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.071121 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.071400 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.071436 (+ 36us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:26.087224 (+ 15788us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:26.087226 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:26.087227 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:26.087237 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:26.088761 (+ 1524us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:26.089195 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:26.089196 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:26.089197 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:26.089256 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:26.089493 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:26.089494 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:26.089494 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:26.089667 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:26.089749 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:26.089932 (+ 183us) server_negotiation.cc:299] Negotiation successful
0808 14:45:26.090024 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 14:45:26.090140 9374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:26.068610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:41515 (local address 127.0.0.1:45994)
0808 14:45:26.068828 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:26.068839 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:26.068915 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:26.069100 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:26.069101 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:26.069261 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:26.069308 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:26.069309 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.070266 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.070267 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:26.071045 (+ 778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:26.071047 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.071507 (+ 460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.071508 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:26.071567 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:26.086430 (+ 14863us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:26.086434 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:26.087068 (+ 634us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:26.088856 (+ 1788us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:26.088857 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:26.088857 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:26.089120 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:26.089314 (+ 194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:26.089314 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:26.089315 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:26.089389 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:26.089743 (+ 354us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:26.089744 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:26.089799 (+ 55us) client_negotiation.cc:769] Sending connection context
0808 14:45:26.089895 (+ 96us) client_negotiation.cc:240] Negotiation successful
0808 14:45:26.090019 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":162,"threads_started":1}
I20260808 14:45:26.090416 9346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:26.068323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33280 (local address 127.30.214.188:33797)
0808 14:45:26.068364 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:26.068366 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:26.068373 (+ 7us) server_negotiation.cc:407] Connection header received
0808 14:45:26.068394 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:26.068394 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:26.068403 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:26.068457 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:26.069245 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.070004 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.071014 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.071265 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.071300 (+ 35us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:26.087574 (+ 16274us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:26.087576 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:26.087576 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:26.087584 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:26.089106 (+ 1522us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:26.089646 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:26.089646 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:26.089647 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:26.089699 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:26.089872 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:26.089873 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:26.089874 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:26.090014 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:26.090077 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:26.090243 (+ 166us) server_negotiation.cc:299] Negotiation successful
0808 14:45:26.090327 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 14:45:26.090762 9373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:26.068156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.188:33797 (local address 127.0.0.1:33280)
0808 14:45:26.068244 (+ 88us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:26.068251 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:26.068276 (+ 25us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:26.068929 (+ 653us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:26.068930 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:26.069106 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:26.069168 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:26.069170 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.070086 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.070087 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:26.070931 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:26.070933 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.071364 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.071365 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:26.071432 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:26.086383 (+ 14951us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:26.086391 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:26.087069 (+ 678us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:26.089329 (+ 2260us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:26.089330 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:26.089330 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:26.089587 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:26.089757 (+ 170us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:26.089757 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:26.089758 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:26.089806 (+ 48us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:26.090104 (+ 298us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:26.090104 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:26.090147 (+ 43us) client_negotiation.cc:769] Sending connection context
0808 14:45:26.090453 (+ 306us) client_negotiation.cc:240] Negotiation successful
0808 14:45:26.090555 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":75,"thread_start_us":56,"threads_started":1}
I20260808 14:45:26.095885 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 8382
Aug 08 14:45:26 dist-test-slave-42z9 krb5kdc[8225](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200325, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.214.190@KRBTEST.COM for oryx/127.30.214.188@KRBTEST.COM
I20260808 14:45:26.119035 9109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:26.093081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.188:33797 (local address 127.0.0.1:33290)
0808 14:45:26.093137 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:26.093151 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:26.093203 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:26.093438 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:26.093439 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:26.093682 (+ 243us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:26.093739 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:26.093742 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.094341 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.094343 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:26.095174 (+ 831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:26.095177 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.095671 (+ 494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.095673 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:26.095757 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:26.111711 (+ 15954us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:26.111719 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:26.115245 (+ 3526us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:26.118082 (+ 2837us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:26.118083 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:26.118083 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:26.118284 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:26.118446 (+ 162us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:26.118447 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:26.118447 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:26.118489 (+ 42us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:26.118713 (+ 224us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:26.118714 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:26.118762 (+ 48us) client_negotiation.cc:769] Sending connection context
0808 14:45:26.118815 (+ 53us) client_negotiation.cc:240] Negotiation successful
0808 14:45:26.118943 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260808 14:45:26.119383 9346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:26.093282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33290 (local address 127.30.214.188:33797)
0808 14:45:26.093328 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:26.093330 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:26.093337 (+ 7us) server_negotiation.cc:407] Connection header received
0808 14:45:26.093364 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:26.093365 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:26.093373 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:26.093415 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:26.093811 (+ 396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.094270 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.095317 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.095586 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.095674 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:26.116482 (+ 20808us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:26.116484 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:26.116484 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:26.116494 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:26.117968 (+ 1474us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:26.118346 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:26.118347 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:26.118348 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:26.118397 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:26.118534 (+ 137us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:26.118535 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:26.118535 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:26.118653 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:26.118696 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:26.119213 (+ 517us) server_negotiation.cc:299] Negotiation successful
0808 14:45:26.119287 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 14:45:26.129144 8296 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.30.214.188:33797: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "3835d4d282c54ce8b02f7780f2d12695"
member_type: NON_VOTER
last_known_addr {
host: "127.30.214.188"
port: 33797
}
attrs {
promote: true
}
}
dest_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad"
cas_config_opid_index: 5
I20260808 14:45:26.129521 8296 consensus_queue.cc:237] T 00000000000000000000000000000000 P 03221342f77f4ccb9c0a4d58bae5a5ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41515 } } peers { permanent_uuid: "2956799a475441f0b2676c39eb812451" member_type: NON_VOTER last_known_addr { host: "127.30.214.189" port: 41969 } attrs { promote: true } } peers { permanent_uuid: "3835d4d282c54ce8b02f7780f2d12695" member_type: NON_VOTER last_known_addr { host: "127.30.214.188" port: 33797 } attrs { promote: true } }
I20260808 14:45:26.130604 9301 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:26.132056 9301 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695 [term 1 FOLLOWER]: Refusing update from remote peer 03221342f77f4ccb9c0a4d58bae5a5ad: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260808 14:45:26.132364 9113 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 03221342f77f4ccb9c0a4d58bae5a5ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "3835d4d282c54ce8b02f7780f2d12695" member_type: NON_VOTER last_known_addr { host: "127.30.214.188" port: 33797 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:45:26.134024 9239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:26.130263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59070 (local address 127.30.214.189:41969)
0808 14:45:26.130427 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:26.130429 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:26.130558 (+ 129us) server_negotiation.cc:407] Connection header received
0808 14:45:26.130584 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:26.130585 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:26.130611 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:26.130660 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:45:26.130835 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.131559 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.132939 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.133486 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.133548 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:26.133621 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:26.133904 (+ 283us) server_negotiation.cc:299] Negotiation successful
0808 14:45:26.133954 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136}
I20260808 14:45:26.134215 9109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:26.130157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.189:41969 (local address 127.0.0.1:59070)
0808 14:45:26.130462 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:26.130474 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:26.130516 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:26.130720 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:26.130721 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:26.130722 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:45:26.130777 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:26.130779 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.131656 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.131657 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:26.132828 (+ 1171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:26.132831 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.133658 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.133659 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:26.133719 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:26.133743 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 14:45:26.133796 (+ 53us) client_negotiation.cc:240] Negotiation successful
0808 14:45:26.134153 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287}
I20260808 14:45:26.134291 9301 raft_consensus.cc:858] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695 [term 1 NON_PARTICIPANT]: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41515 } } peers { permanent_uuid: "2956799a475441f0b2676c39eb812451" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 41969 } } peers { permanent_uuid: "3835d4d282c54ce8b02f7780f2d12695" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 33797 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41515 } } peers { permanent_uuid: "2956799a475441f0b2676c39eb812451" member_type: NON_VOTER last_known_addr { host: "127.30.214.189" port: 41969 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41515 } } peers { permanent_uuid: "2956799a475441f0b2676c39eb812451" member_type: NON_VOTER last_known_addr { host: "127.30.214.189" port: 41969 } attrs { promote: true } } peers { permanent_uuid: "3835d4d282c54ce8b02f7780f2d12695" member_type: NON_VOTER last_known_addr { host: "127.30.214.188" port: 33797 } attrs { promote: true } }
W20260808 14:45:26.134522 9301 raft_consensus.cc:1565] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695 [term 1 NON_PARTICIPANT]: Could not prepare op 'term: 1 index: 6' and following 0 ops. Status for this op: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41515 } } peers { permanent_uuid: "2956799a475441f0b2676c39eb812451" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 41969 } } peers { permanent_uuid: "3835d4d282c54ce8b02f7780f2d12695" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 33797 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41515 } } peers { permanent_uuid: "2956799a475441f0b2676c39eb812451" member_type: NON_VOTER last_known_addr { host: "127.30.214.189" port: 41969 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41515 } } peers { permanent_uuid: "2956799a475441f0b2676c39eb812451" member_type: NON_VOTER last_known_addr { host: "127.30.214.189" port: 41969 } attrs { promote: true } } peers { permanent_uuid: "3835d4d282c54ce8b02f7780f2d12695" member_type: NON_VOTER last_known_addr { host: "127.30.214.188" port: 33797 } attrs { promote: true } }
I20260808 14:45:26.134593 9113 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 03221342f77f4ccb9c0a4d58bae5a5ad [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 3835d4d282c54ce8b02f7780f2d12695 (127.30.214.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41515 } } peers { permanent_uuid: "2956799a475441f0b2676c39eb812451" member_type: NON_VOTER last_known_addr { host: "127.30.214.189" port: 41969 } attrs { promote: true } } peers { permanent_uuid: "3835d4d282c54ce8b02f7780f2d12695" member_type: NON_VOTER last_known_addr { host: "127.30.214.188" port: 33797 } attrs { promote: true } } }
I20260808 14:45:26.135245 9301 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695 [term 1 NON_PARTICIPANT]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 2956799a475441f0b2676c39eb812451 (127.30.214.189) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41515 } } peers { permanent_uuid: "2956799a475441f0b2676c39eb812451" member_type: NON_VOTER last_known_addr { host: "127.30.214.189" port: 41969 } attrs { promote: true } } }
I20260808 14:45:26.135578 9113 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.30.214.188:33797
I20260808 14:45:26.135650 9113 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03221342f77f4ccb9c0a4d58bae5a5ad [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41515 } } peers { permanent_uuid: "2956799a475441f0b2676c39eb812451" member_type: NON_VOTER last_known_addr { host: "127.30.214.189" port: 41969 } attrs { promote: true } } peers { permanent_uuid: "3835d4d282c54ce8b02f7780f2d12695" member_type: NON_VOTER last_known_addr { host: "127.30.214.188" port: 33797 } attrs { promote: true } } }
I20260808 14:45:26.135710 9113 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03221342f77f4ccb9c0a4d58bae5a5ad [sys.catalog]: This master's current role is: LEADER
I20260808 14:45:26.136576 9348 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 03221342f77f4ccb9c0a4d58bae5a5ad. Latest consensus state: current_term: 1 leader_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41515 } } peers { permanent_uuid: "2956799a475441f0b2676c39eb812451" member_type: NON_VOTER last_known_addr { host: "127.30.214.189" port: 41969 } attrs { promote: true } } }
I20260808 14:45:26.136691 9348 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695 [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260808 14:45:26.136543 9244 master.cc:537] Master@127.30.214.188:33797 shutting down...
I20260808 14:45:26.136579 9378 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41515 } } peers { permanent_uuid: "2956799a475441f0b2676c39eb812451" member_type: NON_VOTER last_known_addr { host: "127.30.214.189" port: 41969 } attrs { promote: true } } }
I20260808 14:45:26.137108 9378 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695 [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260808 14:45:26.137105 9184 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451 [term 1 LEARNER]: Refusing update from remote peer 03221342f77f4ccb9c0a4d58bae5a5ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260808 14:45:26.136248 9383 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41515 } } peers { permanent_uuid: "2956799a475441f0b2676c39eb812451" member_type: NON_VOTER last_known_addr { host: "127.30.214.189" port: 41969 } attrs { promote: true } } }
I20260808 14:45:26.137152 9383 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695 [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260808 14:45:26.137336 9112 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 03221342f77f4ccb9c0a4d58bae5a5ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "2956799a475441f0b2676c39eb812451" member_type: NON_VOTER last_known_addr { host: "127.30.214.189" port: 41969 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260808 14:45:26.137951 9184 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 3835d4d282c54ce8b02f7780f2d12695 (127.30.214.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41515 } } peers { permanent_uuid: "2956799a475441f0b2676c39eb812451" member_type: NON_VOTER last_known_addr { host: "127.30.214.189" port: 41969 } attrs { promote: true } } peers { permanent_uuid: "3835d4d282c54ce8b02f7780f2d12695" member_type: NON_VOTER last_known_addr { host: "127.30.214.188" port: 33797 } attrs { promote: true } } }
I20260808 14:45:26.138684 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.129:33035
--local_ip_for_outbound_sockets=127.30.214.129
--tserver_master_addrs=127.30.214.190:41515
--webserver_port=39673
--webserver_interface=127.30.214.129
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/krb5kdc/oryx_127.30.214.129.keytab
--principal=oryx/127.30.214.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:34681
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.30.214.190:41515,127.30.214.189:41969
--tserver_master_addrs=127.30.214.190:41515,127.30.214.189:41969,127.30.214.188:33797 with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:45:26.138972 9221 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 03221342f77f4ccb9c0a4d58bae5a5ad. Latest consensus state: current_term: 1 leader_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41515 } } peers { permanent_uuid: "2956799a475441f0b2676c39eb812451" member_type: NON_VOTER last_known_addr { host: "127.30.214.189" port: 41969 } attrs { promote: true } } peers { permanent_uuid: "3835d4d282c54ce8b02f7780f2d12695" member_type: NON_VOTER last_known_addr { host: "127.30.214.188" port: 33797 } attrs { promote: true } } }
I20260808 14:45:26.139058 9221 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451 [sys.catalog]: This master's current role is: LEARNER
I20260808 14:45:26.139096 9221 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41515 } } peers { permanent_uuid: "2956799a475441f0b2676c39eb812451" member_type: NON_VOTER last_known_addr { host: "127.30.214.189" port: 41969 } attrs { promote: true } } peers { permanent_uuid: "3835d4d282c54ce8b02f7780f2d12695" member_type: NON_VOTER last_known_addr { host: "127.30.214.188" port: 33797 } attrs { promote: true } } }
I20260808 14:45:26.139140 9221 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451 [sys.catalog]: This master's current role is: LEARNER
I20260808 14:45:26.139748 9113 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 03221342f77f4ccb9c0a4d58bae5a5ad: attempting to promote NON_VOTER 2956799a475441f0b2676c39eb812451 to VOTER
I20260808 14:45:26.139967 9113 consensus_queue.cc:237] T 00000000000000000000000000000000 P 03221342f77f4ccb9c0a4d58bae5a5ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41515 } } peers { permanent_uuid: "2956799a475441f0b2676c39eb812451" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 41969 } attrs { promote: false } } peers { permanent_uuid: "3835d4d282c54ce8b02f7780f2d12695" member_type: NON_VOTER last_known_addr { host: "127.30.214.188" port: 33797 } attrs { promote: true } }
I20260808 14:45:26.140281 9113 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03221342f77f4ccb9c0a4d58bae5a5ad [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41515 } } peers { permanent_uuid: "2956799a475441f0b2676c39eb812451" member_type: NON_VOTER last_known_addr { host: "127.30.214.189" port: 41969 } attrs { promote: true } } peers { permanent_uuid: "3835d4d282c54ce8b02f7780f2d12695" member_type: NON_VOTER last_known_addr { host: "127.30.214.188" port: 33797 } attrs { promote: true } } } pending_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41515 } } peers { permanent_uuid: "2956799a475441f0b2676c39eb812451" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 41969 } attrs { promote: false } } peers { permanent_uuid: "3835d4d282c54ce8b02f7780f2d12695" member_type: NON_VOTER last_known_addr { host: "127.30.214.188" port: 33797 } attrs { promote: true } } }
I20260808 14:45:26.140374 9113 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03221342f77f4ccb9c0a4d58bae5a5ad [sys.catalog]: This master's current role is: LEADER
I20260808 14:45:26.140753 9184 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451 [term 1 LEARNER]: Refusing update from remote peer 03221342f77f4ccb9c0a4d58bae5a5ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260808 14:45:26.140911 9244 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695 [term 1 NON_PARTICIPANT]: Raft consensus shutting down.
W20260808 14:45:26.140944 8269 consensus_peers.cc:487] T 00000000000000000000000000000000 P 03221342f77f4ccb9c0a4d58bae5a5ad -> Peer 3835d4d282c54ce8b02f7780f2d12695 (127.30.214.188:33797): Couldn't send request to peer 3835d4d282c54ce8b02f7780f2d12695. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260808 14:45:26.141033 9244 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695 [term 1 NON_PARTICIPANT]: Raft consensus is shut down!
I20260808 14:45:26.141076 9244 tablet_replica.cc:330] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695: stopping tablet replica
I20260808 14:45:26.141325 9386 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 03221342f77f4ccb9c0a4d58bae5a5ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "2956799a475441f0b2676c39eb812451" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 41969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260808 14:45:26.142004 9389 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 03221342f77f4ccb9c0a4d58bae5a5ad [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 2956799a475441f0b2676c39eb812451 (127.30.214.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41515 } } peers { permanent_uuid: "2956799a475441f0b2676c39eb812451" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 41969 } attrs { promote: false } } peers { permanent_uuid: "3835d4d282c54ce8b02f7780f2d12695" member_type: NON_VOTER last_known_addr { host: "127.30.214.188" port: 33797 } attrs { promote: true } } }
I20260808 14:45:26.142171 9184 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 2956799a475441f0b2676c39eb812451 (127.30.214.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41515 } } peers { permanent_uuid: "2956799a475441f0b2676c39eb812451" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 41969 } attrs { promote: false } } peers { permanent_uuid: "3835d4d282c54ce8b02f7780f2d12695" member_type: NON_VOTER last_known_addr { host: "127.30.214.188" port: 33797 } attrs { promote: true } } }
I20260808 14:45:26.142999 9389 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03221342f77f4ccb9c0a4d58bae5a5ad [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41515 } } peers { permanent_uuid: "2956799a475441f0b2676c39eb812451" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 41969 } attrs { promote: false } } peers { permanent_uuid: "3835d4d282c54ce8b02f7780f2d12695" member_type: NON_VOTER last_known_addr { host: "127.30.214.188" port: 33797 } attrs { promote: true } } }
I20260808 14:45:26.143074 9389 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03221342f77f4ccb9c0a4d58bae5a5ad [sys.catalog]: This master's current role is: LEADER
I20260808 14:45:26.143024 9112 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03221342f77f4ccb9c0a4d58bae5a5ad [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41515 } } peers { permanent_uuid: "2956799a475441f0b2676c39eb812451" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 41969 } attrs { promote: false } } peers { permanent_uuid: "3835d4d282c54ce8b02f7780f2d12695" member_type: NON_VOTER last_known_addr { host: "127.30.214.188" port: 33797 } attrs { promote: true } } }
I20260808 14:45:26.143107 9112 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03221342f77f4ccb9c0a4d58bae5a5ad [sys.catalog]: This master's current role is: LEADER
I20260808 14:45:26.143164 9385 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41515 } } peers { permanent_uuid: "2956799a475441f0b2676c39eb812451" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 41969 } attrs { promote: false } } peers { permanent_uuid: "3835d4d282c54ce8b02f7780f2d12695" member_type: NON_VOTER last_known_addr { host: "127.30.214.188" port: 33797 } attrs { promote: true } } }
I20260808 14:45:26.143240 9385 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:45:26.155053 9244 master.cc:552] Master@127.30.214.188:33797 shutdown complete.
I20260808 14:45:26.155109 9244 master_runner.cc:305] Clearing existing system tablet
I20260808 14:45:26.155243 9244 fs_manager.cc:359] Metadata directory not provided
I20260808 14:45:26.155289 9244 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:45:26.155894 9244 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:45:26.156373 9393 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:26.156499 9244 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:45:26.156553 9244 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:26.156575 9244 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/master-2/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/master-2/wal
uuid: "3835d4d282c54ce8b02f7780f2d12695"
format_stamp: "Formatted at 2026-08-08 14:45:26 on dist-test-slave-42z9"
server_key: "53bc0d143dacfd5e63377cba64da2ae9"
server_key_iv: "3ead05fd52f8a5ba76daf043fb20167d"
server_key_version: "encryptionkey@0"
I20260808 14:45:26.157266 9244 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:45:26.158723 9244 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260808 14:45:26.158793 9244 log.cc:1196] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695: Deleting WAL directory at /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260808 14:45:26.159024 9244 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695: Deleting consensus metadata
I20260808 14:45:26.159142 9244 master_runner.cc:315] Copying system tablet from 127.30.214.190:41515
I20260808 14:45:26.159747 9244 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695: tablet copy: Beginning tablet copy session from remote peer at address 127.30.214.190:41515
I20260808 14:45:26.166263 9401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:26.160063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:41515 (local address 127.0.0.1:46004)
0808 14:45:26.160197 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:26.160207 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:26.160267 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:26.160394 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:26.160395 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:26.160591 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:26.160646 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:26.160648 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.161306 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.161307 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:26.161949 (+ 642us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:26.161952 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.162314 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.162315 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:26.162396 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:26.162936 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:26.162941 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:26.163380 (+ 439us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:26.165050 (+ 1670us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:26.165051 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:26.165051 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:26.165282 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:26.165547 (+ 265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:26.165548 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:26.165548 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:26.165615 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:26.165898 (+ 283us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:26.165899 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:26.165949 (+ 50us) client_negotiation.cc:769] Sending connection context
0808 14:45:26.166015 (+ 66us) client_negotiation.cc:240] Negotiation successful
0808 14:45:26.166157 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":77,"threads_started":1}
I20260808 14:45:26.166244 8360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:26.160140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46004 (local address 127.30.214.190:41515)
0808 14:45:26.160195 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:26.160196 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:26.160252 (+ 56us) server_negotiation.cc:407] Connection header received
0808 14:45:26.160318 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:26.160319 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:26.160329 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:26.160387 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:26.160724 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.161231 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.162021 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.162250 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.162308 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:26.163502 (+ 1194us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:26.163504 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:26.163504 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:26.163512 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:26.164971 (+ 1459us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:26.165351 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:26.165352 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:26.165352 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:26.165414 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:26.165712 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:26.165713 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:26.165714 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:26.165836 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:26.165895 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:26.166044 (+ 149us) server_negotiation.cc:299] Negotiation successful
0808 14:45:26.166144 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 14:45:26.166986 8325 tablet_copy_service.cc:140] P 03221342f77f4ccb9c0a4d58bae5a5ad: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 3835d4d282c54ce8b02f7780f2d12695 ({username='oryx', principal='oryx/127.30.214.188@KRBTEST.COM'} at 127.0.0.1:46004)
I20260808 14:45:26.167057 8325 tablet_copy_service.cc:161] P 03221342f77f4ccb9c0a4d58bae5a5ad: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 3835d4d282c54ce8b02f7780f2d12695 at {username='oryx', principal='oryx/127.30.214.188@KRBTEST.COM'} at 127.0.0.1:46004: session id = 3835d4d282c54ce8b02f7780f2d12695-00000000000000000000000000000000
I20260808 14:45:26.167595 8325 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 03221342f77f4ccb9c0a4d58bae5a5ad: Tablet Copy: opened 0 blocks and 1 log segments
I20260808 14:45:26.168118 9244 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260808 14:45:26.169111 9244 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695: tablet copy: Starting download of 0 data blocks...
I20260808 14:45:26.169269 9244 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695: tablet copy: Starting download of 1 WAL segments...
I20260808 14:45:26.170110 9244 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260808 14:45:26.171018 8325 tablet_copy_service.cc:342] P 03221342f77f4ccb9c0a4d58bae5a5ad: Request end of tablet copy session 3835d4d282c54ce8b02f7780f2d12695-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.30.214.188@KRBTEST.COM'} at 127.0.0.1:46004
I20260808 14:45:26.171077 8325 tablet_copy_service.cc:433] P 03221342f77f4ccb9c0a4d58bae5a5ad: ending tablet copy session 3835d4d282c54ce8b02f7780f2d12695-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 3835d4d282c54ce8b02f7780f2d12695
I20260808 14:45:26.173846 9244 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:45:26.174945 9402 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:26.175171 9408 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:26.174930 9403 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:26.178279 9244 server_base.cc:1034] running on GCE node
I20260808 14:45:26.178412 9244 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:45:26.178578 9244 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:45:26.179735 9244 hybrid_clock.cc:648] HybridClock initialized: now 1786200326179729 us; error 28 us; skew 500 ppm
Aug 08 14:45:26 dist-test-slave-42z9 krb5kdc[8225](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200326, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.214.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:45:26.181106 9244 init.cc:377] Logged in from keytab as oryx/127.30.214.188@KRBTEST.COM (short username oryx)
I20260808 14:45:26.181458 9244 webserver.cc:460] Webserver started at http://127.30.214.188:45585/ using document root <none> and password file <none>
I20260808 14:45:26.181583 9244 fs_manager.cc:359] Metadata directory not provided
I20260808 14:45:26.181619 9244 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:45:26.182650 9244 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:45:26.183320 9416 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:26.183457 9244 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:45:26.183521 9244 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/master-2/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/master-2/wal
uuid: "3835d4d282c54ce8b02f7780f2d12695"
format_stamp: "Formatted at 2026-08-08 14:45:26 on dist-test-slave-42z9"
server_key: "53bc0d143dacfd5e63377cba64da2ae9"
server_key_iv: "3ead05fd52f8a5ba76daf043fb20167d"
server_key_version: "encryptionkey@0"
I20260808 14:45:26.183598 9244 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:45:26.192910 9244 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:45:26.194484 9244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:45:26.197394 9244 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.188:33797
I20260808 14:45:26.197742 9496 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.188:33797 every 8 connection(s)
I20260808 14:45:26.197842 9244 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/master-2/data/info.pb
I20260808 14:45:26.198616 9497 sys_catalog.cc:263] Verifying existing consensus state
I20260808 14:45:26.199261 9497 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695: Bootstrap starting.
I20260808 14:45:26.201058 9497 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 14:45:26.201256 9497 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695: Bootstrap complete.
I20260808 14:45:26.201467 9497 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41515 } } peers { permanent_uuid: "2956799a475441f0b2676c39eb812451" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 41969 } attrs { promote: false } } peers { permanent_uuid: "3835d4d282c54ce8b02f7780f2d12695" member_type: NON_VOTER last_known_addr { host: "127.30.214.188" port: 33797 } attrs { promote: true } }
I20260808 14:45:26.201551 9497 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3835d4d282c54ce8b02f7780f2d12695, State: Initialized, Role: LEARNER
I20260808 14:45:26.201591 9497 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41515 } } peers { permanent_uuid: "2956799a475441f0b2676c39eb812451" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 41969 } attrs { promote: false } } peers { permanent_uuid: "3835d4d282c54ce8b02f7780f2d12695" member_type: NON_VOTER last_known_addr { host: "127.30.214.188" port: 33797 } attrs { promote: true } }
I20260808 14:45:26.201773 9497 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:45:26.202775 9501 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41515 } } peers { permanent_uuid: "2956799a475441f0b2676c39eb812451" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 41969 } attrs { promote: false } } peers { permanent_uuid: "3835d4d282c54ce8b02f7780f2d12695" member_type: NON_VOTER last_known_addr { host: "127.30.214.188" port: 33797 } attrs { promote: true } } }
I20260808 14:45:26.203097 9501 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695 [sys.catalog]: This master's current role is: LEARNER
I20260808 14:45:26.203293 9518 catalog_manager.cc:1259] Loaded cluster ID: 3961a3df3910444ea5c53097ccd0ff75
I20260808 14:45:26.203334 9518 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695: loading cluster ID for follower catalog manager: success
I20260808 14:45:26.204372 9518 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695: acquiring CA information for follower catalog manager: success
I20260808 14:45:26.204648 9518 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260808 14:45:26.267262 9390 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:45:26.267552 9390 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:45:26.267588 9390 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:45:26.269501 9390 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:45:26.269567 9390 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:45:26.269608 9390 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.129
I20260808 14:45:26.272240 9390 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:34681
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/krb5kdc/oryx_127.30.214.129.keytab
--principal=oryx/127.30.214.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.129:33035
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.214.129
--webserver_port=39673
--tserver_master_addrs=127.30.214.190:41515,127.30.214.189:41969,127.30.214.188:33797
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9390
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.129
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:45:26.272639 9390 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:45:26.272994 9390 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:45:26.279004 9528 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:26.279074 9534 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:26.279003 9531 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:26.279428 9390 server_base.cc:1034] running on GCE node
I20260808 14:45:26.279647 9390 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:45:26.279963 9390 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:45:26.281167 9390 hybrid_clock.cc:648] HybridClock initialized: now 1786200326281156 us; error 61 us; skew 500 ppm
Aug 08 14:45:26 dist-test-slave-42z9 krb5kdc[8225](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200326, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.214.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:45:26.285413 9390 init.cc:377] Logged in from keytab as oryx/127.30.214.129@KRBTEST.COM (short username oryx)
I20260808 14:45:26.286046 9390 webserver.cc:460] Webserver started at http://127.30.214.129:39673/ using document root <none> and password file <none>
I20260808 14:45:26.286309 9390 fs_manager.cc:359] Metadata directory not provided
I20260808 14:45:26.286401 9390 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:45:26.288498 9390 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 14:45:26.289290 9543 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:26.289503 9390 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:45:26.289615 9390 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-0/wal
uuid: "21687c84bf824598aa839f0615f15623"
format_stamp: "Formatted at 2026-08-08 14:45:25 on dist-test-slave-42z9"
server_key: "0b58f396406b72e756b1f16bdafc2ce8"
server_key_iv: "ea54503f14c574783c9147d26e7345c9"
server_key_version: "encryptionkey@0"
I20260808 14:45:26.290186 9390 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:45:26.314288 9390 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:45:26.316598 9390 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:45:26.316779 9390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:45:26.317179 9390 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:45:26.317560 9390 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:45:26.317602 9390 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:26.317625 9390 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:45:26.317636 9390 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:26.333796 9390 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.129:33035
I20260808 14:45:26.333927 9704 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.129:33035 every 8 connection(s)
I20260808 14:45:26.334286 9390 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
I20260808 14:45:26.338068 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 9390
I20260808 14:45:26.338220 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 8579
Aug 08 14:45:26 dist-test-slave-42z9 krb5kdc[8225](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200326, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.214.129@KRBTEST.COM for oryx/127.30.214.188@KRBTEST.COM
I20260808 14:45:26.346339 9711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:26.335221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.129:50181 (local address 127.30.214.188:33797)
0808 14:45:26.335400 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:26.335402 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:26.335676 (+ 274us) server_negotiation.cc:407] Connection header received
0808 14:45:26.336461 (+ 785us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:26.336462 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:26.336476 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:26.336543 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:26.337802 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.338872 (+ 1070us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.340002 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.340215 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.340248 (+ 33us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:26.342766 (+ 2518us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:26.342768 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:26.342768 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:26.342778 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:26.344739 (+ 1961us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:26.345383 (+ 644us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:26.345384 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:26.345385 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:26.345472 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:26.345711 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:26.345711 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:26.345711 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:26.345838 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:26.345873 (+ 35us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:26.346184 (+ 311us) server_negotiation.cc:299] Negotiation successful
0808 14:45:26.346264 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":60,"threads_started":1}
I20260808 14:45:26.347108 9715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:26.335155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.188:33797 (local address 127.30.214.129:50181)
0808 14:45:26.335495 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:26.335547 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:26.336367 (+ 820us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:26.336953 (+ 586us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:26.336954 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:26.337279 (+ 325us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:26.337704 (+ 425us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:26.337709 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.338979 (+ 1270us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.338980 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:26.339915 (+ 935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:26.339917 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.340325 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.340326 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:26.340436 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:26.340908 (+ 472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:26.340918 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:26.342625 (+ 1707us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:26.344865 (+ 2240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:26.344876 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:26.344880 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:26.345301 (+ 421us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:26.345532 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:26.345532 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:26.345532 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:26.345655 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:26.345907 (+ 252us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:26.345912 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:26.346069 (+ 157us) client_negotiation.cc:769] Sending connection context
0808 14:45:26.346532 (+ 463us) client_negotiation.cc:240] Negotiation successful
0808 14:45:26.346781 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":299,"mutex_wait_us":37,"thread_start_us":192,"threads_started":1}
Aug 08 14:45:26 dist-test-slave-42z9 krb5kdc[8225](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200326, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.214.129@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM
I20260808 14:45:26.365895 9705 heartbeater.cc:347] Connected to a master server at 127.30.214.188:33797
I20260808 14:45:26.366029 9705 heartbeater.cc:464] Registering TS with master...
I20260808 14:45:26.366269 9705 heartbeater.cc:511] Master 127.30.214.188:33797 requested a full tablet report, sending...
I20260808 14:45:26.367211 9439 ts_manager.cc:194] Registered new tserver with Master: 21687c84bf824598aa839f0615f15623 (127.30.214.129:33035)
I20260808 14:45:26.369130 9712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:26.335154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:41515 (local address 127.30.214.129:56565)
0808 14:45:26.335514 (+ 360us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:26.335548 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:26.336365 (+ 817us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:26.336635 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:26.336640 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:26.337293 (+ 653us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:26.337704 (+ 411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:26.337711 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.355969 (+ 18258us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.355971 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:26.356677 (+ 706us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:26.356682 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.357580 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.357583 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:26.357705 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:26.359749 (+ 2044us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:26.359755 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:26.364241 (+ 4486us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:26.367498 (+ 3257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:26.367499 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:26.367500 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:26.367912 (+ 412us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:26.368411 (+ 499us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:26.368412 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:26.368412 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:26.368486 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:26.368789 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:26.368790 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:26.368840 (+ 50us) client_negotiation.cc:769] Sending connection context
0808 14:45:26.368908 (+ 68us) client_negotiation.cc:240] Negotiation successful
0808 14:45:26.369020 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":224,"mutex_wait_us":2,"thread_start_us":161,"threads_started":1}
I20260808 14:45:26.369153 8360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:26.335114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.129:56565 (local address 127.30.214.190:41515)
0808 14:45:26.335165 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:26.335167 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:26.335638 (+ 471us) server_negotiation.cc:407] Connection header received
0808 14:45:26.336504 (+ 866us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:26.336505 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:26.336518 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:26.336550 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:26.337831 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.338590 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.356852 (+ 18262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.357270 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.357421 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:26.364404 (+ 6983us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:26.364407 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:26.364407 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:26.364416 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:26.366759 (+ 2343us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:26.368018 (+ 1259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:26.368020 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:26.368020 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:26.368323 (+ 303us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:26.368570 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:26.368571 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:26.368572 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:26.368721 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:26.368789 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:26.368967 (+ 178us) server_negotiation.cc:299] Negotiation successful
0808 14:45:26.369063 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
Aug 08 14:45:26 dist-test-slave-42z9 krb5kdc[8225](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200326, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.214.129@KRBTEST.COM for oryx/127.30.214.189@KRBTEST.COM
I20260808 14:45:26.370011 9706 heartbeater.cc:347] Connected to a master server at 127.30.214.190:41515
I20260808 14:45:26.370076 9706 heartbeater.cc:464] Registering TS with master...
I20260808 14:45:26.370153 9706 heartbeater.cc:511] Master 127.30.214.190:41515 requested a full tablet report, sending...
I20260808 14:45:26.370301 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.130:41721
--local_ip_for_outbound_sockets=127.30.214.130
--tserver_master_addrs=127.30.214.190:41515
--webserver_port=36087
--webserver_interface=127.30.214.130
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/krb5kdc/oryx_127.30.214.130.keytab
--principal=oryx/127.30.214.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:34681
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.30.214.190:41515,127.30.214.189:41969
--tserver_master_addrs=127.30.214.190:41515,127.30.214.189:41969,127.30.214.188:33797 with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:45:26.370412 8296 ts_manager.cc:194] Re-registered known tserver with Master: 21687c84bf824598aa839f0615f15623 (127.30.214.129:33035)
I20260808 14:45:26.370844 8296 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.30.214.129@KRBTEST.COM'} at 127.30.214.129:56565
I20260808 14:45:26.373031 9239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:26.335642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.129:54769 (local address 127.30.214.189:41969)
0808 14:45:26.335687 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:26.335689 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:26.335908 (+ 219us) server_negotiation.cc:407] Connection header received
0808 14:45:26.336519 (+ 611us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:26.336520 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:26.336542 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:26.336572 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:26.350238 (+ 13666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.350964 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.367543 (+ 16579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.367779 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.367814 (+ 35us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:26.370219 (+ 2405us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:26.370221 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:26.370221 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:26.370231 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:26.371740 (+ 1509us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:26.372161 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:26.372162 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:26.372162 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:26.372214 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:26.372447 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:26.372448 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:26.372448 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:26.372590 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:26.372649 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:26.372879 (+ 230us) server_negotiation.cc:299] Negotiation successful
0808 14:45:26.372949 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 14:45:26.373201 9716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:26.335552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.189:41969 (local address 127.30.214.129:54769)
0808 14:45:26.335833 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:26.335842 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:26.336377 (+ 535us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:26.336713 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:26.336714 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:26.337303 (+ 589us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:26.337704 (+ 401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:26.337711 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.366564 (+ 28853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.366566 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:26.367428 (+ 862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:26.367433 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.367895 (+ 462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.367896 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:26.367951 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:26.368437 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:26.368442 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:26.370080 (+ 1638us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:26.371836 (+ 1756us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:26.371837 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:26.371837 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:26.372079 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:26.372270 (+ 191us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:26.372271 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:26.372271 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:26.372339 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:26.372653 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:26.372654 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:26.372698 (+ 44us) client_negotiation.cc:769] Sending connection context
0808 14:45:26.372845 (+ 147us) client_negotiation.cc:240] Negotiation successful
0808 14:45:26.372985 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":246,"mutex_wait_us":23,"thread_start_us":114,"threads_started":1}
I20260808 14:45:26.373665 9707 heartbeater.cc:347] Connected to a master server at 127.30.214.189:41969
I20260808 14:45:26.373718 9707 heartbeater.cc:464] Registering TS with master...
I20260808 14:45:26.373802 9707 heartbeater.cc:511] Master 127.30.214.189:41969 requested a full tablet report, sending...
I20260808 14:45:26.374184 9168 ts_manager.cc:194] Registered new tserver with Master: 21687c84bf824598aa839f0615f15623 (127.30.214.129:33035)
W20260808 14:45:26.455837 9718 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:45:26.456080 9718 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:45:26.456105 9718 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:45:26.457365 9718 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:45:26.457414 9718 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:45:26.457473 9718 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.130
I20260808 14:45:26.459105 9718 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:34681
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/krb5kdc/oryx_127.30.214.130.keytab
--principal=oryx/127.30.214.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.130:41721
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.214.130
--webserver_port=36087
--tserver_master_addrs=127.30.214.190:41515,127.30.214.189:41969,127.30.214.188:33797
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9718
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.130
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:45:26.459321 9718 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:45:26.459546 9718 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:45:26.464951 9726 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:26.464955 9728 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:26.464955 9725 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:26.465297 9718 server_base.cc:1034] running on GCE node
I20260808 14:45:26.465559 9718 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:45:26.465832 9718 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:45:26.467017 9718 hybrid_clock.cc:648] HybridClock initialized: now 1786200326466996 us; error 33 us; skew 500 ppm
Aug 08 14:45:26 dist-test-slave-42z9 krb5kdc[8225](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200326, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.214.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:45:26.469681 9718 init.cc:377] Logged in from keytab as oryx/127.30.214.130@KRBTEST.COM (short username oryx)
I20260808 14:45:26.470201 9718 webserver.cc:460] Webserver started at http://127.30.214.130:36087/ using document root <none> and password file <none>
I20260808 14:45:26.470429 9718 fs_manager.cc:359] Metadata directory not provided
I20260808 14:45:26.470491 9718 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:45:26.471908 9718 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:45:26.473124 9738 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:26.473423 9718 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:45:26.473547 9718 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-1/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-1/wal
uuid: "005d6a0684f14786a93ab24b32ae0e59"
format_stamp: "Formatted at 2026-08-08 14:45:25 on dist-test-slave-42z9"
server_key: "56ff7883f2de4d08d9111523fd28bdd1"
server_key_iv: "6db353457e61a79734614f12a5266d52"
server_key_version: "encryptionkey@0"
I20260808 14:45:26.474025 9718 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:45:26.482298 9718 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:45:26.484221 9718 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:45:26.484375 9718 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:45:26.484607 9718 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:45:26.484954 9718 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:45:26.484994 9718 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:26.485025 9718 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:45:26.485049 9718 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:26.491108 9718 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.130:41721
I20260808 14:45:26.491171 9904 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.130:41721 every 8 connection(s)
I20260808 14:45:26.491531 9718 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
I20260808 14:45:26.497292 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 9718
I20260808 14:45:26.497501 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 8767
Aug 08 14:45:26 dist-test-slave-42z9 krb5kdc[8225](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200326, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.214.130@KRBTEST.COM for oryx/127.30.214.189@KRBTEST.COM
I20260808 14:45:26.504098 9239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:26.493084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.130:58851 (local address 127.30.214.189:41969)
0808 14:45:26.493145 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:26.493147 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:26.493293 (+ 146us) server_negotiation.cc:407] Connection header received
0808 14:45:26.494183 (+ 890us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:26.494185 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:26.494200 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:26.494234 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:26.495120 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.495915 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.496938 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.497156 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.497226 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:26.499711 (+ 2485us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:26.499712 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:26.499713 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:26.499721 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:26.502492 (+ 2771us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:26.503148 (+ 656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:26.503150 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:26.503150 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:26.503206 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:26.503449 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:26.503450 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:26.503450 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:26.503576 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:26.503635 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:26.503912 (+ 277us) server_negotiation.cc:299] Negotiation successful
0808 14:45:26.504003 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260808 14:45:26.504402 9910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:26.492881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.189:41969 (local address 127.30.214.130:58851)
0808 14:45:26.493201 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:26.493213 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:26.493997 (+ 784us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:26.494319 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:26.494320 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:26.494775 (+ 455us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:26.495010 (+ 235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:26.495014 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.496021 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.496022 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:26.496848 (+ 826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:26.496850 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.497241 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.497242 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:26.497344 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:26.498025 (+ 681us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:26.498034 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:26.499602 (+ 1568us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:26.502651 (+ 3049us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:26.502664 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:26.502667 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:26.503065 (+ 398us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:26.503264 (+ 199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:26.503265 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:26.503265 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:26.503391 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:26.503635 (+ 244us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:26.503642 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:26.503790 (+ 148us) client_negotiation.cc:769] Sending connection context
0808 14:45:26.503884 (+ 94us) client_negotiation.cc:240] Negotiation successful
0808 14:45:26.504080 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":299,"thread_start_us":72,"threads_started":1}
Aug 08 14:45:26 dist-test-slave-42z9 krb5kdc[8225](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200326, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.214.130@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM
Aug 08 14:45:26 dist-test-slave-42z9 krb5kdc[8225](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200326, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.214.130@KRBTEST.COM for oryx/127.30.214.188@KRBTEST.COM
I20260808 14:45:26.511332 8360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:26.492929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.130:42281 (local address 127.30.214.190:41515)
0808 14:45:26.493007 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:26.493010 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:26.493022 (+ 12us) server_negotiation.cc:407] Connection header received
0808 14:45:26.494157 (+ 1135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:26.494158 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:26.494173 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:26.494240 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:26.495172 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.495696 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.497317 (+ 1621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.505615 (+ 8298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.505705 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:26.507966 (+ 2261us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:26.507968 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:26.507968 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:26.507977 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:26.509838 (+ 1861us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:26.510452 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:26.510453 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:26.510453 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:26.510514 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:26.510735 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:26.510736 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:26.510737 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:26.510881 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:26.510924 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:26.511148 (+ 224us) server_negotiation.cc:299] Negotiation successful
0808 14:45:26.511234 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 14:45:26.511883 9912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:26.492505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:41515 (local address 127.30.214.130:42281)
0808 14:45:26.492764 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:26.492814 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:26.493989 (+ 1175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:26.494315 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:26.494319 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:26.494770 (+ 451us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:26.495106 (+ 336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:26.495108 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.495908 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.495909 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:26.497022 (+ 1113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:26.497025 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.505716 (+ 8691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.505718 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:26.505794 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:26.506244 (+ 450us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:26.506250 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:26.507844 (+ 1594us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:26.509933 (+ 2089us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:26.509934 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:26.509935 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:26.510357 (+ 422us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:26.510604 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:26.510605 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:26.510605 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:26.510666 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:26.510969 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:26.510970 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:26.511013 (+ 43us) client_negotiation.cc:769] Sending connection context
0808 14:45:26.511656 (+ 643us) client_negotiation.cc:240] Negotiation successful
0808 14:45:26.511773 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":204,"mutex_wait_us":73,"thread_start_us":137,"threads_started":1}
I20260808 14:45:26.511955 9711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:26.492473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.130:56083 (local address 127.30.214.188:33797)
0808 14:45:26.492522 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:26.492524 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:26.493170 (+ 646us) server_negotiation.cc:407] Connection header received
0808 14:45:26.494303 (+ 1133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:26.494304 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:26.494315 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:26.494372 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:26.495144 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.495915 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.506250 (+ 10335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.506584 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.506661 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:26.509284 (+ 2623us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:26.509286 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:26.509287 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:26.509294 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:26.510803 (+ 1509us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:26.511173 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:26.511174 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:26.511174 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:26.511234 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:26.511420 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:26.511420 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:26.511421 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:26.511556 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:26.511597 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:26.511789 (+ 192us) server_negotiation.cc:299] Negotiation successful
0808 14:45:26.511870 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 14:45:26.512317 9913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:26.492505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.188:33797 (local address 127.30.214.130:56083)
0808 14:45:26.493100 (+ 595us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:26.493110 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:26.493989 (+ 879us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:26.494396 (+ 407us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:26.494397 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:26.494770 (+ 373us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:26.495010 (+ 240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:26.495018 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.495998 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.495999 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:26.497025 (+ 1026us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:26.497027 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.506808 (+ 9781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.506809 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:26.506967 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:26.507386 (+ 419us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:26.507391 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:26.509169 (+ 1778us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:26.510882 (+ 1713us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:26.510883 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:26.510883 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:26.511094 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:26.511303 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:26.511303 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:26.511304 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:26.511356 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:26.511641 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:26.511641 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:26.511683 (+ 42us) client_negotiation.cc:769] Sending connection context
0808 14:45:26.512083 (+ 400us) client_negotiation.cc:240] Negotiation successful
0808 14:45:26.512188 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":557,"mutex_wait_us":106,"spinlock_wait_cycles":9600,"thread_start_us":136,"threads_started":1}
I20260808 14:45:26.513799 9905 heartbeater.cc:347] Connected to a master server at 127.30.214.188:33797
I20260808 14:45:26.513909 9905 heartbeater.cc:464] Registering TS with master...
I20260808 14:45:26.514117 9905 heartbeater.cc:511] Master 127.30.214.188:33797 requested a full tablet report, sending...
I20260808 14:45:26.514580 9439 ts_manager.cc:194] Registered new tserver with Master: 005d6a0684f14786a93ab24b32ae0e59 (127.30.214.130:41721)
I20260808 14:45:26.516988 9906 heartbeater.cc:347] Connected to a master server at 127.30.214.190:41515
I20260808 14:45:26.517050 9906 heartbeater.cc:464] Registering TS with master...
I20260808 14:45:26.517128 9906 heartbeater.cc:511] Master 127.30.214.190:41515 requested a full tablet report, sending...
I20260808 14:45:26.517267 9907 heartbeater.cc:347] Connected to a master server at 127.30.214.189:41969
I20260808 14:45:26.517300 9907 heartbeater.cc:464] Registering TS with master...
I20260808 14:45:26.517354 9907 heartbeater.cc:511] Master 127.30.214.189:41969 requested a full tablet report, sending...
I20260808 14:45:26.517347 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.131:34441
--local_ip_for_outbound_sockets=127.30.214.131
--tserver_master_addrs=127.30.214.190:41515
--webserver_port=43765
--webserver_interface=127.30.214.131
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/krb5kdc/oryx_127.30.214.131.keytab
--principal=oryx/127.30.214.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:34681
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.30.214.190:41515,127.30.214.189:41969
--tserver_master_addrs=127.30.214.190:41515,127.30.214.189:41969,127.30.214.188:33797 with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:45:26.518872 8296 ts_manager.cc:194] Re-registered known tserver with Master: 005d6a0684f14786a93ab24b32ae0e59 (127.30.214.130:41721)
I20260808 14:45:26.519325 9711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:26.516624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33294 (local address 127.30.214.188:33797)
0808 14:45:26.516732 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:26.516733 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:26.516741 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:45:26.516765 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:26.516766 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:26.516792 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:26.516852 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:45:26.516974 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.517707 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.518584 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.519003 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.519082 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:26.519158 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:26.519213 (+ 55us) server_negotiation.cc:299] Negotiation successful
0808 14:45:26.519253 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260808 14:45:26.519325 9109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:26.516570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.188:33797 (local address 127.0.0.1:33294)
0808 14:45:26.516625 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:26.516638 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:26.516685 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:26.516866 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:26.516868 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:26.516870 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:45:26.516920 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:26.516921 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.517780 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.517781 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:26.518494 (+ 713us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:26.518496 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.519084 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.519085 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:26.519148 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:26.519151 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:45:26.519206 (+ 55us) client_negotiation.cc:240] Negotiation successful
0808 14:45:26.519254 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260808 14:45:26.519383 8296 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.30.214.130@KRBTEST.COM'} at 127.30.214.130:42281
I20260808 14:45:26.519635 9168 ts_manager.cc:194] Registered new tserver with Master: 005d6a0684f14786a93ab24b32ae0e59 (127.30.214.130:41721)
I20260808 14:45:26.520360 9458 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260808 14:45:26.520547 9501 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 03221342f77f4ccb9c0a4d58bae5a5ad. Latest consensus state: current_term: 1 leader_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41515 } } peers { permanent_uuid: "2956799a475441f0b2676c39eb812451" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 41969 } attrs { promote: false } } peers { permanent_uuid: "3835d4d282c54ce8b02f7780f2d12695" member_type: NON_VOTER last_known_addr { host: "127.30.214.188" port: 33797 } attrs { promote: true } } }
I20260808 14:45:26.520676 9501 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695 [sys.catalog]: This master's current role is: LEARNER
W20260808 14:45:26.602368 9914 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:45:26.602600 9914 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:45:26.602635 9914 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:45:26.603924 9914 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:45:26.603984 9914 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:45:26.604013 9914 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.131
I20260808 14:45:26.605574 9914 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:34681
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/krb5kdc/oryx_127.30.214.131.keytab
--principal=oryx/127.30.214.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.131:34441
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.214.131
--webserver_port=43765
--tserver_master_addrs=127.30.214.190:41515,127.30.214.189:41969,127.30.214.188:33797
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9914
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.131
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:45:26.605795 9914 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:45:26.605999 9914 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:45:26.611096 9925 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:26.611129 9928 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:26.611184 9922 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:26.611490 9914 server_base.cc:1034] running on GCE node
I20260808 14:45:26.611691 9914 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:45:26.611927 9914 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:45:26.613072 9914 hybrid_clock.cc:648] HybridClock initialized: now 1786200326613055 us; error 29 us; skew 500 ppm
Aug 08 14:45:26 dist-test-slave-42z9 krb5kdc[8225](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200326, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.214.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:45:26.615845 9914 init.cc:377] Logged in from keytab as oryx/127.30.214.131@KRBTEST.COM (short username oryx)
I20260808 14:45:26.616314 9914 webserver.cc:460] Webserver started at http://127.30.214.131:43765/ using document root <none> and password file <none>
I20260808 14:45:26.616528 9914 fs_manager.cc:359] Metadata directory not provided
I20260808 14:45:26.616607 9914 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:45:26.618197 9914 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260808 14:45:26.618789 9936 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:26.618942 9914 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:26.619041 9914 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-2/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-2/wal
uuid: "afc1660c6a3f4cd695128351c5507cbb"
format_stamp: "Formatted at 2026-08-08 14:45:25 on dist-test-slave-42z9"
server_key: "7e6c1a5c3de88eebdb8869ee6d5e21f6"
server_key_iv: "296d138949c03e5390383244fa3c9f86"
server_key_version: "encryptionkey@0"
I20260808 14:45:26.619408 9914 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:45:26.628453 9914 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:45:26.630641 9914 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:45:26.630786 9914 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:45:26.631063 9914 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:45:26.631371 9914 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:45:26.631407 9914 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:26.631438 9914 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:45:26.631461 9914 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:26.637936 9914 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.131:34441
I20260808 14:45:26.637977 10101 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.131:34441 every 8 connection(s)
I20260808 14:45:26.638338 9914 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
I20260808 14:45:26.643713 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 9914
Aug 08 14:45:26 dist-test-slave-42z9 krb5kdc[8225](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200326, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.214.131@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM
Aug 08 14:45:26 dist-test-slave-42z9 krb5kdc[8225](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200326, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.214.131@KRBTEST.COM for oryx/127.30.214.189@KRBTEST.COM
Aug 08 14:45:26 dist-test-slave-42z9 krb5kdc[8225](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200326, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.214.131@KRBTEST.COM for oryx/127.30.214.188@KRBTEST.COM
I20260808 14:45:26.650548 8360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:26.639097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:50897 (local address 127.30.214.190:41515)
0808 14:45:26.639154 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:26.639156 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:26.639554 (+ 398us) server_negotiation.cc:407] Connection header received
0808 14:45:26.640170 (+ 616us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:26.640171 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:26.640184 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:26.640233 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:26.641144 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.641697 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.643067 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.643329 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.643393 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:26.646312 (+ 2919us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:26.646314 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:26.646314 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:26.646322 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:26.648129 (+ 1807us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:26.649369 (+ 1240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:26.649370 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:26.649371 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:26.649496 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:26.649796 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:26.649796 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:26.649797 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:26.649919 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:26.649961 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:26.650370 (+ 409us) server_negotiation.cc:299] Negotiation successful
0808 14:45:26.650454 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 14:45:26.650738 10112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:26.639554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.189:41969 (local address 127.30.214.131:48251)
0808 14:45:26.639679 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:26.639688 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:26.640062 (+ 374us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:26.640683 (+ 621us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:26.640684 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:26.640863 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:26.640994 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:26.640998 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.641909 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.641910 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:26.642794 (+ 884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:26.642796 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.643173 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.643174 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:26.643381 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:26.644112 (+ 731us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:26.644117 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:26.647094 (+ 2977us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:26.649105 (+ 2011us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:26.649106 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:26.649106 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:26.649372 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:26.649600 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:26.649601 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:26.649601 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:26.649719 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:26.650001 (+ 282us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:26.650008 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:26.650192 (+ 184us) client_negotiation.cc:769] Sending connection context
0808 14:45:26.650321 (+ 129us) client_negotiation.cc:240] Negotiation successful
0808 14:45:26.650496 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"mutex_wait_us":33,"thread_start_us":70,"threads_started":1}
I20260808 14:45:26.650864 10109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:26.639114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:41515 (local address 127.30.214.131:50897)
0808 14:45:26.639421 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:26.639470 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:26.640049 (+ 579us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:26.640324 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:26.640328 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:26.640805 (+ 477us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:26.641082 (+ 277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:26.641084 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.641867 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.641868 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:26.642971 (+ 1103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:26.642975 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.643451 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.643452 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:26.643535 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:26.644003 (+ 468us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:26.644014 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:26.646189 (+ 2175us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:26.648677 (+ 2488us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:26.648689 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:26.648692 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:26.649278 (+ 586us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:26.649572 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:26.649572 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:26.649572 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:26.649719 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:26.650004 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:26.650008 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:26.650192 (+ 184us) client_negotiation.cc:769] Sending connection context
0808 14:45:26.650679 (+ 487us) client_negotiation.cc:240] Negotiation successful
0808 14:45:26.650779 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":245,"mutex_wait_us":2,"thread_start_us":170,"threads_started":1}
I20260808 14:45:26.651134 9239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:26.639736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:48251 (local address 127.30.214.189:41969)
0808 14:45:26.639789 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:26.639791 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:26.639801 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:45:26.640168 (+ 367us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:26.640170 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:26.640182 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:26.640211 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:26.641084 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.641828 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.642883 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.643104 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.643186 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:26.647193 (+ 4007us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:26.647194 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:26.647195 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:26.647204 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:26.648999 (+ 1795us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:26.649469 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:26.649470 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:26.649470 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:26.649528 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:26.649788 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:26.649789 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:26.649789 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:26.649919 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:26.649974 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:26.650998 (+ 1024us) server_negotiation.cc:299] Negotiation successful
0808 14:45:26.651065 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 14:45:26.651325 10111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:26.639114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.188:33797 (local address 127.30.214.131:39575)
0808 14:45:26.639417 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:26.639462 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:26.640088 (+ 626us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:26.640338 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:26.640339 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:26.640659 (+ 320us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:26.640874 (+ 215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:26.640879 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.641898 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.641898 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:26.643040 (+ 1142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:26.643042 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.644735 (+ 1693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.644736 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:26.644873 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:26.645385 (+ 512us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:26.645390 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:26.648092 (+ 2702us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:26.649977 (+ 1885us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:26.649978 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:26.649979 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:26.650183 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:26.650386 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:26.650386 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:26.650387 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:26.650448 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:26.650758 (+ 310us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:26.650759 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:26.650803 (+ 44us) client_negotiation.cc:769] Sending connection context
0808 14:45:26.650862 (+ 59us) client_negotiation.cc:240] Negotiation successful
0808 14:45:26.650980 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262,"mutex_wait_us":69,"thread_start_us":125,"threads_started":1}
I20260808 14:45:26.651404 10103 heartbeater.cc:347] Connected to a master server at 127.30.214.190:41515
I20260808 14:45:26.651459 10104 heartbeater.cc:347] Connected to a master server at 127.30.214.189:41969
I20260808 14:45:26.651499 10103 heartbeater.cc:464] Registering TS with master...
I20260808 14:45:26.651510 10104 heartbeater.cc:464] Registering TS with master...
I20260808 14:45:26.651661 10103 heartbeater.cc:511] Master 127.30.214.190:41515 requested a full tablet report, sending...
I20260808 14:45:26.651664 10104 heartbeater.cc:511] Master 127.30.214.189:41969 requested a full tablet report, sending...
I20260808 14:45:26.651911 9711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:26.639153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:39575 (local address 127.30.214.188:33797)
0808 14:45:26.639215 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:26.639217 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:26.639554 (+ 337us) server_negotiation.cc:407] Connection header received
0808 14:45:26.640205 (+ 651us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:26.640207 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:26.640218 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:26.640247 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:26.640999 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.641808 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.643116 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.643427 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.643504 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:26.648220 (+ 4716us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:26.648221 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:26.648221 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:26.648228 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:26.649868 (+ 1640us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:26.650257 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:26.650258 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:26.650258 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:26.650319 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:26.650529 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:26.650529 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:26.650530 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:26.650663 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:26.650731 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:26.651725 (+ 994us) server_negotiation.cc:299] Negotiation successful
0808 14:45:26.651815 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 14:45:26.652127 9168 ts_manager.cc:194] Registered new tserver with Master: afc1660c6a3f4cd695128351c5507cbb (127.30.214.131:34441)
I20260808 14:45:26.652268 8296 ts_manager.cc:194] Re-registered known tserver with Master: afc1660c6a3f4cd695128351c5507cbb (127.30.214.131:34441)
I20260808 14:45:26.652580 10102 heartbeater.cc:347] Connected to a master server at 127.30.214.188:33797
I20260808 14:45:26.652631 10102 heartbeater.cc:464] Registering TS with master...
I20260808 14:45:26.652648 8296 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.30.214.131@KRBTEST.COM'} at 127.30.214.131:50897
I20260808 14:45:26.652695 10102 heartbeater.cc:511] Master 127.30.214.188:33797 requested a full tablet report, sending...
I20260808 14:45:26.652998 9439 ts_manager.cc:194] Registered new tserver with Master: afc1660c6a3f4cd695128351c5507cbb (127.30.214.131:34441)
I20260808 14:45:26.657194 10122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:26.645489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46016 (local address 127.30.214.190:41515)
0808 14:45:26.645614 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:26.645616 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:26.646350 (+ 734us) server_negotiation.cc:407] Connection header received
0808 14:45:26.647199 (+ 849us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:26.647200 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:26.647214 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:26.647255 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:26.648071 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.648771 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.650027 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.650322 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.650362 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:26.654164 (+ 3802us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:26.654166 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:26.654166 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:26.654175 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:26.655731 (+ 1556us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:26.656315 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:26.656316 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:26.656316 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:26.656387 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:26.656566 (+ 179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:26.656567 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:26.656567 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:26.656678 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:26.656763 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:26.656898 (+ 135us) server_negotiation.cc:299] Negotiation successful
0808 14:45:26.657094 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102,"thread_start_us":71,"threads_started":1}
I20260808 14:45:26.658167 10121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:26.645334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33298 (local address 127.30.214.188:33797)
0808 14:45:26.646267 (+ 933us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:26.646269 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:26.646600 (+ 331us) server_negotiation.cc:407] Connection header received
0808 14:45:26.646690 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:26.646691 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:26.646704 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:26.646742 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:26.648537 (+ 1795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.652532 (+ 3995us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.653609 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.653915 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.653973 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:26.655233 (+ 1260us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:26.655234 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:26.655235 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:26.655242 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:26.656836 (+ 1594us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:26.657207 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:26.657209 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:26.657209 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:26.657275 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:26.657532 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:26.657533 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:26.657533 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:26.657677 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:26.657753 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:26.657988 (+ 235us) server_negotiation.cc:299] Negotiation successful
0808 14:45:26.658073 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":910,"thread_start_us":53,"threads_started":1}
I20260808 14:45:26.659601 10119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:26.645226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59074 (local address 127.30.214.189:41969)
0808 14:45:26.646321 (+ 1095us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:26.646323 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:26.646330 (+ 7us) server_negotiation.cc:407] Connection header received
0808 14:45:26.646354 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:26.646355 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:26.646368 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:26.646454 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:26.647342 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.653789 (+ 6447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.654849 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.655165 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.655254 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:26.656404 (+ 1150us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:26.656405 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:26.656406 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:26.656413 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:26.658579 (+ 2166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:26.658874 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:26.658875 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:26.658875 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:26.658934 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:26.659102 (+ 168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:26.659103 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:26.659103 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:26.659213 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:26.659297 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:26.659416 (+ 119us) server_negotiation.cc:299] Negotiation successful
0808 14:45:26.659498 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1076,"thread_start_us":51,"threads_started":1}
I20260808 14:45:26.658746 8296 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46016:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:45:26.660650 8296 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:45:26.661643 9389 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03221342f77f4ccb9c0a4d58bae5a5ad [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41515 } } peers { permanent_uuid: "2956799a475441f0b2676c39eb812451" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 41969 } attrs { promote: false } } peers { permanent_uuid: "3835d4d282c54ce8b02f7780f2d12695" member_type: NON_VOTER last_known_addr { host: "127.30.214.188" port: 33797 } attrs { promote: true } } }
I20260808 14:45:26.661814 9389 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03221342f77f4ccb9c0a4d58bae5a5ad [sys.catalog]: This master's current role is: LEADER
I20260808 14:45:26.662747 10128 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 03221342f77f4ccb9c0a4d58bae5a5ad: attempting to promote NON_VOTER 3835d4d282c54ce8b02f7780f2d12695 to VOTER
I20260808 14:45:26.662942 10128 consensus_queue.cc:237] T 00000000000000000000000000000000 P 03221342f77f4ccb9c0a4d58bae5a5ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41515 } } peers { permanent_uuid: "2956799a475441f0b2676c39eb812451" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 41969 } attrs { promote: false } } peers { permanent_uuid: "3835d4d282c54ce8b02f7780f2d12695" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 33797 } attrs { promote: false } }
I20260808 14:45:26.663398 9184 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451 [term 1 FOLLOWER]: Refusing update from remote peer 03221342f77f4ccb9c0a4d58bae5a5ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260808 14:45:26.663426 9458 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695 [term 1 LEARNER]: Refusing update from remote peer 03221342f77f4ccb9c0a4d58bae5a5ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260808 14:45:26.663693 10127 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 03221342f77f4ccb9c0a4d58bae5a5ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "2956799a475441f0b2676c39eb812451" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 41969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260808 14:45:26.663852 9389 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 03221342f77f4ccb9c0a4d58bae5a5ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "3835d4d282c54ce8b02f7780f2d12695" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 33797 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260808 14:45:26.664742 10127 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 03221342f77f4ccb9c0a4d58bae5a5ad [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 3835d4d282c54ce8b02f7780f2d12695 (127.30.214.188) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41515 } } peers { permanent_uuid: "2956799a475441f0b2676c39eb812451" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 41969 } attrs { promote: false } } peers { permanent_uuid: "3835d4d282c54ce8b02f7780f2d12695" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 33797 } attrs { promote: false } } }
I20260808 14:45:26.664947 9184 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 3835d4d282c54ce8b02f7780f2d12695 (127.30.214.188) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41515 } } peers { permanent_uuid: "2956799a475441f0b2676c39eb812451" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 41969 } attrs { promote: false } } peers { permanent_uuid: "3835d4d282c54ce8b02f7780f2d12695" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 33797 } attrs { promote: false } } }
I20260808 14:45:26.664973 9458 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 3835d4d282c54ce8b02f7780f2d12695 (127.30.214.188) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41515 } } peers { permanent_uuid: "2956799a475441f0b2676c39eb812451" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 41969 } attrs { promote: false } } peers { permanent_uuid: "3835d4d282c54ce8b02f7780f2d12695" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 33797 } attrs { promote: false } } }
I20260808 14:45:26.665866 10127 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03221342f77f4ccb9c0a4d58bae5a5ad [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41515 } } peers { permanent_uuid: "2956799a475441f0b2676c39eb812451" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 41969 } attrs { promote: false } } peers { permanent_uuid: "3835d4d282c54ce8b02f7780f2d12695" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 33797 } attrs { promote: false } } }
I20260808 14:45:26.665957 10127 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03221342f77f4ccb9c0a4d58bae5a5ad [sys.catalog]: This master's current role is: LEADER
I20260808 14:45:26.666023 10127 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03221342f77f4ccb9c0a4d58bae5a5ad [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41515 } } peers { permanent_uuid: "2956799a475441f0b2676c39eb812451" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 41969 } attrs { promote: false } } peers { permanent_uuid: "3835d4d282c54ce8b02f7780f2d12695" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 33797 } attrs { promote: false } } }
I20260808 14:45:26.666082 10127 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03221342f77f4ccb9c0a4d58bae5a5ad [sys.catalog]: This master's current role is: LEADER
I20260808 14:45:26.666101 9389 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03221342f77f4ccb9c0a4d58bae5a5ad [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41515 } } peers { permanent_uuid: "2956799a475441f0b2676c39eb812451" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 41969 } attrs { promote: false } } peers { permanent_uuid: "3835d4d282c54ce8b02f7780f2d12695" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 33797 } attrs { promote: false } } }
I20260808 14:45:26.666200 9389 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03221342f77f4ccb9c0a4d58bae5a5ad [sys.catalog]: This master's current role is: LEADER
I20260808 14:45:26.666246 10141 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41515 } } peers { permanent_uuid: "2956799a475441f0b2676c39eb812451" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 41969 } attrs { promote: false } } peers { permanent_uuid: "3835d4d282c54ce8b02f7780f2d12695" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 33797 } attrs { promote: false } } }
I20260808 14:45:26.666334 10141 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:45:26.666325 9501 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41515 } } peers { permanent_uuid: "2956799a475441f0b2676c39eb812451" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 41969 } attrs { promote: false } } peers { permanent_uuid: "3835d4d282c54ce8b02f7780f2d12695" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 33797 } attrs { promote: false } } }
I20260808 14:45:26.666426 9501 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:45:26.672714 9109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:26.668574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.131:34441 (local address 127.0.0.1:53268)
0808 14:45:26.668626 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:26.668638 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:26.668678 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:26.669465 (+ 787us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:26.669466 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:26.669467 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:45:26.669494 (+ 27us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:26.669495 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.670739 (+ 1244us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.670740 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:26.671579 (+ 839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:26.671582 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.672484 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.672484 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:26.672544 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:26.672548 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:45:26.672591 (+ 43us) client_negotiation.cc:240] Negotiation successful
0808 14:45:26.672633 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260808 14:45:26.672829 10145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:26.668777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53268 (local address 127.30.214.131:34441)
0808 14:45:26.669296 (+ 519us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:26.669300 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:26.669309 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:45:26.669347 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:26.669349 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:26.669365 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:26.669489 (+ 124us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:45:26.669557 (+ 68us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.670653 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.671668 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.672423 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.672491 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:26.672553 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:26.672614 (+ 61us) server_negotiation.cc:299] Negotiation successful
0808 14:45:26.672657 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":441,"thread_start_us":88,"threads_started":1}
I20260808 14:45:26.673849 10001 tablet_service.cc:1467] Processing CreateTablet for tablet 8ddc81044790461dab8a65d8493ec6bb (DEFAULT_TABLE table=test-table [id=4511b78a3adf47518ac39b84c27ab692]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:45:26.674403 10142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:26.668646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.129:33035 (local address 127.0.0.1:56260)
0808 14:45:26.668957 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:26.668978 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:26.669021 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:26.669276 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:26.669277 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:26.669279 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:45:26.669323 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:26.669325 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.671655 (+ 2330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.671656 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:26.672343 (+ 687us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:26.672345 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.674043 (+ 1698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.674044 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:26.674154 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:26.674159 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 14:45:26.674212 (+ 53us) client_negotiation.cc:240] Negotiation successful
0808 14:45:26.674257 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":291,"thread_start_us":105,"threads_started":1}
I20260808 14:45:26.674404 10001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ddc81044790461dab8a65d8493ec6bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:45:26.674583 10147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:26.668785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43966 (local address 127.30.214.130:41721)
0808 14:45:26.670930 (+ 2145us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:26.670935 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:26.670946 (+ 11us) server_negotiation.cc:407] Connection header received
0808 14:45:26.671025 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:26.671027 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:26.671045 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:26.671126 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:45:26.671277 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.672235 (+ 958us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.673688 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.674241 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.674328 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:26.674382 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:26.674458 (+ 76us) server_negotiation.cc:299] Negotiation successful
0808 14:45:26.674497 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2064,"thread_start_us":85,"threads_started":1}
I20260808 14:45:26.674976 10148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:26.668882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56260 (local address 127.30.214.129:33035)
0808 14:45:26.669035 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:26.669041 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:26.669061 (+ 20us) server_negotiation.cc:407] Connection header received
0808 14:45:26.669102 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:26.669105 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:26.669121 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:26.669206 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:45:26.669399 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.670671 (+ 1272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.672439 (+ 1768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.673529 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.673930 (+ 401us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:26.673996 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:26.674797 (+ 801us) server_negotiation.cc:299] Negotiation successful
0808 14:45:26.674846 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":86,"threads_started":1}
I20260808 14:45:26.674566 10143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:26.668684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.130:41721 (local address 127.0.0.1:43966)
0808 14:45:26.669089 (+ 405us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:26.669096 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:26.669127 (+ 31us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:26.671122 (+ 1995us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:26.671123 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:26.671126 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:45:26.671201 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:26.671203 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.672330 (+ 1127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.672331 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:26.673605 (+ 1274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:26.673608 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.674320 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.674321 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:26.674384 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:26.674389 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 14:45:26.674442 (+ 53us) client_negotiation.cc:240] Negotiation successful
0808 14:45:26.674482 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":391,"thread_start_us":181,"threads_started":1}
I20260808 14:45:26.675858 9806 tablet_service.cc:1467] Processing CreateTablet for tablet 8ddc81044790461dab8a65d8493ec6bb (DEFAULT_TABLE table=test-table [id=4511b78a3adf47518ac39b84c27ab692]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:45:26.676225 9806 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ddc81044790461dab8a65d8493ec6bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:45:26.678102 9608 tablet_service.cc:1467] Processing CreateTablet for tablet 8ddc81044790461dab8a65d8493ec6bb (DEFAULT_TABLE table=test-table [id=4511b78a3adf47518ac39b84c27ab692]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:45:26.678622 9608 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ddc81044790461dab8a65d8493ec6bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:45:26.679586 10150 tablet_bootstrap.cc:492] T 8ddc81044790461dab8a65d8493ec6bb P afc1660c6a3f4cd695128351c5507cbb: Bootstrap starting.
I20260808 14:45:26.680982 10150 tablet_bootstrap.cc:654] T 8ddc81044790461dab8a65d8493ec6bb P afc1660c6a3f4cd695128351c5507cbb: Neither blocks nor log segments found. Creating new log.
I20260808 14:45:26.681620 10153 tablet_bootstrap.cc:492] T 8ddc81044790461dab8a65d8493ec6bb P 005d6a0684f14786a93ab24b32ae0e59: Bootstrap starting.
I20260808 14:45:26.682215 10150 log.cc:824] T 8ddc81044790461dab8a65d8493ec6bb P afc1660c6a3f4cd695128351c5507cbb: Log is configured to *not* fsync() on all Append() calls
I20260808 14:45:26.682839 10153 tablet_bootstrap.cc:654] T 8ddc81044790461dab8a65d8493ec6bb P 005d6a0684f14786a93ab24b32ae0e59: Neither blocks nor log segments found. Creating new log.
I20260808 14:45:26.683288 10150 tablet_bootstrap.cc:492] T 8ddc81044790461dab8a65d8493ec6bb P afc1660c6a3f4cd695128351c5507cbb: No bootstrap required, opened a new log
I20260808 14:45:26.683377 10150 ts_tablet_manager.cc:1397] T 8ddc81044790461dab8a65d8493ec6bb P afc1660c6a3f4cd695128351c5507cbb: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20260808 14:45:26.683741 10153 log.cc:824] T 8ddc81044790461dab8a65d8493ec6bb P 005d6a0684f14786a93ab24b32ae0e59: Log is configured to *not* fsync() on all Append() calls
I20260808 14:45:26.684648 10157 tablet_bootstrap.cc:492] T 8ddc81044790461dab8a65d8493ec6bb P 21687c84bf824598aa839f0615f15623: Bootstrap starting.
I20260808 14:45:26.684926 10153 tablet_bootstrap.cc:492] T 8ddc81044790461dab8a65d8493ec6bb P 005d6a0684f14786a93ab24b32ae0e59: No bootstrap required, opened a new log
I20260808 14:45:26.684998 10153 ts_tablet_manager.cc:1397] T 8ddc81044790461dab8a65d8493ec6bb P 005d6a0684f14786a93ab24b32ae0e59: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 14:45:26.686231 10157 tablet_bootstrap.cc:654] T 8ddc81044790461dab8a65d8493ec6bb P 21687c84bf824598aa839f0615f15623: Neither blocks nor log segments found. Creating new log.
I20260808 14:45:26.687263 10157 log.cc:824] T 8ddc81044790461dab8a65d8493ec6bb P 21687c84bf824598aa839f0615f15623: Log is configured to *not* fsync() on all Append() calls
I20260808 14:45:26.688833 10153 raft_consensus.cc:348] T 8ddc81044790461dab8a65d8493ec6bb P 005d6a0684f14786a93ab24b32ae0e59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afc1660c6a3f4cd695128351c5507cbb" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 34441 } } peers { permanent_uuid: "005d6a0684f14786a93ab24b32ae0e59" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 41721 } } peers { permanent_uuid: "21687c84bf824598aa839f0615f15623" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 33035 } }
I20260808 14:45:26.689010 10153 raft_consensus.cc:374] T 8ddc81044790461dab8a65d8493ec6bb P 005d6a0684f14786a93ab24b32ae0e59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:45:26.689049 10153 raft_consensus.cc:729] T 8ddc81044790461dab8a65d8493ec6bb P 005d6a0684f14786a93ab24b32ae0e59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005d6a0684f14786a93ab24b32ae0e59, State: Initialized, Role: FOLLOWER
I20260808 14:45:26.688917 10150 raft_consensus.cc:348] T 8ddc81044790461dab8a65d8493ec6bb P afc1660c6a3f4cd695128351c5507cbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afc1660c6a3f4cd695128351c5507cbb" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 34441 } } peers { permanent_uuid: "005d6a0684f14786a93ab24b32ae0e59" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 41721 } } peers { permanent_uuid: "21687c84bf824598aa839f0615f15623" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 33035 } }
I20260808 14:45:26.689067 10157 tablet_bootstrap.cc:492] T 8ddc81044790461dab8a65d8493ec6bb P 21687c84bf824598aa839f0615f15623: No bootstrap required, opened a new log
I20260808 14:45:26.689092 10150 raft_consensus.cc:374] T 8ddc81044790461dab8a65d8493ec6bb P afc1660c6a3f4cd695128351c5507cbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:45:26.689126 10150 raft_consensus.cc:729] T 8ddc81044790461dab8a65d8493ec6bb P afc1660c6a3f4cd695128351c5507cbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afc1660c6a3f4cd695128351c5507cbb, State: Initialized, Role: FOLLOWER
I20260808 14:45:26.689133 10157 ts_tablet_manager.cc:1397] T 8ddc81044790461dab8a65d8493ec6bb P 21687c84bf824598aa839f0615f15623: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20260808 14:45:26.689177 10153 consensus_queue.cc:260] T 8ddc81044790461dab8a65d8493ec6bb P 005d6a0684f14786a93ab24b32ae0e59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afc1660c6a3f4cd695128351c5507cbb" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 34441 } } peers { permanent_uuid: "005d6a0684f14786a93ab24b32ae0e59" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 41721 } } peers { permanent_uuid: "21687c84bf824598aa839f0615f15623" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 33035 } }
I20260808 14:45:26.689270 10150 consensus_queue.cc:260] T 8ddc81044790461dab8a65d8493ec6bb P afc1660c6a3f4cd695128351c5507cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afc1660c6a3f4cd695128351c5507cbb" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 34441 } } peers { permanent_uuid: "005d6a0684f14786a93ab24b32ae0e59" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 41721 } } peers { permanent_uuid: "21687c84bf824598aa839f0615f15623" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 33035 } }
I20260808 14:45:26.689639 10153 ts_tablet_manager.cc:1428] T 8ddc81044790461dab8a65d8493ec6bb P 005d6a0684f14786a93ab24b32ae0e59: Time spent starting tablet: real 0.005s user 0.000s sys 0.005s
I20260808 14:45:26.689671 10150 ts_tablet_manager.cc:1428] T 8ddc81044790461dab8a65d8493ec6bb P afc1660c6a3f4cd695128351c5507cbb: Time spent starting tablet: real 0.006s user 0.005s sys 0.001s
I20260808 14:45:26.689781 9906 heartbeater.cc:503] Master 127.30.214.190:41515 was elected leader, sending a full tablet report...
I20260808 14:45:26.689800 10103 heartbeater.cc:503] Master 127.30.214.190:41515 was elected leader, sending a full tablet report...
I20260808 14:45:26.693421 10157 raft_consensus.cc:348] T 8ddc81044790461dab8a65d8493ec6bb P 21687c84bf824598aa839f0615f15623 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afc1660c6a3f4cd695128351c5507cbb" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 34441 } } peers { permanent_uuid: "005d6a0684f14786a93ab24b32ae0e59" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 41721 } } peers { permanent_uuid: "21687c84bf824598aa839f0615f15623" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 33035 } }
I20260808 14:45:26.693668 10157 raft_consensus.cc:374] T 8ddc81044790461dab8a65d8493ec6bb P 21687c84bf824598aa839f0615f15623 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:45:26.693708 10157 raft_consensus.cc:729] T 8ddc81044790461dab8a65d8493ec6bb P 21687c84bf824598aa839f0615f15623 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21687c84bf824598aa839f0615f15623, State: Initialized, Role: FOLLOWER
I20260808 14:45:26.693835 10157 consensus_queue.cc:260] T 8ddc81044790461dab8a65d8493ec6bb P 21687c84bf824598aa839f0615f15623 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afc1660c6a3f4cd695128351c5507cbb" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 34441 } } peers { permanent_uuid: "005d6a0684f14786a93ab24b32ae0e59" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 41721 } } peers { permanent_uuid: "21687c84bf824598aa839f0615f15623" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 33035 } }
I20260808 14:45:26.694237 10157 ts_tablet_manager.cc:1428] T 8ddc81044790461dab8a65d8493ec6bb P 21687c84bf824598aa839f0615f15623: Time spent starting tablet: real 0.005s user 0.000s sys 0.004s
I20260808 14:45:26.694470 9706 heartbeater.cc:503] Master 127.30.214.190:41515 was elected leader, sending a full tablet report...
W20260808 14:45:26.743472 9909 tablet.cc:2369] T 8ddc81044790461dab8a65d8493ec6bb P 005d6a0684f14786a93ab24b32ae0e59: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:45:26.835520 9708 tablet.cc:2369] T 8ddc81044790461dab8a65d8493ec6bb P 21687c84bf824598aa839f0615f15623: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:45:26.889187 10108 tablet.cc:2369] T 8ddc81044790461dab8a65d8493ec6bb P afc1660c6a3f4cd695128351c5507cbb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:45:26.912333 10161 raft_consensus.cc:482] T 8ddc81044790461dab8a65d8493ec6bb P afc1660c6a3f4cd695128351c5507cbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:45:26.912482 10161 raft_consensus.cc:504] T 8ddc81044790461dab8a65d8493ec6bb P afc1660c6a3f4cd695128351c5507cbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afc1660c6a3f4cd695128351c5507cbb" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 34441 } } peers { permanent_uuid: "005d6a0684f14786a93ab24b32ae0e59" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 41721 } } peers { permanent_uuid: "21687c84bf824598aa839f0615f15623" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 33035 } }
I20260808 14:45:26.912860 10161 leader_election.cc:288] T 8ddc81044790461dab8a65d8493ec6bb P afc1660c6a3f4cd695128351c5507cbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005d6a0684f14786a93ab24b32ae0e59 (127.30.214.130:41721), 21687c84bf824598aa839f0615f15623 (127.30.214.129:33035)
I20260808 14:45:26.916762 10147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:26.913144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:51165 (local address 127.30.214.130:41721)
0808 14:45:26.913192 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:26.913194 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:26.913207 (+ 13us) server_negotiation.cc:407] Connection header received
0808 14:45:26.913264 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:26.913265 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:26.913275 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:26.913335 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:45:26.913588 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.914339 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.915821 (+ 1482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.916381 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.916460 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:26.916470 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:26.916660 (+ 190us) server_negotiation.cc:299] Negotiation successful
0808 14:45:26.916693 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 14:45:26.916770 10111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:26.913087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.130:41721 (local address 127.30.214.131:51165)
0808 14:45:26.913146 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:26.913157 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:26.913204 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:26.913351 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:26.913352 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:26.913354 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:45:26.913520 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:26.913521 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.914414 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.914415 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:26.915719 (+ 1304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:26.915722 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.916467 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.916468 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:26.916582 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:26.916587 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 14:45:26.916643 (+ 56us) client_negotiation.cc:240] Negotiation successful
0808 14:45:26.916689 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39,"mutex_wait_us":59}
I20260808 14:45:26.916854 10148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:26.913144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:56199 (local address 127.30.214.129:33035)
0808 14:45:26.913205 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:26.913207 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:26.913214 (+ 7us) server_negotiation.cc:407] Connection header received
0808 14:45:26.913275 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:26.913276 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:26.913284 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:26.913335 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:45:26.913594 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.914340 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.915819 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.916381 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.916460 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:26.916470 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:26.916757 (+ 287us) server_negotiation.cc:299] Negotiation successful
0808 14:45:26.916798 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 14:45:26.917150 10109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:26.913129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.129:33035 (local address 127.30.214.131:56199)
0808 14:45:26.913170 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:26.913177 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:26.913204 (+ 27us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:26.913351 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:26.913352 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:26.913354 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:45:26.913513 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:26.913516 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.914414 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.914414 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:26.915719 (+ 1305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:26.915722 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.916467 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.916468 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:26.916683 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:26.916687 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:45:26.916737 (+ 50us) client_negotiation.cc:240] Negotiation successful
0808 14:45:26.916770 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31,"mutex_wait_us":74}
I20260808 14:45:26.917207 9833 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ddc81044790461dab8a65d8493ec6bb" candidate_uuid: "afc1660c6a3f4cd695128351c5507cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005d6a0684f14786a93ab24b32ae0e59" is_pre_election: true
I20260808 14:45:26.917392 9833 raft_consensus.cc:2454] T 8ddc81044790461dab8a65d8493ec6bb P 005d6a0684f14786a93ab24b32ae0e59 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afc1660c6a3f4cd695128351c5507cbb in term 0.
I20260808 14:45:26.917568 9632 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ddc81044790461dab8a65d8493ec6bb" candidate_uuid: "afc1660c6a3f4cd695128351c5507cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21687c84bf824598aa839f0615f15623" is_pre_election: true
I20260808 14:45:26.917726 9632 raft_consensus.cc:2454] T 8ddc81044790461dab8a65d8493ec6bb P 21687c84bf824598aa839f0615f15623 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afc1660c6a3f4cd695128351c5507cbb in term 0.
I20260808 14:45:26.917739 9940 leader_election.cc:302] T 8ddc81044790461dab8a65d8493ec6bb P afc1660c6a3f4cd695128351c5507cbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005d6a0684f14786a93ab24b32ae0e59, afc1660c6a3f4cd695128351c5507cbb; no voters:
I20260808 14:45:26.917974 10161 raft_consensus.cc:2781] T 8ddc81044790461dab8a65d8493ec6bb P afc1660c6a3f4cd695128351c5507cbb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:45:26.918032 10161 raft_consensus.cc:482] T 8ddc81044790461dab8a65d8493ec6bb P afc1660c6a3f4cd695128351c5507cbb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:45:26.918047 10161 raft_consensus.cc:3037] T 8ddc81044790461dab8a65d8493ec6bb P afc1660c6a3f4cd695128351c5507cbb [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:26.919027 10161 raft_consensus.cc:504] T 8ddc81044790461dab8a65d8493ec6bb P afc1660c6a3f4cd695128351c5507cbb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afc1660c6a3f4cd695128351c5507cbb" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 34441 } } peers { permanent_uuid: "005d6a0684f14786a93ab24b32ae0e59" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 41721 } } peers { permanent_uuid: "21687c84bf824598aa839f0615f15623" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 33035 } }
I20260808 14:45:26.919160 10161 leader_election.cc:288] T 8ddc81044790461dab8a65d8493ec6bb P afc1660c6a3f4cd695128351c5507cbb [CANDIDATE]: Term 1 election: Requested vote from peers 005d6a0684f14786a93ab24b32ae0e59 (127.30.214.130:41721), 21687c84bf824598aa839f0615f15623 (127.30.214.129:33035)
I20260808 14:45:26.919363 9632 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ddc81044790461dab8a65d8493ec6bb" candidate_uuid: "afc1660c6a3f4cd695128351c5507cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21687c84bf824598aa839f0615f15623"
I20260808 14:45:26.919379 9833 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ddc81044790461dab8a65d8493ec6bb" candidate_uuid: "afc1660c6a3f4cd695128351c5507cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005d6a0684f14786a93ab24b32ae0e59"
I20260808 14:45:26.919448 9632 raft_consensus.cc:3037] T 8ddc81044790461dab8a65d8493ec6bb P 21687c84bf824598aa839f0615f15623 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:26.919497 9833 raft_consensus.cc:3037] T 8ddc81044790461dab8a65d8493ec6bb P 005d6a0684f14786a93ab24b32ae0e59 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:26.920327 9632 raft_consensus.cc:2454] T 8ddc81044790461dab8a65d8493ec6bb P 21687c84bf824598aa839f0615f15623 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afc1660c6a3f4cd695128351c5507cbb in term 1.
I20260808 14:45:26.920331 9833 raft_consensus.cc:2454] T 8ddc81044790461dab8a65d8493ec6bb P 005d6a0684f14786a93ab24b32ae0e59 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afc1660c6a3f4cd695128351c5507cbb in term 1.
I20260808 14:45:26.920513 9940 leader_election.cc:302] T 8ddc81044790461dab8a65d8493ec6bb P afc1660c6a3f4cd695128351c5507cbb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005d6a0684f14786a93ab24b32ae0e59, afc1660c6a3f4cd695128351c5507cbb; no voters:
I20260808 14:45:26.920619 10161 raft_consensus.cc:2781] T 8ddc81044790461dab8a65d8493ec6bb P afc1660c6a3f4cd695128351c5507cbb [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:45:26.920775 10161 raft_consensus.cc:686] T 8ddc81044790461dab8a65d8493ec6bb P afc1660c6a3f4cd695128351c5507cbb [term 1 LEADER]: Becoming Leader. State: Replica: afc1660c6a3f4cd695128351c5507cbb, State: Running, Role: LEADER
I20260808 14:45:26.920862 10161 consensus_queue.cc:237] T 8ddc81044790461dab8a65d8493ec6bb P afc1660c6a3f4cd695128351c5507cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afc1660c6a3f4cd695128351c5507cbb" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 34441 } } peers { permanent_uuid: "005d6a0684f14786a93ab24b32ae0e59" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 41721 } } peers { permanent_uuid: "21687c84bf824598aa839f0615f15623" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 33035 } }
I20260808 14:45:26.921833 8295 catalog_manager.cc:5495] T 8ddc81044790461dab8a65d8493ec6bb P afc1660c6a3f4cd695128351c5507cbb reported cstate change: term changed from 0 to 1, leader changed from <none> to afc1660c6a3f4cd695128351c5507cbb (127.30.214.131). New cstate: current_term: 1 leader_uuid: "afc1660c6a3f4cd695128351c5507cbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afc1660c6a3f4cd695128351c5507cbb" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 34441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "005d6a0684f14786a93ab24b32ae0e59" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 41721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21687c84bf824598aa839f0615f15623" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 33035 } health_report { overall_health: UNKNOWN } } }
I20260808 14:45:26.955142 10145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:26.952546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53270 (local address 127.30.214.131:34441)
0808 14:45:26.952607 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:26.952609 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:26.952616 (+ 7us) server_negotiation.cc:407] Connection header received
0808 14:45:26.952655 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:26.952656 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:26.952676 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:26.952738 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:45:26.953032 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.953657 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.954391 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.954597 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.954653 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:26.954811 (+ 158us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:45:26.954922 (+ 111us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:45:26.954998 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:26.955036 (+ 38us) server_negotiation.cc:299] Negotiation successful
0808 14:45:26.955060 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 14:45:26.957129 9632 raft_consensus.cc:1261] T 8ddc81044790461dab8a65d8493ec6bb P 21687c84bf824598aa839f0615f15623 [term 1 FOLLOWER]: Refusing update from remote peer afc1660c6a3f4cd695128351c5507cbb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:45:26.957146 9833 raft_consensus.cc:1261] T 8ddc81044790461dab8a65d8493ec6bb P 005d6a0684f14786a93ab24b32ae0e59 [term 1 FOLLOWER]: Refusing update from remote peer afc1660c6a3f4cd695128351c5507cbb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:45:26.957499 10163 consensus_queue.cc:1035] T 8ddc81044790461dab8a65d8493ec6bb P afc1660c6a3f4cd695128351c5507cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "21687c84bf824598aa839f0615f15623" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 33035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:45:26.957638 10161 consensus_queue.cc:1035] T 8ddc81044790461dab8a65d8493ec6bb P afc1660c6a3f4cd695128351c5507cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "005d6a0684f14786a93ab24b32ae0e59" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 41721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:45:26.963950 8296 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46016:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:45:26.964066 8296 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46016:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:45:26.965837 8296 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 03221342f77f4ccb9c0a4d58bae5a5ad: Sending DeleteTablet for 3 replicas of tablet 8ddc81044790461dab8a65d8493ec6bb
I20260808 14:45:26.966272 9608 tablet_service.cc:1514] Processing DeleteTablet for tablet 8ddc81044790461dab8a65d8493ec6bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:45:26 UTC) from {username='oryx', principal='oryx/127.30.214.190@KRBTEST.COM'} at 127.0.0.1:56260
I20260808 14:45:26.966447 10001 tablet_service.cc:1514] Processing DeleteTablet for tablet 8ddc81044790461dab8a65d8493ec6bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:45:26 UTC) from {username='oryx', principal='oryx/127.30.214.190@KRBTEST.COM'} at 127.0.0.1:53268
I20260808 14:45:26.966842 10191 tablet_replica.cc:330] T 8ddc81044790461dab8a65d8493ec6bb P afc1660c6a3f4cd695128351c5507cbb: stopping tablet replica
I20260808 14:45:26.966859 9806 tablet_service.cc:1514] Processing DeleteTablet for tablet 8ddc81044790461dab8a65d8493ec6bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:45:26 UTC) from {username='oryx', principal='oryx/127.30.214.190@KRBTEST.COM'} at 127.0.0.1:43966
I20260808 14:45:26.966959 10191 raft_consensus.cc:2229] T 8ddc81044790461dab8a65d8493ec6bb P afc1660c6a3f4cd695128351c5507cbb [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:45:26.967113 10191 raft_consensus.cc:2258] T 8ddc81044790461dab8a65d8493ec6bb P afc1660c6a3f4cd695128351c5507cbb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:45:26.967845 10191 ts_tablet_manager.cc:1905] T 8ddc81044790461dab8a65d8493ec6bb P afc1660c6a3f4cd695128351c5507cbb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:45:26.968132 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 8246
I20260808 14:45:26.974347 10121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:26.967360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33306 (local address 127.30.214.188:33797)
0808 14:45:26.967408 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:26.967410 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:26.967420 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:45:26.967442 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:26.967443 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:26.967456 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:26.967502 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:26.968613 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.969239 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.970173 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.970421 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.970456 (+ 35us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:26.971986 (+ 1530us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:26.971987 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:26.971987 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:26.971995 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:26.973286 (+ 1291us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:26.973649 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:26.973650 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:26.973650 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:26.973701 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:26.973846 (+ 145us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:26.973846 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:26.973847 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:26.973967 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:26.974027 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:26.974185 (+ 158us) server_negotiation.cc:299] Negotiation successful
0808 14:45:26.974265 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 14:45:26.980609 10191 ts_tablet_manager.cc:1918] T 8ddc81044790461dab8a65d8493ec6bb P afc1660c6a3f4cd695128351c5507cbb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:45:26.980727 10191 log.cc:1196] T 8ddc81044790461dab8a65d8493ec6bb P afc1660c6a3f4cd695128351c5507cbb: Deleting WAL directory at /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-2/wal/wals/8ddc81044790461dab8a65d8493ec6bb
I20260808 14:45:26.981058 10191 ts_tablet_manager.cc:1939] T 8ddc81044790461dab8a65d8493ec6bb P afc1660c6a3f4cd695128351c5507cbb: Deleting consensus metadata
I20260808 14:45:26.981631 10192 tablet_replica.cc:330] T 8ddc81044790461dab8a65d8493ec6bb P 005d6a0684f14786a93ab24b32ae0e59: stopping tablet replica
I20260808 14:45:26.981782 10192 raft_consensus.cc:2229] T 8ddc81044790461dab8a65d8493ec6bb P 005d6a0684f14786a93ab24b32ae0e59 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:45:26.981948 10192 raft_consensus.cc:2258] T 8ddc81044790461dab8a65d8493ec6bb P 005d6a0684f14786a93ab24b32ae0e59 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:45:26.983610 10188 tablet_replica.cc:330] T 8ddc81044790461dab8a65d8493ec6bb P 21687c84bf824598aa839f0615f15623: stopping tablet replica
I20260808 14:45:26.983757 10188 raft_consensus.cc:2229] T 8ddc81044790461dab8a65d8493ec6bb P 21687c84bf824598aa839f0615f15623 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:45:26.983888 10188 raft_consensus.cc:2258] T 8ddc81044790461dab8a65d8493ec6bb P 21687c84bf824598aa839f0615f15623 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:45:26.984853 10188 ts_tablet_manager.cc:1905] T 8ddc81044790461dab8a65d8493ec6bb P 21687c84bf824598aa839f0615f15623: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:45:26.986661 10188 ts_tablet_manager.cc:1918] T 8ddc81044790461dab8a65d8493ec6bb P 21687c84bf824598aa839f0615f15623: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:45:26.986744 10188 log.cc:1196] T 8ddc81044790461dab8a65d8493ec6bb P 21687c84bf824598aa839f0615f15623: Deleting WAL directory at /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-0/wal/wals/8ddc81044790461dab8a65d8493ec6bb
I20260808 14:45:26.987032 10188 ts_tablet_manager.cc:1939] T 8ddc81044790461dab8a65d8493ec6bb P 21687c84bf824598aa839f0615f15623: Deleting consensus metadata
I20260808 14:45:26.990077 10192 ts_tablet_manager.cc:1905] T 8ddc81044790461dab8a65d8493ec6bb P 005d6a0684f14786a93ab24b32ae0e59: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:45:26.991565 10192 ts_tablet_manager.cc:1918] T 8ddc81044790461dab8a65d8493ec6bb P 005d6a0684f14786a93ab24b32ae0e59: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:45:26.991643 10192 log.cc:1196] T 8ddc81044790461dab8a65d8493ec6bb P 005d6a0684f14786a93ab24b32ae0e59: Deleting WAL directory at /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-1/wal/wals/8ddc81044790461dab8a65d8493ec6bb
I20260808 14:45:26.991878 10192 ts_tablet_manager.cc:1939] T 8ddc81044790461dab8a65d8493ec6bb P 005d6a0684f14786a93ab24b32ae0e59: Deleting consensus metadata
W20260808 14:45:26.992357 9544 connection.cc:535] server connection from 127.0.0.1:56260 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260808 14:45:26.992517 9938 connection.cc:535] server connection from 127.0.0.1:53268 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 14:45:27.000890 10119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:26.994339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59082 (local address 127.30.214.189:41969)
0808 14:45:26.994386 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:26.994388 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:26.994551 (+ 163us) server_negotiation.cc:407] Connection header received
0808 14:45:26.994684 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:26.994685 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:26.994698 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:26.994744 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:26.995271 (+ 527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.995840 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.996529 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.996734 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.996790 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:26.998239 (+ 1449us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:26.998241 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:26.998242 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:26.998249 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:26.999640 (+ 1391us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:27.000035 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:27.000036 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:27.000036 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:27.000094 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:27.000285 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:27.000286 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:27.000286 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:27.000426 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:27.000530 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:27.000705 (+ 175us) server_negotiation.cc:299] Negotiation successful
0808 14:45:27.000797 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 14:45:27.002231 10121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:26.994588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33312 (local address 127.30.214.188:33797)
0808 14:45:26.994632 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:26.994634 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:26.994643 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:45:26.994672 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:26.994673 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:26.994683 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:26.994735 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:26.995846 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.996619 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.997769 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:26.998086 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:26.998162 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:26.999520 (+ 1358us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:26.999521 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:26.999521 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:26.999529 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:27.001119 (+ 1590us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:27.001489 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:27.001490 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:27.001490 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:27.001550 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:27.001758 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:27.001759 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:27.001760 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:27.001876 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:27.001965 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:27.002062 (+ 97us) server_negotiation.cc:299] Negotiation successful
0808 14:45:27.002143 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 14:45:27.962471 10203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:27.962129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:41515 (local address 127.30.214.131:53961)
0808 14:45:27.962274 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:27.962398 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:41515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":71,"threads_started":1}
W20260808 14:45:27.962741 10103 heartbeater.cc:644] Failed to heartbeat to 127.30.214.190:41515 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.30.214.190:41515: connect: Connection refused (error 111)
I20260808 14:45:27.964238 10204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:27.963963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:41515 (local address 127.30.214.130:53383)
0808 14:45:27.964096 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:27.964183 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:41515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":70,"threads_started":1}
W20260808 14:45:27.964412 9906 heartbeater.cc:644] Failed to heartbeat to 127.30.214.190:41515 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.30.214.190:41515: connect: Connection refused (error 111)
I20260808 14:45:27.964828 10205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:27.964631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:41515 (local address 127.30.214.129:53663)
0808 14:45:27.964729 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:27.964794 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:41515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83,"thread_start_us":48,"threads_started":1}
W20260808 14:45:27.965009 9706 heartbeater.cc:644] Failed to heartbeat to 127.30.214.190:41515 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.30.214.190:41515: connect: Connection refused (error 111)
I20260808 14:45:28.466223 10207 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 03221342f77f4ccb9c0a4d58bae5a5ad)
I20260808 14:45:28.466317 10212 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 03221342f77f4ccb9c0a4d58bae5a5ad)
I20260808 14:45:28.466400 10207 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41515 } } peers { permanent_uuid: "2956799a475441f0b2676c39eb812451" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 41969 } attrs { promote: false } } peers { permanent_uuid: "3835d4d282c54ce8b02f7780f2d12695" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 33797 } attrs { promote: false } }
I20260808 14:45:28.466459 10212 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41515 } } peers { permanent_uuid: "2956799a475441f0b2676c39eb812451" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 41969 } attrs { promote: false } } peers { permanent_uuid: "3835d4d282c54ce8b02f7780f2d12695" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 33797 } attrs { promote: false } }
I20260808 14:45:28.466686 10207 leader_election.cc:288] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 03221342f77f4ccb9c0a4d58bae5a5ad (127.30.214.190:41515), 2956799a475441f0b2676c39eb812451 (127.30.214.189:41969)
I20260808 14:45:28.466709 10212 leader_election.cc:288] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 03221342f77f4ccb9c0a4d58bae5a5ad (127.30.214.190:41515), 3835d4d282c54ce8b02f7780f2d12695 (127.30.214.188:33797)
I20260808 14:45:28.467084 10217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:28.466823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:41515 (local address 127.0.0.1:46474)
0808 14:45:28.466973 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:28.467040 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:41515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":57,"threads_started":1}
W20260808 14:45:28.467206 9420 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.30.214.190:41515: connect: Connection refused (error 111)
I20260808 14:45:28.467289 10222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:28.466975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:41515 (local address 127.0.0.1:46478)
0808 14:45:28.467207 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:28.467252 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:41515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":43,"threads_started":1}
W20260808 14:45:28.467432 9146 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.30.214.190:41515: connect: Connection refused (error 111)
I20260808 14:45:28.467643 10217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:28.467559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:41515 (local address 127.0.0.1:46480)
0808 14:45:28.467594 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:28.467617 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:41515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
W20260808 14:45:28.467720 9420 leader_election.cc:334] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 03221342f77f4ccb9c0a4d58bae5a5ad (127.30.214.190:41515): Network error: Client connection negotiation failed: client connection to 127.30.214.190:41515: connect: Connection refused (error 111)
I20260808 14:45:28.467840 10222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:28.467761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:41515 (local address 127.0.0.1:46482)
0808 14:45:28.467793 (+ 32us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:28.467816 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:41515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
W20260808 14:45:28.468091 9146 leader_election.cc:334] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 03221342f77f4ccb9c0a4d58bae5a5ad (127.30.214.190:41515): Network error: Client connection negotiation failed: client connection to 127.30.214.190:41515: connect: Connection refused (error 111)
I20260808 14:45:28.470834 10220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:28.466879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.188:33797 (local address 127.0.0.1:33316)
0808 14:45:28.467053 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:28.467064 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:28.467123 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:28.467600 (+ 477us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:28.467600 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:28.467602 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:45:28.467653 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:28.467655 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:28.468672 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:28.468673 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:28.469855 (+ 1182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:28.469858 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:28.470591 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:28.470592 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:28.470657 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:28.470662 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 14:45:28.470713 (+ 51us) client_negotiation.cc:240] Negotiation successful
0808 14:45:28.470761 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":51,"threads_started":1}
I20260808 14:45:28.470891 10225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:28.467083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33316 (local address 127.30.214.188:33797)
0808 14:45:28.467163 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:28.467164 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:28.467174 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:45:28.467314 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:28.467315 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:28.467423 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:28.467470 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:45:28.467877 (+ 407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:28.468578 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:28.469930 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:28.470484 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:28.470563 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:28.470573 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:28.470735 (+ 162us) server_negotiation.cc:299] Negotiation successful
0808 14:45:28.470799 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63,"thread_start_us":38,"threads_started":1}
I20260808 14:45:28.471007 10215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:28.466861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.189:41969 (local address 127.0.0.1:59094)
0808 14:45:28.467154 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:28.467164 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:28.467221 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:28.467471 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:28.467472 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:28.467475 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:45:28.467585 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:28.467588 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:28.468570 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:28.468571 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:28.469818 (+ 1247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:28.469821 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:28.470584 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:28.470586 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:28.470673 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:28.470676 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:45:28.470729 (+ 53us) client_negotiation.cc:240] Negotiation successful
0808 14:45:28.470772 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":280,"thread_start_us":50,"threads_started":1}
I20260808 14:45:28.471072 10223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:28.467057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59094 (local address 127.30.214.189:41969)
0808 14:45:28.467316 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:28.467318 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:28.467325 (+ 7us) server_negotiation.cc:407] Connection header received
0808 14:45:28.467348 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:28.467350 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:28.467359 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:28.467414 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:45:28.467667 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:28.468448 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:28.469906 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:28.470484 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:28.470563 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:28.470573 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:28.470936 (+ 363us) server_negotiation.cc:299] Negotiation successful
0808 14:45:28.470988 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":242,"thread_start_us":52,"threads_started":1}
I20260808 14:45:28.471143 9458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2956799a475441f0b2676c39eb812451" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "3835d4d282c54ce8b02f7780f2d12695" is_pre_election: true
I20260808 14:45:28.471249 9458 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2956799a475441f0b2676c39eb812451 in term 1.
I20260808 14:45:28.471244 9184 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3835d4d282c54ce8b02f7780f2d12695" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "2956799a475441f0b2676c39eb812451" is_pre_election: true
I20260808 14:45:28.471346 9184 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3835d4d282c54ce8b02f7780f2d12695 in term 1.
I20260808 14:45:28.471402 9142 leader_election.cc:302] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2956799a475441f0b2676c39eb812451, 3835d4d282c54ce8b02f7780f2d12695; no voters: 03221342f77f4ccb9c0a4d58bae5a5ad
I20260808 14:45:28.471493 10212 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260808 14:45:28.471493 9417 leader_election.cc:302] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2956799a475441f0b2676c39eb812451, 3835d4d282c54ce8b02f7780f2d12695; no voters: 03221342f77f4ccb9c0a4d58bae5a5ad
I20260808 14:45:28.471535 10212 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 03221342f77f4ccb9c0a4d58bae5a5ad)
I20260808 14:45:28.471557 10212 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451 [term 1 FOLLOWER]: Advancing to term 2
I20260808 14:45:28.471611 10207 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260808 14:45:28.471652 10207 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 03221342f77f4ccb9c0a4d58bae5a5ad)
I20260808 14:45:28.471668 10207 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695 [term 1 FOLLOWER]: Advancing to term 2
I20260808 14:45:28.472298 10212 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41515 } } peers { permanent_uuid: "2956799a475441f0b2676c39eb812451" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 41969 } attrs { promote: false } } peers { permanent_uuid: "3835d4d282c54ce8b02f7780f2d12695" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 33797 } attrs { promote: false } }
I20260808 14:45:28.472328 10207 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41515 } } peers { permanent_uuid: "2956799a475441f0b2676c39eb812451" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 41969 } attrs { promote: false } } peers { permanent_uuid: "3835d4d282c54ce8b02f7780f2d12695" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 33797 } attrs { promote: false } }
I20260808 14:45:28.472434 10207 leader_election.cc:288] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695 [CANDIDATE]: Term 2 election: Requested vote from peers 03221342f77f4ccb9c0a4d58bae5a5ad (127.30.214.190:41515), 2956799a475441f0b2676c39eb812451 (127.30.214.189:41969)
I20260808 14:45:28.472429 10212 leader_election.cc:288] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451 [CANDIDATE]: Term 2 election: Requested vote from peers 03221342f77f4ccb9c0a4d58bae5a5ad (127.30.214.190:41515), 3835d4d282c54ce8b02f7780f2d12695 (127.30.214.188:33797)
I20260808 14:45:28.472653 10220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:28.472562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:41515 (local address 127.0.0.1:46486)
0808 14:45:28.472601 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:28.472630 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:41515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
I20260808 14:45:28.472630 9458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2956799a475441f0b2676c39eb812451" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "3835d4d282c54ce8b02f7780f2d12695"
I20260808 14:45:28.472707 10215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:28.472567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:41515 (local address 127.0.0.1:46488)
0808 14:45:28.472605 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:28.472628 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:41515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260808 14:45:28.472762 9458 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2956799a475441f0b2676c39eb812451 in current term 2: Already voted for candidate 3835d4d282c54ce8b02f7780f2d12695 in this term.
I20260808 14:45:28.472644 9184 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3835d4d282c54ce8b02f7780f2d12695" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "2956799a475441f0b2676c39eb812451"
I20260808 14:45:28.472821 9184 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3835d4d282c54ce8b02f7780f2d12695 in current term 2: Already voted for candidate 2956799a475441f0b2676c39eb812451 in this term.
I20260808 14:45:28.472973 10217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:28.472895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:41515 (local address 127.0.0.1:46496)
0808 14:45:28.472927 (+ 32us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:28.472952 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:41515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
W20260808 14:45:28.473037 9420 leader_election.cc:334] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 03221342f77f4ccb9c0a4d58bae5a5ad (127.30.214.190:41515): Network error: Client connection negotiation failed: client connection to 127.30.214.190:41515: connect: Connection refused (error 111)
I20260808 14:45:28.473071 9420 leader_election.cc:302] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3835d4d282c54ce8b02f7780f2d12695; no voters: 03221342f77f4ccb9c0a4d58bae5a5ad, 2956799a475441f0b2676c39eb812451
I20260808 14:45:28.473150 10207 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260808 14:45:28.473402 10220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:28.473315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:41515 (local address 127.0.0.1:46502)
0808 14:45:28.473357 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:28.473382 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:41515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260808 14:45:28.473500 9146 leader_election.cc:334] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 03221342f77f4ccb9c0a4d58bae5a5ad (127.30.214.190:41515): Network error: Client connection negotiation failed: client connection to 127.30.214.190:41515: connect: Connection refused (error 111)
I20260808 14:45:28.473541 9146 leader_election.cc:302] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2956799a475441f0b2676c39eb812451; no voters: 03221342f77f4ccb9c0a4d58bae5a5ad, 3835d4d282c54ce8b02f7780f2d12695
I20260808 14:45:28.473603 10212 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260808 14:45:28.963284 10228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:28.963069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:41515 (local address 127.30.214.131:55475)
0808 14:45:28.963194 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:28.963237 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:41515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":67,"threads_started":1}
I20260808 14:45:28.964890 10229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:28.964680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:41515 (local address 127.30.214.130:41739)
0808 14:45:28.964807 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:28.964843 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:41515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":78,"threads_started":1}
I20260808 14:45:28.965410 10230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:28.965237 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:41515 (local address 127.30.214.129:47487)
0808 14:45:28.965341 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:28.965374 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:41515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89,"thread_start_us":56,"threads_started":1}
I20260808 14:45:29.963982 10231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:29.963765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:41515 (local address 127.30.214.131:57755)
0808 14:45:29.963893 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:29.963936 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:41515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":65,"threads_started":1}
I20260808 14:45:29.965498 10232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:29.965258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:41515 (local address 127.30.214.130:57133)
0808 14:45:29.965381 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:29.965422 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:41515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":53,"threads_started":1}
I20260808 14:45:29.965941 10233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:29.965774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:41515 (local address 127.30.214.129:50831)
0808 14:45:29.965868 (+ 94us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:29.965902 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:41515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79,"thread_start_us":44,"threads_started":1}
I20260808 14:45:30.003688 10234 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:45:30.003788 10234 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41515 } } peers { permanent_uuid: "2956799a475441f0b2676c39eb812451" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 41969 } attrs { promote: false } } peers { permanent_uuid: "3835d4d282c54ce8b02f7780f2d12695" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 33797 } attrs { promote: false } }
I20260808 14:45:30.003940 10234 leader_election.cc:288] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 03221342f77f4ccb9c0a4d58bae5a5ad (127.30.214.190:41515), 3835d4d282c54ce8b02f7780f2d12695 (127.30.214.188:33797)
I20260808 14:45:30.004196 9458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2956799a475441f0b2676c39eb812451" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "3835d4d282c54ce8b02f7780f2d12695" is_pre_election: true
I20260808 14:45:30.004277 10235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:30.004086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:41515 (local address 127.0.0.1:42416)
0808 14:45:30.004198 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:30.004235 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:41515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":62,"threads_started":1}
I20260808 14:45:30.004287 9458 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2956799a475441f0b2676c39eb812451 in term 2.
I20260808 14:45:30.004436 9142 leader_election.cc:302] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2956799a475441f0b2676c39eb812451, 3835d4d282c54ce8b02f7780f2d12695; no voters:
I20260808 14:45:30.004531 10234 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260808 14:45:30.004582 10234 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:45:30.004602 10234 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451 [term 2 FOLLOWER]: Advancing to term 3
I20260808 14:45:30.004761 10235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:30.004676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:41515 (local address 127.0.0.1:42430)
0808 14:45:30.004711 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:30.004742 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:41515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
W20260808 14:45:30.004829 9146 leader_election.cc:334] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 03221342f77f4ccb9c0a4d58bae5a5ad (127.30.214.190:41515): Network error: Client connection negotiation failed: client connection to 127.30.214.190:41515: connect: Connection refused (error 111)
I20260808 14:45:30.005395 10234 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41515 } } peers { permanent_uuid: "2956799a475441f0b2676c39eb812451" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 41969 } attrs { promote: false } } peers { permanent_uuid: "3835d4d282c54ce8b02f7780f2d12695" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 33797 } attrs { promote: false } }
I20260808 14:45:30.005560 10234 leader_election.cc:288] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451 [CANDIDATE]: Term 3 election: Requested vote from peers 03221342f77f4ccb9c0a4d58bae5a5ad (127.30.214.190:41515), 3835d4d282c54ce8b02f7780f2d12695 (127.30.214.188:33797)
I20260808 14:45:30.005729 10235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:30.005640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:41515 (local address 127.0.0.1:42446)
0808 14:45:30.005675 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:30.005705 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:41515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
I20260808 14:45:30.005720 9458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2956799a475441f0b2676c39eb812451" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "3835d4d282c54ce8b02f7780f2d12695"
I20260808 14:45:30.005785 9458 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695 [term 2 FOLLOWER]: Advancing to term 3
I20260808 14:45:30.006075 10235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:30.005964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:41515 (local address 127.0.0.1:42450)
0808 14:45:30.005990 (+ 26us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:30.006018 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:41515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":15}
W20260808 14:45:30.006294 9146 leader_election.cc:334] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 03221342f77f4ccb9c0a4d58bae5a5ad (127.30.214.190:41515): Network error: Client connection negotiation failed: client connection to 127.30.214.190:41515: connect: Connection refused (error 111)
I20260808 14:45:30.006601 9458 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2956799a475441f0b2676c39eb812451 in term 3.
I20260808 14:45:30.006791 9142 leader_election.cc:302] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2956799a475441f0b2676c39eb812451, 3835d4d282c54ce8b02f7780f2d12695; no voters: 03221342f77f4ccb9c0a4d58bae5a5ad
I20260808 14:45:30.006919 10234 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451 [term 3 FOLLOWER]: Leader election won for term 3
I20260808 14:45:30.007033 10234 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451 [term 3 LEADER]: Becoming Leader. State: Replica: 2956799a475441f0b2676c39eb812451, State: Running, Role: LEADER
I20260808 14:45:30.007107 10234 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41515 } } peers { permanent_uuid: "2956799a475441f0b2676c39eb812451" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 41969 } attrs { promote: false } } peers { permanent_uuid: "3835d4d282c54ce8b02f7780f2d12695" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 33797 } attrs { promote: false } }
I20260808 14:45:30.007431 10241 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2956799a475441f0b2676c39eb812451. Latest consensus state: current_term: 3 leader_uuid: "2956799a475441f0b2676c39eb812451" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41515 } } peers { permanent_uuid: "2956799a475441f0b2676c39eb812451" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 41969 } attrs { promote: false } } peers { permanent_uuid: "3835d4d282c54ce8b02f7780f2d12695" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 33797 } attrs { promote: false } } }
I20260808 14:45:30.007520 10241 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451 [sys.catalog]: This master's current role is: LEADER
I20260808 14:45:30.007704 10246 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:45:30.008209 10246 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:45:30.008285 10246 catalog_manager.cc:1259] Loaded cluster ID: 3961a3df3910444ea5c53097ccd0ff75
I20260808 14:45:30.008317 10246 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:45:30.008502 10246 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:45:30.008575 10246 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451: Loaded TSK: 0
I20260808 14:45:30.008710 10246 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:45:30.087339 9165 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59082:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:45:30.089001 9165 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:45:30.090030 10235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:30.089934 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:41515 (local address 127.0.0.1:42480)
0808 14:45:30.089969 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:30.090000 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:41515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
I20260808 14:45:30.090075 9458 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695 [term 3 FOLLOWER]: Refusing update from remote peer 2956799a475441f0b2676c39eb812451: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 3 index: 14. (index mismatch)
I20260808 14:45:30.090303 10241 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3835d4d282c54ce8b02f7780f2d12695" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 33797 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260808 14:45:30.090360 10235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:30.090265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:41515 (local address 127.0.0.1:42486)
0808 14:45:30.090309 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:30.090335 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:41515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260808 14:45:30.090479 9146 consensus_peers.cc:487] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451 -> Peer 03221342f77f4ccb9c0a4d58bae5a5ad (127.30.214.190:41515): Couldn't send request to peer 03221342f77f4ccb9c0a4d58bae5a5ad. Status: Network error: Client connection negotiation failed: client connection to 127.30.214.190:41515: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260808 14:45:30.090924 10248 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2956799a475441f0b2676c39eb812451. Latest consensus state: current_term: 3 leader_uuid: "2956799a475441f0b2676c39eb812451" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41515 } } peers { permanent_uuid: "2956799a475441f0b2676c39eb812451" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 41969 } attrs { promote: false } } peers { permanent_uuid: "3835d4d282c54ce8b02f7780f2d12695" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 33797 } attrs { promote: false } } }
I20260808 14:45:30.091012 10248 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:45:30.091404 10241 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "2956799a475441f0b2676c39eb812451" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41515 } } peers { permanent_uuid: "2956799a475441f0b2676c39eb812451" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 41969 } attrs { promote: false } } peers { permanent_uuid: "3835d4d282c54ce8b02f7780f2d12695" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 33797 } attrs { promote: false } } }
I20260808 14:45:30.091496 10241 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451 [sys.catalog]: This master's current role is: LEADER
I20260808 14:45:30.091538 10248 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "2956799a475441f0b2676c39eb812451" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "03221342f77f4ccb9c0a4d58bae5a5ad" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41515 } } peers { permanent_uuid: "2956799a475441f0b2676c39eb812451" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 41969 } attrs { promote: false } } peers { permanent_uuid: "3835d4d282c54ce8b02f7780f2d12695" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 33797 } attrs { promote: false } } }
I20260808 14:45:30.091620 10248 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3835d4d282c54ce8b02f7780f2d12695 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:45:30.091740 10249 mvcc.cc:205] Tried to move back new op lower bound from 7316276552046948352 to 7316276551709790208. Current Snapshot: MvccSnapshot[applied={T|T < 7316276552046948352}]
I20260808 14:45:30.096884 10257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:30.093386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33786 (local address 127.30.214.130:41721)
0808 14:45:30.093877 (+ 491us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:30.093878 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:30.093885 (+ 7us) server_negotiation.cc:407] Connection header received
0808 14:45:30.093909 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:30.093910 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:30.093918 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:30.093977 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:45:30.094087 (+ 110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:30.094828 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:30.095872 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:30.096462 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:30.096544 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:30.096554 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:30.096748 (+ 194us) server_negotiation.cc:299] Negotiation successful
0808 14:45:30.096791 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":457,"thread_start_us":73,"threads_started":1}
I20260808 14:45:30.096897 10235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:30.093185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.130:41721 (local address 127.0.0.1:33786)
0808 14:45:30.093236 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:30.093247 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:30.093301 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:30.093993 (+ 692us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:30.093993 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:30.093995 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:45:30.094033 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:30.094034 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:30.094901 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:30.094901 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:30.095800 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:30.095803 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:30.096582 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:30.096584 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:30.096670 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:30.096673 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:45:30.096736 (+ 63us) client_negotiation.cc:240] Negotiation successful
0808 14:45:30.096801 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33,"mutex_wait_us":2}
I20260808 14:45:30.096899 10254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:30.093290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.131:34441 (local address 127.0.0.1:36564)
0808 14:45:30.093551 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:30.093560 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:30.093605 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:30.093797 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:30.093798 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:30.093800 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:45:30.093848 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:30.093850 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:30.094741 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:30.094742 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:30.095877 (+ 1135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:30.095878 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:30.096584 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:30.096585 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:30.096664 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:30.096669 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 14:45:30.096736 (+ 67us) client_negotiation.cc:240] Negotiation successful
0808 14:45:30.096802 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":242,"mutex_wait_us":65,"thread_start_us":73,"threads_started":1}
I20260808 14:45:30.097399 10255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:30.093240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.129:33035 (local address 127.0.0.1:36708)
0808 14:45:30.093427 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:30.093456 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:30.093507 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:30.093740 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:30.093741 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:30.093743 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:45:30.093801 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:30.093803 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:30.094613 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:30.094614 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:30.095871 (+ 1257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:30.095874 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:30.097218 (+ 1344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:30.097219 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:30.097265 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:30.097268 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:45:30.097310 (+ 42us) client_negotiation.cc:240] Negotiation successful
0808 14:45:30.097343 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168,"mutex_wait_us":2,"thread_start_us":76,"threads_started":1}
I20260808 14:45:30.097422 10258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:30.093427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36708 (local address 127.30.214.129:33035)
0808 14:45:30.093545 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:30.093547 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:30.093556 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:45:30.093621 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:30.093622 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:30.093633 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:30.093689 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:45:30.093889 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:30.094534 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:30.096610 (+ 2076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:30.097145 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:30.097223 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:30.097232 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:30.097317 (+ 85us) server_negotiation.cc:299] Negotiation successful
0808 14:45:30.097353 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98,"thread_start_us":72,"threads_started":1}
I20260808 14:45:30.097810 9608 tablet_service.cc:1467] Processing CreateTablet for tablet 6b41f562bdce458aa3f68ba59ee0350f (DEFAULT_TABLE table=test-table [id=4f706fa418394f108b0eeac75e99c754]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:45:30.097843 9806 tablet_service.cc:1467] Processing CreateTablet for tablet 6b41f562bdce458aa3f68ba59ee0350f (DEFAULT_TABLE table=test-table [id=4f706fa418394f108b0eeac75e99c754]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:45:30.097960 9806 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6b41f562bdce458aa3f68ba59ee0350f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:45:30.097961 9608 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6b41f562bdce458aa3f68ba59ee0350f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:45:30.098027 10256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:30.093357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36564 (local address 127.30.214.131:34441)
0808 14:45:30.093693 (+ 336us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:30.093695 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:30.093702 (+ 7us) server_negotiation.cc:407] Connection header received
0808 14:45:30.093725 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:30.093726 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:30.093736 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:30.093794 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:45:30.093909 (+ 115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:30.094665 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:30.095943 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:30.096497 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:30.096564 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:30.096572 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:30.097792 (+ 1220us) server_negotiation.cc:299] Negotiation successful
0808 14:45:30.097930 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":313,"thread_start_us":100,"threads_started":1}
I20260808 14:45:30.098233 10001 tablet_service.cc:1467] Processing CreateTablet for tablet 6b41f562bdce458aa3f68ba59ee0350f (DEFAULT_TABLE table=test-table [id=4f706fa418394f108b0eeac75e99c754]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:45:30.098337 10001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6b41f562bdce458aa3f68ba59ee0350f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:45:30.099365 10260 tablet_bootstrap.cc:492] T 6b41f562bdce458aa3f68ba59ee0350f P afc1660c6a3f4cd695128351c5507cbb: Bootstrap starting.
I20260808 14:45:30.099678 10264 tablet_bootstrap.cc:492] T 6b41f562bdce458aa3f68ba59ee0350f P 21687c84bf824598aa839f0615f15623: Bootstrap starting.
I20260808 14:45:30.099900 10260 tablet_bootstrap.cc:654] T 6b41f562bdce458aa3f68ba59ee0350f P afc1660c6a3f4cd695128351c5507cbb: Neither blocks nor log segments found. Creating new log.
I20260808 14:45:30.100255 10264 tablet_bootstrap.cc:654] T 6b41f562bdce458aa3f68ba59ee0350f P 21687c84bf824598aa839f0615f15623: Neither blocks nor log segments found. Creating new log.
I20260808 14:45:30.100495 10260 tablet_bootstrap.cc:492] T 6b41f562bdce458aa3f68ba59ee0350f P afc1660c6a3f4cd695128351c5507cbb: No bootstrap required, opened a new log
I20260808 14:45:30.100554 10260 ts_tablet_manager.cc:1397] T 6b41f562bdce458aa3f68ba59ee0350f P afc1660c6a3f4cd695128351c5507cbb: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 14:45:30.100647 10261 tablet_bootstrap.cc:492] T 6b41f562bdce458aa3f68ba59ee0350f P 005d6a0684f14786a93ab24b32ae0e59: Bootstrap starting.
I20260808 14:45:30.100798 10260 raft_consensus.cc:348] T 6b41f562bdce458aa3f68ba59ee0350f P afc1660c6a3f4cd695128351c5507cbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005d6a0684f14786a93ab24b32ae0e59" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 41721 } } peers { permanent_uuid: "afc1660c6a3f4cd695128351c5507cbb" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 34441 } } peers { permanent_uuid: "21687c84bf824598aa839f0615f15623" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 33035 } }
I20260808 14:45:30.100894 10260 raft_consensus.cc:374] T 6b41f562bdce458aa3f68ba59ee0350f P afc1660c6a3f4cd695128351c5507cbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:45:30.100944 10260 raft_consensus.cc:729] T 6b41f562bdce458aa3f68ba59ee0350f P afc1660c6a3f4cd695128351c5507cbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afc1660c6a3f4cd695128351c5507cbb, State: Initialized, Role: FOLLOWER
I20260808 14:45:30.100986 10261 tablet_bootstrap.cc:654] T 6b41f562bdce458aa3f68ba59ee0350f P 005d6a0684f14786a93ab24b32ae0e59: Neither blocks nor log segments found. Creating new log.
I20260808 14:45:30.101004 10260 consensus_queue.cc:260] T 6b41f562bdce458aa3f68ba59ee0350f P afc1660c6a3f4cd695128351c5507cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005d6a0684f14786a93ab24b32ae0e59" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 41721 } } peers { permanent_uuid: "afc1660c6a3f4cd695128351c5507cbb" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 34441 } } peers { permanent_uuid: "21687c84bf824598aa839f0615f15623" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 33035 } }
I20260808 14:45:30.101200 10260 ts_tablet_manager.cc:1428] T 6b41f562bdce458aa3f68ba59ee0350f P afc1660c6a3f4cd695128351c5507cbb: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:30.101531 10231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:30.101395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:41515 (local address 127.30.214.131:51389)
0808 14:45:30.101472 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:30.101503 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:41515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260808 14:45:30.101909 10231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:30.101820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:41515 (local address 127.30.214.131:36799)
0808 14:45:30.101857 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:30.101885 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:41515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
I20260808 14:45:30.101920 10104 heartbeater.cc:503] Master 127.30.214.189:41969 was elected leader, sending a full tablet report...
I20260808 14:45:30.102088 10261 tablet_bootstrap.cc:492] T 6b41f562bdce458aa3f68ba59ee0350f P 005d6a0684f14786a93ab24b32ae0e59: No bootstrap required, opened a new log
I20260808 14:45:30.102149 10261 ts_tablet_manager.cc:1397] T 6b41f562bdce458aa3f68ba59ee0350f P 005d6a0684f14786a93ab24b32ae0e59: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:45:30.102321 10261 raft_consensus.cc:348] T 6b41f562bdce458aa3f68ba59ee0350f P 005d6a0684f14786a93ab24b32ae0e59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005d6a0684f14786a93ab24b32ae0e59" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 41721 } } peers { permanent_uuid: "afc1660c6a3f4cd695128351c5507cbb" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 34441 } } peers { permanent_uuid: "21687c84bf824598aa839f0615f15623" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 33035 } }
I20260808 14:45:30.102407 10261 raft_consensus.cc:374] T 6b41f562bdce458aa3f68ba59ee0350f P 005d6a0684f14786a93ab24b32ae0e59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:45:30.102427 10261 raft_consensus.cc:729] T 6b41f562bdce458aa3f68ba59ee0350f P 005d6a0684f14786a93ab24b32ae0e59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005d6a0684f14786a93ab24b32ae0e59, State: Initialized, Role: FOLLOWER
I20260808 14:45:30.102476 10261 consensus_queue.cc:260] T 6b41f562bdce458aa3f68ba59ee0350f P 005d6a0684f14786a93ab24b32ae0e59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005d6a0684f14786a93ab24b32ae0e59" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 41721 } } peers { permanent_uuid: "afc1660c6a3f4cd695128351c5507cbb" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 34441 } } peers { permanent_uuid: "21687c84bf824598aa839f0615f15623" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 33035 } }
I20260808 14:45:30.102519 10264 tablet_bootstrap.cc:492] T 6b41f562bdce458aa3f68ba59ee0350f P 21687c84bf824598aa839f0615f15623: No bootstrap required, opened a new log
I20260808 14:45:30.102586 10264 ts_tablet_manager.cc:1397] T 6b41f562bdce458aa3f68ba59ee0350f P 21687c84bf824598aa839f0615f15623: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260808 14:45:30.102722 10261 ts_tablet_manager.cc:1428] T 6b41f562bdce458aa3f68ba59ee0350f P 005d6a0684f14786a93ab24b32ae0e59: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 14:45:30.102808 10264 raft_consensus.cc:348] T 6b41f562bdce458aa3f68ba59ee0350f P 21687c84bf824598aa839f0615f15623 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005d6a0684f14786a93ab24b32ae0e59" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 41721 } } peers { permanent_uuid: "afc1660c6a3f4cd695128351c5507cbb" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 34441 } } peers { permanent_uuid: "21687c84bf824598aa839f0615f15623" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 33035 } }
I20260808 14:45:30.102893 10232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:30.102817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:41515 (local address 127.30.214.130:36821)
0808 14:45:30.102844 (+ 27us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:30.102869 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:41515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":12}
I20260808 14:45:30.102917 10264 raft_consensus.cc:374] T 6b41f562bdce458aa3f68ba59ee0350f P 21687c84bf824598aa839f0615f15623 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:45:30.102939 10264 raft_consensus.cc:729] T 6b41f562bdce458aa3f68ba59ee0350f P 21687c84bf824598aa839f0615f15623 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21687c84bf824598aa839f0615f15623, State: Initialized, Role: FOLLOWER
I20260808 14:45:30.102982 10264 consensus_queue.cc:260] T 6b41f562bdce458aa3f68ba59ee0350f P 21687c84bf824598aa839f0615f15623 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005d6a0684f14786a93ab24b32ae0e59" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 41721 } } peers { permanent_uuid: "afc1660c6a3f4cd695128351c5507cbb" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 34441 } } peers { permanent_uuid: "21687c84bf824598aa839f0615f15623" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 33035 } }
I20260808 14:45:30.103147 10232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:30.103066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:41515 (local address 127.30.214.130:56735)
0808 14:45:30.103097 (+ 31us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:30.103121 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:41515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":16}
I20260808 14:45:30.103168 10264 ts_tablet_manager.cc:1428] T 6b41f562bdce458aa3f68ba59ee0350f P 21687c84bf824598aa839f0615f15623: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 14:45:30.103585 10233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:30.103485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:41515 (local address 127.30.214.129:33423)
0808 14:45:30.103523 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:30.103557 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:41515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
I20260808 14:45:30.103732 9707 heartbeater.cc:503] Master 127.30.214.189:41969 was elected leader, sending a full tablet report...
I20260808 14:45:30.103735 9907 heartbeater.cc:503] Master 127.30.214.189:41969 was elected leader, sending a full tablet report...
I20260808 14:45:30.104012 10233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:30.103935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:41515 (local address 127.30.214.129:33987)
0808 14:45:30.103968 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:30.103988 (+ 20us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:41515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":20}
I20260808 14:45:30.197479 10270 raft_consensus.cc:482] T 6b41f562bdce458aa3f68ba59ee0350f P afc1660c6a3f4cd695128351c5507cbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:45:30.197597 10270 raft_consensus.cc:504] T 6b41f562bdce458aa3f68ba59ee0350f P afc1660c6a3f4cd695128351c5507cbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005d6a0684f14786a93ab24b32ae0e59" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 41721 } } peers { permanent_uuid: "afc1660c6a3f4cd695128351c5507cbb" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 34441 } } peers { permanent_uuid: "21687c84bf824598aa839f0615f15623" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 33035 } }
I20260808 14:45:30.197767 10270 leader_election.cc:288] T 6b41f562bdce458aa3f68ba59ee0350f P afc1660c6a3f4cd695128351c5507cbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005d6a0684f14786a93ab24b32ae0e59 (127.30.214.130:41721), 21687c84bf824598aa839f0615f15623 (127.30.214.129:33035)
I20260808 14:45:30.198033 9833 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b41f562bdce458aa3f68ba59ee0350f" candidate_uuid: "afc1660c6a3f4cd695128351c5507cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005d6a0684f14786a93ab24b32ae0e59" is_pre_election: true
I20260808 14:45:30.198058 9632 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b41f562bdce458aa3f68ba59ee0350f" candidate_uuid: "afc1660c6a3f4cd695128351c5507cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21687c84bf824598aa839f0615f15623" is_pre_election: true
I20260808 14:45:30.198137 9833 raft_consensus.cc:2454] T 6b41f562bdce458aa3f68ba59ee0350f P 005d6a0684f14786a93ab24b32ae0e59 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afc1660c6a3f4cd695128351c5507cbb in term 0.
I20260808 14:45:30.198170 9632 raft_consensus.cc:2454] T 6b41f562bdce458aa3f68ba59ee0350f P 21687c84bf824598aa839f0615f15623 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afc1660c6a3f4cd695128351c5507cbb in term 0.
I20260808 14:45:30.198354 9939 leader_election.cc:302] T 6b41f562bdce458aa3f68ba59ee0350f P afc1660c6a3f4cd695128351c5507cbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21687c84bf824598aa839f0615f15623, afc1660c6a3f4cd695128351c5507cbb; no voters:
I20260808 14:45:30.198460 10270 raft_consensus.cc:2781] T 6b41f562bdce458aa3f68ba59ee0350f P afc1660c6a3f4cd695128351c5507cbb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:45:30.198509 10270 raft_consensus.cc:482] T 6b41f562bdce458aa3f68ba59ee0350f P afc1660c6a3f4cd695128351c5507cbb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:45:30.198537 10270 raft_consensus.cc:3037] T 6b41f562bdce458aa3f68ba59ee0350f P afc1660c6a3f4cd695128351c5507cbb [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:30.199312 10270 raft_consensus.cc:504] T 6b41f562bdce458aa3f68ba59ee0350f P afc1660c6a3f4cd695128351c5507cbb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005d6a0684f14786a93ab24b32ae0e59" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 41721 } } peers { permanent_uuid: "afc1660c6a3f4cd695128351c5507cbb" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 34441 } } peers { permanent_uuid: "21687c84bf824598aa839f0615f15623" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 33035 } }
I20260808 14:45:30.199461 10270 leader_election.cc:288] T 6b41f562bdce458aa3f68ba59ee0350f P afc1660c6a3f4cd695128351c5507cbb [CANDIDATE]: Term 1 election: Requested vote from peers 005d6a0684f14786a93ab24b32ae0e59 (127.30.214.130:41721), 21687c84bf824598aa839f0615f15623 (127.30.214.129:33035)
I20260808 14:45:30.199637 9632 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b41f562bdce458aa3f68ba59ee0350f" candidate_uuid: "afc1660c6a3f4cd695128351c5507cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21687c84bf824598aa839f0615f15623"
I20260808 14:45:30.199653 9833 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b41f562bdce458aa3f68ba59ee0350f" candidate_uuid: "afc1660c6a3f4cd695128351c5507cbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005d6a0684f14786a93ab24b32ae0e59"
I20260808 14:45:30.199707 9632 raft_consensus.cc:3037] T 6b41f562bdce458aa3f68ba59ee0350f P 21687c84bf824598aa839f0615f15623 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:30.199724 9833 raft_consensus.cc:3037] T 6b41f562bdce458aa3f68ba59ee0350f P 005d6a0684f14786a93ab24b32ae0e59 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:30.200302 9833 raft_consensus.cc:2454] T 6b41f562bdce458aa3f68ba59ee0350f P 005d6a0684f14786a93ab24b32ae0e59 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afc1660c6a3f4cd695128351c5507cbb in term 1.
I20260808 14:45:30.200309 9632 raft_consensus.cc:2454] T 6b41f562bdce458aa3f68ba59ee0350f P 21687c84bf824598aa839f0615f15623 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afc1660c6a3f4cd695128351c5507cbb in term 1.
I20260808 14:45:30.200487 9940 leader_election.cc:302] T 6b41f562bdce458aa3f68ba59ee0350f P afc1660c6a3f4cd695128351c5507cbb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005d6a0684f14786a93ab24b32ae0e59, afc1660c6a3f4cd695128351c5507cbb; no voters:
I20260808 14:45:30.200601 10270 raft_consensus.cc:2781] T 6b41f562bdce458aa3f68ba59ee0350f P afc1660c6a3f4cd695128351c5507cbb [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:45:30.200752 10270 raft_consensus.cc:686] T 6b41f562bdce458aa3f68ba59ee0350f P afc1660c6a3f4cd695128351c5507cbb [term 1 LEADER]: Becoming Leader. State: Replica: afc1660c6a3f4cd695128351c5507cbb, State: Running, Role: LEADER
I20260808 14:45:30.200802 10270 consensus_queue.cc:237] T 6b41f562bdce458aa3f68ba59ee0350f P afc1660c6a3f4cd695128351c5507cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005d6a0684f14786a93ab24b32ae0e59" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 41721 } } peers { permanent_uuid: "afc1660c6a3f4cd695128351c5507cbb" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 34441 } } peers { permanent_uuid: "21687c84bf824598aa839f0615f15623" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 33035 } }
I20260808 14:45:30.201138 10231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:30.201005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:41515 (local address 127.30.214.131:42225)
0808 14:45:30.201065 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:30.201107 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:41515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260808 14:45:30.201537 9165 catalog_manager.cc:5495] T 6b41f562bdce458aa3f68ba59ee0350f P afc1660c6a3f4cd695128351c5507cbb reported cstate change: term changed from 0 to 1, leader changed from <none> to afc1660c6a3f4cd695128351c5507cbb (127.30.214.131). New cstate: current_term: 1 leader_uuid: "afc1660c6a3f4cd695128351c5507cbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005d6a0684f14786a93ab24b32ae0e59" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 41721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afc1660c6a3f4cd695128351c5507cbb" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 34441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21687c84bf824598aa839f0615f15623" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 33035 } health_report { overall_health: UNKNOWN } } }
I20260808 14:45:30.211558 10256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:30.209418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36576 (local address 127.30.214.131:34441)
0808 14:45:30.209472 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:30.209475 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:30.209483 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:45:30.209558 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:30.209559 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:30.209570 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:30.209613 (+ 43us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:45:30.209737 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:30.210223 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:30.210940 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:30.211150 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:30.211204 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:30.211335 (+ 131us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:45:30.211369 (+ 34us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:45:30.211409 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:30.211461 (+ 52us) server_negotiation.cc:299] Negotiation successful
0808 14:45:30.211483 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 14:45:30.212453 9632 raft_consensus.cc:1261] T 6b41f562bdce458aa3f68ba59ee0350f P 21687c84bf824598aa839f0615f15623 [term 1 FOLLOWER]: Refusing update from remote peer afc1660c6a3f4cd695128351c5507cbb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:45:30.212479 9833 raft_consensus.cc:1261] T 6b41f562bdce458aa3f68ba59ee0350f P 005d6a0684f14786a93ab24b32ae0e59 [term 1 FOLLOWER]: Refusing update from remote peer afc1660c6a3f4cd695128351c5507cbb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:45:30.212698 10275 consensus_queue.cc:1035] T 6b41f562bdce458aa3f68ba59ee0350f P afc1660c6a3f4cd695128351c5507cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "21687c84bf824598aa839f0615f15623" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 33035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:45:30.212813 10270 consensus_queue.cc:1035] T 6b41f562bdce458aa3f68ba59ee0350f P afc1660c6a3f4cd695128351c5507cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "005d6a0684f14786a93ab24b32ae0e59" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 41721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:45:30.213388 10233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:30.213219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:41515 (local address 127.30.214.129:43001)
0808 14:45:30.213325 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:30.213356 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:41515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260808 14:45:30.213517 10232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:30.213395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:41515 (local address 127.30.214.130:36591)
0808 14:45:30.213457 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:30.213485 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:41515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
I20260808 14:45:30.214890 10231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:30.214732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:41515 (local address 127.30.214.131:37773)
0808 14:45:30.214830 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:30.214858 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:41515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
I20260808 14:45:30.215024 10233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:30.214753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:41515 (local address 127.30.214.129:43155)
0808 14:45:30.214967 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:30.214999 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:41515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":196}
I20260808 14:45:30.215193 10282 mvcc.cc:205] Tried to move back new op lower bound from 7316276552548495360 to 7316276552503005184. Current Snapshot: MvccSnapshot[applied={T|T < 7316276552548495360}]
I20260808 14:45:30.215937 9165 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59082:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:45:30.216039 9165 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59082:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:45:30.216159 10231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:30.215888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:41515 (local address 127.30.214.131:51725)
0808 14:45:30.216106 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:30.216135 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:41515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":203}
I20260808 14:45:30.216135 10285 mvcc.cc:205] Tried to move back new op lower bound from 7316276552548495360 to 7316276552503005184. Current Snapshot: MvccSnapshot[applied={T|T < 7316276552548495360}]
I20260808 14:45:30.216400 10232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:30.216304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:41515 (local address 127.30.214.130:43549)
0808 14:45:30.216347 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:30.216372 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:41515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260808 14:45:30.217336 9165 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2956799a475441f0b2676c39eb812451: Sending DeleteTablet for 3 replicas of tablet 6b41f562bdce458aa3f68ba59ee0350f
I20260808 14:45:30.217694 9608 tablet_service.cc:1514] Processing DeleteTablet for tablet 6b41f562bdce458aa3f68ba59ee0350f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:45:30 UTC) from {username='oryx', principal='oryx/127.30.214.189@KRBTEST.COM'} at 127.0.0.1:36708
I20260808 14:45:30.217727 9997 tablet_service.cc:1514] Processing DeleteTablet for tablet 6b41f562bdce458aa3f68ba59ee0350f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:45:30 UTC) from {username='oryx', principal='oryx/127.30.214.189@KRBTEST.COM'} at 127.0.0.1:36564
I20260808 14:45:30.217770 9806 tablet_service.cc:1514] Processing DeleteTablet for tablet 6b41f562bdce458aa3f68ba59ee0350f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:45:30 UTC) from {username='oryx', principal='oryx/127.30.214.189@KRBTEST.COM'} at 127.0.0.1:33786
I20260808 14:45:30.217743 10001 tablet_service.cc:1514] Processing DeleteTablet for tablet 6b41f562bdce458aa3f68ba59ee0350f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:45:30 UTC) from {username='oryx', principal='oryx/127.30.214.189@KRBTEST.COM'} at 127.0.0.1:36564
I20260808 14:45:30.217945 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 9390
I20260808 14:45:30.217974 10294 tablet_replica.cc:330] T 6b41f562bdce458aa3f68ba59ee0350f P 005d6a0684f14786a93ab24b32ae0e59: stopping tablet replica
I20260808 14:45:30.218025 10293 tablet_replica.cc:330] T 6b41f562bdce458aa3f68ba59ee0350f P afc1660c6a3f4cd695128351c5507cbb: stopping tablet replica
I20260808 14:45:30.218037 10294 raft_consensus.cc:2229] T 6b41f562bdce458aa3f68ba59ee0350f P 005d6a0684f14786a93ab24b32ae0e59 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:45:30.218075 10294 raft_consensus.cc:2258] T 6b41f562bdce458aa3f68ba59ee0350f P 005d6a0684f14786a93ab24b32ae0e59 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:45:30.218474 10293 raft_consensus.cc:2229] T 6b41f562bdce458aa3f68ba59ee0350f P afc1660c6a3f4cd695128351c5507cbb [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:45:30.218567 10293 raft_consensus.cc:2258] T 6b41f562bdce458aa3f68ba59ee0350f P afc1660c6a3f4cd695128351c5507cbb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:45:30.220729 10293 ts_tablet_manager.cc:1905] T 6b41f562bdce458aa3f68ba59ee0350f P afc1660c6a3f4cd695128351c5507cbb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:45:30.224408 10293 ts_tablet_manager.cc:1918] T 6b41f562bdce458aa3f68ba59ee0350f P afc1660c6a3f4cd695128351c5507cbb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:45:30.224473 10293 log.cc:1196] T 6b41f562bdce458aa3f68ba59ee0350f P afc1660c6a3f4cd695128351c5507cbb: Deleting WAL directory at /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-2/wal/wals/6b41f562bdce458aa3f68ba59ee0350f
I20260808 14:45:30.224712 10293 ts_tablet_manager.cc:1939] T 6b41f562bdce458aa3f68ba59ee0350f P afc1660c6a3f4cd695128351c5507cbb: Deleting consensus metadata
I20260808 14:45:30.225097 9146 catalog_manager.cc:4841] TS afc1660c6a3f4cd695128351c5507cbb (127.30.214.131:34441): tablet 6b41f562bdce458aa3f68ba59ee0350f (table test-table [id=4f706fa418394f108b0eeac75e99c754]) successfully deleted
W20260808 14:45:30.225313 9146 catalog_manager.cc:4808] TS afc1660c6a3f4cd695128351c5507cbb (127.30.214.131:34441): delete failed for tablet 6b41f562bdce458aa3f68ba59ee0350f because the tablet was not found. No further retry: Not found: Tablet not found: 6b41f562bdce458aa3f68ba59ee0350f
I20260808 14:45:30.233460 10294 ts_tablet_manager.cc:1905] T 6b41f562bdce458aa3f68ba59ee0350f P 005d6a0684f14786a93ab24b32ae0e59: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:45:30.235791 10294 ts_tablet_manager.cc:1918] T 6b41f562bdce458aa3f68ba59ee0350f P 005d6a0684f14786a93ab24b32ae0e59: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:45:30.235898 10294 log.cc:1196] T 6b41f562bdce458aa3f68ba59ee0350f P 005d6a0684f14786a93ab24b32ae0e59: Deleting WAL directory at /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786200295877777-31578-0/minicluster-data/ts-1/wal/wals/6b41f562bdce458aa3f68ba59ee0350f
I20260808 14:45:30.236096 10294 ts_tablet_manager.cc:1939] T 6b41f562bdce458aa3f68ba59ee0350f P 005d6a0684f14786a93ab24b32ae0e59: Deleting consensus metadata
I20260808 14:45:30.244832 9146 catalog_manager.cc:4841] TS 005d6a0684f14786a93ab24b32ae0e59 (127.30.214.130:41721): tablet 6b41f562bdce458aa3f68ba59ee0350f (table test-table [id=4f706fa418394f108b0eeac75e99c754]) successfully deleted
I20260808 14:45:30.250823 10255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:30.250655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.129:33035 (local address 127.0.0.1:36714)
0808 14:45:30.250743 (+ 88us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:30.250781 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.129:33035: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260808 14:45:30.250787 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 9718
W20260808 14:45:30.255965 9143 catalog_manager.cc:4584] TS 21687c84bf824598aa839f0615f15623 (127.30.214.129:33035): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 6b41f562bdce458aa3f68ba59ee0350f: Network error: Client connection negotiation failed: client connection to 127.30.214.129:33035: connect: Connection refused (error 111)
I20260808 14:45:30.268268 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 9914
I20260808 14:45:30.285737 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 8954
I20260808 14:45:30.300786 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 9244
2026-08-08T14:45:30Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (6632 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:45:30 dist-test-slave-42z9 krb5kdc[10298](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:45:30 dist-test-slave-42z9 krb5kdc[10298](info): set up 2 sockets
Aug 08 14:45:30 dist-test-slave-42z9 krb5kdc[10298](info): commencing operation
krb5kdc: starting...
W20260808 14:45:31.449463 31578 mini_kdc.cc:121] Time spent starting KDC: real 1.117s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Aug 08 14:45:31 dist-test-slave-42z9 krb5kdc[10298](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200331, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:45:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:45:31Z Disabled control of system clock
WARNING: no policy specified for oryx/127.30.214.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.30.214.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.30.214.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/krb5kdc/oryx_127.30.214.190.keytab.
Entry for principal oryx/127.30.214.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/krb5kdc/oryx_127.30.214.190.keytab.
I20260808 14:45:31.572613 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:46267
--webserver_interface=127.30.214.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/krb5kdc/oryx_127.30.214.190.keytab
--principal=oryx/127.30.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:35345
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.214.190:46267
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:45:31.654724 10315 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:45:31.654956 10315 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:45:31.654987 10315 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:45:31.656174 10315 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:45:31.656220 10315 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 14:45:31.656237 10315 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:45:31.656253 10315 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:45:31.656270 10315 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:45:31.656294 10315 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:45:31.657951 10315 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:35345
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.214.190:46267
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/krb5kdc/oryx_127.30.214.190.keytab
--principal=oryx/127.30.214.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:46267
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10315
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:45:31.658227 10315 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:45:31.658447 10315 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:45:31.663411 10326 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:31.663439 10324 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:31.663405 10323 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:31.663496 10315 server_base.cc:1034] running on GCE node
I20260808 14:45:31.663928 10315 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:45:31.664222 10315 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:45:31.665390 10315 hybrid_clock.cc:648] HybridClock initialized: now 1786200331665370 us; error 33 us; skew 500 ppm
Aug 08 14:45:31 dist-test-slave-42z9 krb5kdc[10298](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200331, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:45:31.667873 10315 init.cc:377] Logged in from keytab as oryx/127.30.214.190@KRBTEST.COM (short username oryx)
I20260808 14:45:31.668324 10315 webserver.cc:460] Webserver started at http://127.30.214.190:44913/ using document root <none> and password file <none>
I20260808 14:45:31.668525 10315 fs_manager.cc:359] Metadata directory not provided
I20260808 14:45:31.668563 10315 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:45:31.668668 10315 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:45:31.669786 10315 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/master-0/data/instance:
uuid: "578c10ced2184843b5084ac4b58829dd"
format_stamp: "Formatted at 2026-08-08 14:45:31 on dist-test-slave-42z9"
server_key: "842e5327fb20f19c79456184cf62ae3e"
server_key_iv: "78d36186d257b5c3c3b760495c29bbf6"
server_key_version: "encryptionkey@0"
I20260808 14:45:31.670091 10315 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/master-0/wal/instance:
uuid: "578c10ced2184843b5084ac4b58829dd"
format_stamp: "Formatted at 2026-08-08 14:45:31 on dist-test-slave-42z9"
server_key: "842e5327fb20f19c79456184cf62ae3e"
server_key_iv: "78d36186d257b5c3c3b760495c29bbf6"
server_key_version: "encryptionkey@0"
I20260808 14:45:31.671384 10315 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:45:31.672075 10335 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:31.672241 10315 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:45:31.672325 10315 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/master-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/master-0/wal
uuid: "578c10ced2184843b5084ac4b58829dd"
format_stamp: "Formatted at 2026-08-08 14:45:31 on dist-test-slave-42z9"
server_key: "842e5327fb20f19c79456184cf62ae3e"
server_key_iv: "78d36186d257b5c3c3b760495c29bbf6"
server_key_version: "encryptionkey@0"
I20260808 14:45:31.672387 10315 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:45:31.686785 10315 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:45:31.688930 10315 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:45:31.689057 10315 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:45:31.693786 10315 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.190:46267
I20260808 14:45:31.693859 10423 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.190:46267 every 8 connection(s)
I20260808 14:45:31.694200 10315 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
I20260808 14:45:31.694924 10429 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:45:31.697285 10429 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 578c10ced2184843b5084ac4b58829dd: Bootstrap starting.
I20260808 14:45:31.697928 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 10315
I20260808 14:45:31.697971 10429 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 578c10ced2184843b5084ac4b58829dd: Neither blocks nor log segments found. Creating new log.
I20260808 14:45:31.698017 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/master-0/wal/instance
I20260808 14:45:31.698186 31578 external_mini_cluster.cc:1428] Setting key ae04790dd10adbb6536f4baee5488414
I20260808 14:45:31.698271 10429 log.cc:824] T 00000000000000000000000000000000 P 578c10ced2184843b5084ac4b58829dd: Log is configured to *not* fsync() on all Append() calls
I20260808 14:45:31.699023 10429 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 578c10ced2184843b5084ac4b58829dd: No bootstrap required, opened a new log
I20260808 14:45:31.701102 10429 raft_consensus.cc:348] T 00000000000000000000000000000000 P 578c10ced2184843b5084ac4b58829dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "578c10ced2184843b5084ac4b58829dd" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 46267 } }
I20260808 14:45:31.701252 10429 raft_consensus.cc:374] T 00000000000000000000000000000000 P 578c10ced2184843b5084ac4b58829dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:45:31.701285 10429 raft_consensus.cc:729] T 00000000000000000000000000000000 P 578c10ced2184843b5084ac4b58829dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 578c10ced2184843b5084ac4b58829dd, State: Initialized, Role: FOLLOWER
I20260808 14:45:31.701434 10429 consensus_queue.cc:260] T 00000000000000000000000000000000 P 578c10ced2184843b5084ac4b58829dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "578c10ced2184843b5084ac4b58829dd" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 46267 } }
I20260808 14:45:31.701561 10429 raft_consensus.cc:388] T 00000000000000000000000000000000 P 578c10ced2184843b5084ac4b58829dd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:45:31.701627 10429 raft_consensus.cc:482] T 00000000000000000000000000000000 P 578c10ced2184843b5084ac4b58829dd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:45:31.701674 10429 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 578c10ced2184843b5084ac4b58829dd [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:31.702365 10429 raft_consensus.cc:504] T 00000000000000000000000000000000 P 578c10ced2184843b5084ac4b58829dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "578c10ced2184843b5084ac4b58829dd" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 46267 } }
I20260808 14:45:31.702486 10429 leader_election.cc:302] T 00000000000000000000000000000000 P 578c10ced2184843b5084ac4b58829dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 578c10ced2184843b5084ac4b58829dd; no voters:
I20260808 14:45:31.702685 10429 leader_election.cc:288] T 00000000000000000000000000000000 P 578c10ced2184843b5084ac4b58829dd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:45:31.702711 10436 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 578c10ced2184843b5084ac4b58829dd [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:45:31.702878 10436 raft_consensus.cc:686] T 00000000000000000000000000000000 P 578c10ced2184843b5084ac4b58829dd [term 1 LEADER]: Becoming Leader. State: Replica: 578c10ced2184843b5084ac4b58829dd, State: Running, Role: LEADER
I20260808 14:45:31.702996 10429 sys_catalog.cc:564] T 00000000000000000000000000000000 P 578c10ced2184843b5084ac4b58829dd [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:45:31.703015 10436 consensus_queue.cc:237] T 00000000000000000000000000000000 P 578c10ced2184843b5084ac4b58829dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "578c10ced2184843b5084ac4b58829dd" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 46267 } }
I20260808 14:45:31.703435 10437 sys_catalog.cc:455] T 00000000000000000000000000000000 P 578c10ced2184843b5084ac4b58829dd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "578c10ced2184843b5084ac4b58829dd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "578c10ced2184843b5084ac4b58829dd" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 46267 } } }
I20260808 14:45:31.703531 10437 sys_catalog.cc:458] T 00000000000000000000000000000000 P 578c10ced2184843b5084ac4b58829dd [sys.catalog]: This master's current role is: LEADER
I20260808 14:45:31.704201 10448 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:45:31.704777 10448 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:45:31.703756 10438 sys_catalog.cc:455] T 00000000000000000000000000000000 P 578c10ced2184843b5084ac4b58829dd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 578c10ced2184843b5084ac4b58829dd. Latest consensus state: current_term: 1 leader_uuid: "578c10ced2184843b5084ac4b58829dd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "578c10ced2184843b5084ac4b58829dd" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 46267 } } }
I20260808 14:45:31.705209 10438 sys_catalog.cc:458] T 00000000000000000000000000000000 P 578c10ced2184843b5084ac4b58829dd [sys.catalog]: This master's current role is: LEADER
I20260808 14:45:31.706656 10448 catalog_manager.cc:1347] Generated new cluster ID: 07a09c30db3e4abca258fc3653158d42
I20260808 14:45:31.706708 10448 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 14:45:31 dist-test-slave-42z9 krb5kdc[10298](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200331, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM
I20260808 14:45:31.712402 10435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:31.698694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50086 (local address 127.30.214.190:46267)
0808 14:45:31.698869 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:31.698878 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:31.701502 (+ 2624us) server_negotiation.cc:407] Connection header received
0808 14:45:31.701717 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:31.701725 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:31.701775 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:31.701888 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:31.702828 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:31.704238 (+ 1410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:31.705118 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:31.705669 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:31.705778 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:31.708532 (+ 2754us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:31.708537 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:31.708537 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:31.708551 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:31.710521 (+ 1970us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:31.710886 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:31.710889 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:31.710889 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:31.711009 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:31.711180 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:31.711180 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:31.711180 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:31.711480 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:31.711610 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:31.712039 (+ 429us) server_negotiation.cc:299] Negotiation successful
0808 14:45:31.712175 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":122,"thread_start_us":81,"threads_started":1}
I20260808 14:45:31.718048 10448 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:45:31.718564 10448 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:45:31.723673 10448 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 578c10ced2184843b5084ac4b58829dd: Generated new TSK 0
I20260808 14:45:31.723850 10448 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.30.214.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.30.214.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.30.214.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/krb5kdc/oryx_127.30.214.129.keytab.
Entry for principal oryx/127.30.214.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/krb5kdc/oryx_127.30.214.129.keytab.
I20260808 14:45:31.750252 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.129:0
--local_ip_for_outbound_sockets=127.30.214.129
--webserver_interface=127.30.214.129
--webserver_port=0
--tserver_master_addrs=127.30.214.190:46267
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/krb5kdc/oryx_127.30.214.129.keytab
--principal=oryx/127.30.214.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:35345
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:45:31.833693 10465 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:45:31.833927 10465 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:45:31.833956 10465 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:45:31.835175 10465 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:45:31.835227 10465 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:45:31.835253 10465 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 14:45:31.835285 10465 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.129
I20260808 14:45:31.836925 10465 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:35345
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/krb5kdc/oryx_127.30.214.129.keytab
--principal=oryx/127.30.214.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.214.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.30.214.190:46267
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10465
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.129
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:45:31.837188 10465 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:45:31.837420 10465 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:45:31.842412 10472 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:31.842412 10473 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:31.842432 10475 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:31.842693 10465 server_base.cc:1034] running on GCE node
I20260808 14:45:31.842947 10465 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:45:31.843200 10465 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:45:31.844375 10465 hybrid_clock.cc:648] HybridClock initialized: now 1786200331844357 us; error 31 us; skew 500 ppm
Aug 08 14:45:31 dist-test-slave-42z9 krb5kdc[10298](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200331, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.214.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:45:31.846988 10465 init.cc:377] Logged in from keytab as oryx/127.30.214.129@KRBTEST.COM (short username oryx)
I20260808 14:45:31.847460 10465 webserver.cc:460] Webserver started at http://127.30.214.129:34349/ using document root <none> and password file <none>
I20260808 14:45:31.847703 10465 fs_manager.cc:359] Metadata directory not provided
I20260808 14:45:31.847756 10465 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:45:31.847887 10465 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:45:31.848953 10465 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/ts-0/data/instance:
uuid: "4dca6cd9810744e493c4879d080285b1"
format_stamp: "Formatted at 2026-08-08 14:45:31 on dist-test-slave-42z9"
server_key: "823ab689cec457c7afca0bc97aae4b0a"
server_key_iv: "3e39aaa9eebe2afe6db913693fe43cdf"
server_key_version: "encryptionkey@0"
I20260808 14:45:31.849300 10465 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/ts-0/wal/instance:
uuid: "4dca6cd9810744e493c4879d080285b1"
format_stamp: "Formatted at 2026-08-08 14:45:31 on dist-test-slave-42z9"
server_key: "823ab689cec457c7afca0bc97aae4b0a"
server_key_iv: "3e39aaa9eebe2afe6db913693fe43cdf"
server_key_version: "encryptionkey@0"
I20260808 14:45:31.850666 10465 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:45:31.851436 10485 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:31.851621 10465 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:45:31.851708 10465 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/ts-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/ts-0/wal
uuid: "4dca6cd9810744e493c4879d080285b1"
format_stamp: "Formatted at 2026-08-08 14:45:31 on dist-test-slave-42z9"
server_key: "823ab689cec457c7afca0bc97aae4b0a"
server_key_iv: "3e39aaa9eebe2afe6db913693fe43cdf"
server_key_version: "encryptionkey@0"
I20260808 14:45:31.851778 10465 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:45:31.858614 10465 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:45:31.860440 10465 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:45:31.860587 10465 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:45:31.861127 10465 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:45:31.861178 10465 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:31.861207 10465 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:45:31.861222 10465 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 14:45:31 dist-test-slave-42z9 krb5kdc[10298](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200331, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.214.129@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM
I20260808 14:45:31.868222 10465 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.129:34711
I20260808 14:45:31.868328 10664 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.129:34711 every 8 connection(s)
I20260808 14:45:31.868621 10465 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
I20260808 14:45:31.871423 10435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:31.861549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.129:33021 (local address 127.30.214.190:46267)
0808 14:45:31.861619 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:31.861621 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:31.861945 (+ 324us) server_negotiation.cc:407] Connection header received
0808 14:45:31.862627 (+ 682us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:31.862628 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:31.862639 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:31.862680 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:31.863559 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:31.864342 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:31.865930 (+ 1588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:31.866188 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:31.866248 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:31.868696 (+ 2448us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:31.868698 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:31.868699 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:31.868708 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:31.870107 (+ 1399us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:31.870498 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:31.870500 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:31.870500 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:31.870560 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:31.870787 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:31.870787 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:31.870788 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:31.870910 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:31.870968 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:31.871240 (+ 272us) server_negotiation.cc:299] Negotiation successful
0808 14:45:31.871332 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 14:45:31.871604 10503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:31.861619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:46267 (local address 127.30.214.129:33021)
0808 14:45:31.861794 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:31.861845 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:31.862503 (+ 658us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:31.862763 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:31.862767 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:31.863146 (+ 379us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:31.863451 (+ 305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:31.863457 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:31.864461 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:31.864463 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:31.865843 (+ 1380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:31.865846 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:31.866272 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:31.866273 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:31.866428 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:31.866998 (+ 570us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:31.867007 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:31.868599 (+ 1592us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:31.870190 (+ 1591us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:31.870198 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:31.870200 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:31.870424 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:31.870615 (+ 191us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:31.870615 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:31.870616 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:31.870727 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:31.870964 (+ 237us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:31.870971 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:31.871113 (+ 142us) client_negotiation.cc:769] Sending connection context
0808 14:45:31.871206 (+ 93us) client_negotiation.cc:240] Negotiation successful
0808 14:45:31.871376 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":78,"threads_started":1}
I20260808 14:45:31.872119 10665 heartbeater.cc:347] Connected to a master server at 127.30.214.190:46267
I20260808 14:45:31.872212 10665 heartbeater.cc:464] Registering TS with master...
I20260808 14:45:31.872392 10665 heartbeater.cc:511] Master 127.30.214.190:46267 requested a full tablet report, sending...
I20260808 14:45:31.872982 10360 ts_manager.cc:194] Registered new tserver with Master: 4dca6cd9810744e493c4879d080285b1 (127.30.214.129:34711)
I20260808 14:45:31.873900 10360 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.30.214.129@KRBTEST.COM'} at 127.30.214.129:33021
I20260808 14:45:31.876047 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 10465
I20260808 14:45:31.876157 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/ts-0/wal/instance
I20260808 14:45:31.876371 31578 external_mini_cluster.cc:1428] Setting key a8109ca3e4ee7ded85e021e350846120
I20260808 14:45:31.878723 10675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:31.873109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:46267 (local address 127.30.214.129:35207)
0808 14:45:31.873245 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:31.873257 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:31.873315 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:31.873431 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:31.873432 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:31.873654 (+ 222us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:31.873724 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:31.873725 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:31.874501 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:31.874503 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:31.875084 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:31.875086 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:31.875420 (+ 334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:31.875421 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:31.875515 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:31.875911 (+ 396us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:31.875915 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:31.876268 (+ 353us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:31.877752 (+ 1484us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:31.877753 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:31.877754 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:31.877920 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:31.878098 (+ 178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:31.878099 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:31.878099 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:31.878159 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:31.878370 (+ 211us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:31.878371 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:31.878422 (+ 51us) client_negotiation.cc:769] Sending connection context
0808 14:45:31.878502 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 14:45:31.878614 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":67,"threads_started":1}
I20260808 14:45:31.878938 10435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:31.873263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.129:35207 (local address 127.30.214.190:46267)
0808 14:45:31.873299 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:31.873300 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:31.873309 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:45:31.873373 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:31.873374 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:31.873382 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:31.873423 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:31.873786 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:31.874407 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:31.875157 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:31.875362 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:31.875417 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:31.876340 (+ 923us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:31.876341 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:31.876342 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:31.876349 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:31.877680 (+ 1331us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:31.877989 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:31.877990 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:31.877990 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:31.878046 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:31.878209 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:31.878210 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:31.878210 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:31.878319 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:31.878375 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:31.878527 (+ 152us) server_negotiation.cc:299] Negotiation successful
0808 14:45:31.878771 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
WARNING: no policy specified for oryx/127.30.214.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.30.214.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.30.214.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/krb5kdc/oryx_127.30.214.130.keytab.
Entry for principal oryx/127.30.214.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/krb5kdc/oryx_127.30.214.130.keytab.
I20260808 14:45:31.902403 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.130:0
--local_ip_for_outbound_sockets=127.30.214.130
--webserver_interface=127.30.214.130
--webserver_port=0
--tserver_master_addrs=127.30.214.190:46267
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/krb5kdc/oryx_127.30.214.130.keytab
--principal=oryx/127.30.214.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:35345
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:45:31.985114 10681 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:45:31.985337 10681 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:45:31.985371 10681 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:45:31.986603 10681 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:45:31.986655 10681 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:45:31.986685 10681 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 14:45:31.986707 10681 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.130
I20260808 14:45:31.988322 10681 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:35345
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/krb5kdc/oryx_127.30.214.130.keytab
--principal=oryx/127.30.214.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.214.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.30.214.190:46267
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10681
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.130
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:45:31.988591 10681 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:45:31.988812 10681 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:45:31.993767 10693 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:31.993779 10691 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:31.993762 10689 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:31.994123 10681 server_base.cc:1034] running on GCE node
I20260808 14:45:31.994331 10681 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:45:31.994560 10681 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:45:31.995709 10681 hybrid_clock.cc:648] HybridClock initialized: now 1786200331995692 us; error 31 us; skew 500 ppm
Aug 08 14:45:31 dist-test-slave-42z9 krb5kdc[10298](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200331, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.214.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:45:31.998253 10681 init.cc:377] Logged in from keytab as oryx/127.30.214.130@KRBTEST.COM (short username oryx)
I20260808 14:45:31.998735 10681 webserver.cc:460] Webserver started at http://127.30.214.130:37979/ using document root <none> and password file <none>
I20260808 14:45:31.998940 10681 fs_manager.cc:359] Metadata directory not provided
I20260808 14:45:31.998989 10681 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:45:31.999119 10681 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:45:32.000202 10681 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/ts-1/data/instance:
uuid: "a99a92d079d84236bcdbd8ff5f0ddfad"
format_stamp: "Formatted at 2026-08-08 14:45:31 on dist-test-slave-42z9"
server_key: "f810a0c36db6c4c5822aab7c457db42c"
server_key_iv: "be3234eae9cbc2a7610a65e78b4dcabf"
server_key_version: "encryptionkey@0"
I20260808 14:45:32.000546 10681 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/ts-1/wal/instance:
uuid: "a99a92d079d84236bcdbd8ff5f0ddfad"
format_stamp: "Formatted at 2026-08-08 14:45:31 on dist-test-slave-42z9"
server_key: "f810a0c36db6c4c5822aab7c457db42c"
server_key_iv: "be3234eae9cbc2a7610a65e78b4dcabf"
server_key_version: "encryptionkey@0"
I20260808 14:45:32.001869 10681 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260808 14:45:32.002547 10703 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:32.002719 10681 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:45:32.002792 10681 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/ts-1/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/ts-1/wal
uuid: "a99a92d079d84236bcdbd8ff5f0ddfad"
format_stamp: "Formatted at 2026-08-08 14:45:31 on dist-test-slave-42z9"
server_key: "f810a0c36db6c4c5822aab7c457db42c"
server_key_iv: "be3234eae9cbc2a7610a65e78b4dcabf"
server_key_version: "encryptionkey@0"
I20260808 14:45:32.002851 10681 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:45:32.013715 10681 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:45:32.015559 10681 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:45:32.015682 10681 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:45:32.016171 10681 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:45:32.016213 10681 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:32.016237 10681 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:45:32.016249 10681 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:32.022989 10681 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.130:34247
Aug 08 14:45:32 dist-test-slave-42z9 krb5kdc[10298](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200331, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.214.130@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM
I20260808 14:45:32.023145 10865 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.130:34247 every 8 connection(s)
I20260808 14:45:32.023432 10681 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
I20260808 14:45:32.026278 10435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:32.016663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.130:34845 (local address 127.30.214.190:46267)
0808 14:45:32.016733 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:32.016735 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:32.016894 (+ 159us) server_negotiation.cc:407] Connection header received
0808 14:45:32.017406 (+ 512us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:32.017408 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:32.017422 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:32.017533 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:32.018379 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.019156 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.020684 (+ 1528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.020992 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.021068 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:32.023700 (+ 2632us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:32.023702 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:32.023702 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:32.023711 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:32.024893 (+ 1182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:32.025299 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:32.025301 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:32.025301 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:32.025365 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:32.025623 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:32.025624 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:32.025624 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:32.025750 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:32.025809 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:32.026086 (+ 277us) server_negotiation.cc:299] Negotiation successful
0808 14:45:32.026185 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 14:45:32.026454 10715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:32.016611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:46267 (local address 127.30.214.130:34845)
0808 14:45:32.016767 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:32.016808 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:32.017303 (+ 495us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:32.017605 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:32.017610 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:32.017950 (+ 340us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:32.018245 (+ 295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:32.018253 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.019279 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.019280 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:32.020577 (+ 1297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:32.020581 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.021092 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.021093 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:32.021215 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:32.021789 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:32.021800 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:32.023606 (+ 1806us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:32.024979 (+ 1373us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:32.024996 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:32.024999 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:32.025227 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:32.025420 (+ 193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:32.025421 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:32.025422 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:32.025565 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:32.025807 (+ 242us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:32.025814 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:32.025955 (+ 141us) client_negotiation.cc:769] Sending connection context
0808 14:45:32.026053 (+ 98us) client_negotiation.cc:240] Negotiation successful
0808 14:45:32.026225 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":87,"threads_started":1}
I20260808 14:45:32.026921 10866 heartbeater.cc:347] Connected to a master server at 127.30.214.190:46267
I20260808 14:45:32.027019 10866 heartbeater.cc:464] Registering TS with master...
I20260808 14:45:32.027205 10866 heartbeater.cc:511] Master 127.30.214.190:46267 requested a full tablet report, sending...
I20260808 14:45:32.027635 10362 ts_manager.cc:194] Registered new tserver with Master: a99a92d079d84236bcdbd8ff5f0ddfad (127.30.214.130:34247)
I20260808 14:45:32.028050 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 10681
I20260808 14:45:32.028075 10362 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.30.214.130@KRBTEST.COM'} at 127.30.214.130:34845
I20260808 14:45:32.028173 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/ts-1/wal/instance
I20260808 14:45:32.028371 31578 external_mini_cluster.cc:1428] Setting key d23a8ae9479ceeefa80081566f579e06
I20260808 14:45:32.034236 10872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:32.027953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:46267 (local address 127.30.214.130:56905)
0808 14:45:32.028122 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:32.028134 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:32.028240 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:32.028412 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:32.028413 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:32.028617 (+ 204us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:32.028702 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:32.028705 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.029623 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.029624 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:32.030324 (+ 700us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:32.030327 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.030692 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.030693 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:32.030769 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:32.031230 (+ 461us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:32.031236 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:32.031632 (+ 396us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:32.033169 (+ 1537us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:32.033170 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:32.033170 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:32.033332 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:32.033573 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:32.033573 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:32.033574 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:32.033625 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:32.033974 (+ 349us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:32.033975 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:32.034019 (+ 44us) client_negotiation.cc:769] Sending connection context
0808 14:45:32.034065 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 14:45:32.034154 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":92,"threads_started":1}
I20260808 14:45:32.034279 10435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:32.028144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.130:56905 (local address 127.30.214.190:46267)
0808 14:45:32.028203 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:32.028205 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:32.028213 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:45:32.028318 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:32.028319 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:32.028331 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:32.028410 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:32.028774 (+ 364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.029527 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.030413 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.030610 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.030676 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:32.031717 (+ 1041us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:32.031718 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:32.031718 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:32.031726 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:32.033086 (+ 1360us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:32.033406 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:32.033407 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:32.033407 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:32.033509 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:32.033685 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:32.033686 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:32.033686 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:32.033897 (+ 211us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:32.033986 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:32.034103 (+ 117us) server_negotiation.cc:299] Negotiation successful
0808 14:45:32.034187 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
WARNING: no policy specified for oryx/127.30.214.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.30.214.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.30.214.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/krb5kdc/oryx_127.30.214.131.keytab.
Entry for principal oryx/127.30.214.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/krb5kdc/oryx_127.30.214.131.keytab.
I20260808 14:45:32.056806 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.131:0
--local_ip_for_outbound_sockets=127.30.214.131
--webserver_interface=127.30.214.131
--webserver_port=0
--tserver_master_addrs=127.30.214.190:46267
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/krb5kdc/oryx_127.30.214.131.keytab
--principal=oryx/127.30.214.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:35345
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:45:32.141530 10875 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:45:32.141762 10875 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:45:32.141788 10875 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:45:32.142997 10875 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:45:32.143043 10875 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:45:32.143064 10875 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 14:45:32.143080 10875 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.131
I20260808 14:45:32.144654 10875 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:35345
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/krb5kdc/oryx_127.30.214.131.keytab
--principal=oryx/127.30.214.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.214.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.30.214.190:46267
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10875
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.131
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:45:32.144876 10875 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:45:32.145069 10875 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:45:32.150825 10883 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:32.150820 10882 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:32.150820 10887 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:32.151086 10875 server_base.cc:1034] running on GCE node
I20260808 14:45:32.151321 10875 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:45:32.151566 10875 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:45:32.152704 10875 hybrid_clock.cc:648] HybridClock initialized: now 1786200332152689 us; error 28 us; skew 500 ppm
Aug 08 14:45:32 dist-test-slave-42z9 krb5kdc[10298](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200332, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.214.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:45:32.155267 10875 init.cc:377] Logged in from keytab as oryx/127.30.214.131@KRBTEST.COM (short username oryx)
I20260808 14:45:32.155706 10875 webserver.cc:460] Webserver started at http://127.30.214.131:40937/ using document root <none> and password file <none>
I20260808 14:45:32.155908 10875 fs_manager.cc:359] Metadata directory not provided
I20260808 14:45:32.155947 10875 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:45:32.156046 10875 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:45:32.157069 10875 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/ts-2/data/instance:
uuid: "5d6010dd8b8f4fe58796523605f77a17"
format_stamp: "Formatted at 2026-08-08 14:45:32 on dist-test-slave-42z9"
server_key: "3d773783dec34cf9fb57475985261e1a"
server_key_iv: "e9e3a7341e1043c71716327bf243e986"
server_key_version: "encryptionkey@0"
I20260808 14:45:32.157368 10875 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/ts-2/wal/instance:
uuid: "5d6010dd8b8f4fe58796523605f77a17"
format_stamp: "Formatted at 2026-08-08 14:45:32 on dist-test-slave-42z9"
server_key: "3d773783dec34cf9fb57475985261e1a"
server_key_iv: "e9e3a7341e1043c71716327bf243e986"
server_key_version: "encryptionkey@0"
I20260808 14:45:32.158751 10875 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:45:32.159483 10900 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:32.159660 10875 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:45:32.159746 10875 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/ts-2/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/ts-2/wal
uuid: "5d6010dd8b8f4fe58796523605f77a17"
format_stamp: "Formatted at 2026-08-08 14:45:32 on dist-test-slave-42z9"
server_key: "3d773783dec34cf9fb57475985261e1a"
server_key_iv: "e9e3a7341e1043c71716327bf243e986"
server_key_version: "encryptionkey@0"
I20260808 14:45:32.159806 10875 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:45:32.180220 10875 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:45:32.182412 10875 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:45:32.182546 10875 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:45:32.183079 10875 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:45:32.183125 10875 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:32.183149 10875 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:45:32.183161 10875 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:32.189714 10875 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.131:43057
I20260808 14:45:32.189793 11069 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.131:43057 every 8 connection(s)
Aug 08 14:45:32 dist-test-slave-42z9 krb5kdc[10298](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200332, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.214.131@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM
I20260808 14:45:32.190102 10875 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
I20260808 14:45:32.192904 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 10875
I20260808 14:45:32.192905 10435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:32.183594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:60639 (local address 127.30.214.190:46267)
0808 14:45:32.183647 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:32.183649 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:32.183886 (+ 237us) server_negotiation.cc:407] Connection header received
0808 14:45:32.184403 (+ 517us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:32.184406 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:32.184422 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:32.184496 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:32.185376 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.186194 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.187695 (+ 1501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.187978 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.188073 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:32.190605 (+ 2532us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:32.190607 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:32.190607 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:32.190615 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:32.191736 (+ 1121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:32.192134 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:32.192134 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:32.192135 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:32.192179 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:32.192343 (+ 164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:32.192343 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:32.192343 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:32.192442 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:32.192485 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:32.192726 (+ 241us) server_negotiation.cc:299] Negotiation successful
0808 14:45:32.192812 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 14:45:32.193014 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/ts-2/wal/instance
I20260808 14:45:32.192994 10914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:32.183592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:46267 (local address 127.30.214.131:60639)
0808 14:45:32.183752 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:32.183789 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:32.184303 (+ 514us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:32.184565 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:32.184570 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:32.184949 (+ 379us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:32.185262 (+ 313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:32.185269 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.186283 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.186284 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:32.187590 (+ 1306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:32.187593 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.188076 (+ 483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.188077 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:32.188183 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:32.188752 (+ 569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:32.188762 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:32.190520 (+ 1758us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:32.191825 (+ 1305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:32.191832 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:32.191834 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:32.192071 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:32.192215 (+ 144us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:32.192216 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:32.192216 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:32.192303 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:32.192487 (+ 184us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:32.192490 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:32.192607 (+ 117us) client_negotiation.cc:769] Sending connection context
0808 14:45:32.192688 (+ 81us) client_negotiation.cc:240] Negotiation successful
0808 14:45:32.192812 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":83,"threads_started":1}
I20260808 14:45:32.193230 31578 external_mini_cluster.cc:1428] Setting key 175d1da9f4e966d3d17d6d73af0c3430
I20260808 14:45:32.193524 11070 heartbeater.cc:347] Connected to a master server at 127.30.214.190:46267
I20260808 14:45:32.193616 11070 heartbeater.cc:464] Registering TS with master...
I20260808 14:45:32.193794 11070 heartbeater.cc:511] Master 127.30.214.190:46267 requested a full tablet report, sending...
I20260808 14:45:32.194180 10362 ts_manager.cc:194] Registered new tserver with Master: 5d6010dd8b8f4fe58796523605f77a17 (127.30.214.131:43057)
I20260808 14:45:32.194540 10362 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.30.214.131@KRBTEST.COM'} at 127.30.214.131:60639
I20260808 14:45:32.195048 31578 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:45:32.200812 11076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:32.194594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:46267 (local address 127.30.214.131:56569)
0808 14:45:32.194829 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:32.194841 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:32.195369 (+ 528us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:32.195485 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:32.195486 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:32.195663 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:32.195720 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:32.195722 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.196351 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.196352 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:32.196861 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:32.196863 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.197289 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.197290 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:32.197359 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:32.197846 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:32.197851 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:32.198182 (+ 331us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:32.199780 (+ 1598us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:32.199781 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:32.199781 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:32.199988 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:32.200196 (+ 208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:32.200197 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:32.200197 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:32.200248 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:32.200499 (+ 251us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:32.200499 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:32.200566 (+ 67us) client_negotiation.cc:769] Sending connection context
0808 14:45:32.200613 (+ 47us) client_negotiation.cc:240] Negotiation successful
0808 14:45:32.200707 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":67,"threads_started":1}
I20260808 14:45:32.200829 10435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:32.194657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:56569 (local address 127.30.214.190:46267)
0808 14:45:32.194724 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:32.194726 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:32.195369 (+ 643us) server_negotiation.cc:407] Connection header received
0808 14:45:32.195424 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:32.195425 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:32.195435 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:32.195481 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:32.195785 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.196260 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.196937 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.197203 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.197268 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:32.198270 (+ 1002us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:32.198271 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:32.198271 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:32.198278 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:32.199679 (+ 1401us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:32.200065 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:32.200066 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:32.200067 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:32.200132 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:32.200297 (+ 165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:32.200297 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:32.200297 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:32.200442 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:32.200514 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:32.200653 (+ 139us) server_negotiation.cc:299] Negotiation successful
0808 14:45:32.200734 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
Aug 08 14:45:32 dist-test-slave-42z9 krb5kdc[10298](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200332, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 14:45:32 dist-test-slave-42z9 krb5kdc[10298](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:45:32 dist-test-slave-42z9 krb5kdc[10298](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
W20260808 14:45:32.218225 10435 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:45:32.213217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50100 (local address 127.30.214.190:46267)
0808 14:45:32.213277 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:32.213279 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:32.213288 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:45:32.213313 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:32.213314 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:32.213323 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:32.213371 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:32.213919 (+ 548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.214409 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.215074 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.215249 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.215292 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:32.218140 (+ 2848us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50100: BlockingRecv error: recv got EOF from 127.0.0.1:50100 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
Aug 08 14:45:32 dist-test-slave-42z9 krb5kdc[10298](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200332, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM
I20260808 14:45:32.225291 10435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:32.219023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50104 (local address 127.30.214.190:46267)
0808 14:45:32.219086 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:32.219088 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:32.219156 (+ 68us) server_negotiation.cc:407] Connection header received
0808 14:45:32.219215 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:32.219215 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:32.219226 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:32.219278 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:32.219743 (+ 465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.220224 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.220890 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.221078 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.221133 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:32.223163 (+ 2030us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:32.223165 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:32.223165 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:32.223172 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:32.224444 (+ 1272us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:32.224742 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:32.224743 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:32.224743 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:32.224788 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:32.224920 (+ 132us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:32.224920 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:32.224920 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:32.225019 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:32.225089 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:32.225164 (+ 75us) server_negotiation.cc:299] Negotiation successful
0808 14:45:32.225221 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 14:45:32.226861 10362 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50104:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:45:32.228600 10362 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:45:32.235035 11098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:32.230801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.131:43057 (local address 127.0.0.1:50864)
0808 14:45:32.231110 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:32.231122 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:32.231174 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:32.231350 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:32.231353 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:32.231354 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:45:32.231413 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:32.231415 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.232752 (+ 1337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.232753 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:32.234071 (+ 1318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:32.234073 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.234708 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.234709 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:32.234804 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:32.234819 (+ 15us) client_negotiation.cc:769] Sending connection context
0808 14:45:32.234886 (+ 67us) client_negotiation.cc:240] Negotiation successful
0808 14:45:32.234945 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":295,"thread_start_us":101,"threads_started":1}
I20260808 14:45:32.235049 11106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:32.230967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50864 (local address 127.30.214.131:43057)
0808 14:45:32.231170 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:32.231175 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:32.231187 (+ 12us) server_negotiation.cc:407] Connection header received
0808 14:45:32.231240 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:32.231242 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:32.231258 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:32.231337 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:45:32.231512 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.232669 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.234156 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.234627 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.234717 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:32.234782 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:32.234910 (+ 128us) server_negotiation.cc:299] Negotiation successful
0808 14:45:32.234956 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":101,"threads_started":1}
I20260808 14:45:32.235255 11100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:32.230797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.130:34247 (local address 127.0.0.1:43452)
0808 14:45:32.230955 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:32.231000 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:32.231070 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:32.231604 (+ 534us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:32.231605 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:32.231607 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:45:32.231652 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:32.231654 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.232872 (+ 1218us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.232873 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:32.234020 (+ 1147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:32.234022 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.235017 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.235019 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:32.235081 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:32.235085 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:45:32.235133 (+ 48us) client_negotiation.cc:240] Negotiation successful
0808 14:45:32.235175 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"mutex_wait_us":3,"thread_start_us":51,"threads_started":1}
I20260808 14:45:32.235576 11102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:32.230922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43452 (local address 127.30.214.130:34247)
0808 14:45:32.231461 (+ 539us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:32.231464 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:32.231472 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:45:32.231501 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:32.231503 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:32.231518 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:32.231593 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:45:32.231731 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.232787 (+ 1056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.234107 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.234847 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.234930 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:32.234982 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:32.235420 (+ 438us) server_negotiation.cc:299] Negotiation successful
0808 14:45:32.235464 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":499,"thread_start_us":91,"threads_started":1}
I20260808 14:45:32.235786 10974 tablet_service.cc:1467] Processing CreateTablet for tablet b2d0ba698bb347fea3c00172f7bd00c2 (DEFAULT_TABLE table=test-table [id=393ee10b6bff4d06827f5071912291bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:45:32.236186 10974 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b2d0ba698bb347fea3c00172f7bd00c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:45:32.236233 10774 tablet_service.cc:1467] Processing CreateTablet for tablet b2d0ba698bb347fea3c00172f7bd00c2 (DEFAULT_TABLE table=test-table [id=393ee10b6bff4d06827f5071912291bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:45:32.236560 10774 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b2d0ba698bb347fea3c00172f7bd00c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:45:32.237830 11103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:32.230989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.129:34711 (local address 127.0.0.1:57890)
0808 14:45:32.231681 (+ 692us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:32.231691 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:32.231738 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:32.231930 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:32.231931 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:32.231933 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:45:32.231978 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:32.231980 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.233507 (+ 1527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.233508 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:32.234706 (+ 1198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:32.234710 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.237583 (+ 2873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.237585 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:32.237654 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:32.237659 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 14:45:32.237715 (+ 56us) client_negotiation.cc:240] Negotiation successful
0808 14:45:32.237759 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":672,"thread_start_us":88,"threads_started":1}
I20260808 14:45:32.238109 11107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:32.231246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57890 (local address 127.30.214.129:34711)
0808 14:45:32.231542 (+ 296us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:32.231547 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:32.231794 (+ 247us) server_negotiation.cc:407] Connection header received
0808 14:45:32.231838 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:32.231840 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:32.231854 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:32.231923 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:45:32.232033 (+ 110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.232774 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.234811 (+ 2037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.235798 (+ 987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.235887 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:32.235942 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:32.237949 (+ 2007us) server_negotiation.cc:299] Negotiation successful
0808 14:45:32.237999 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":258,"thread_start_us":80,"threads_started":1}
I20260808 14:45:32.238822 10561 tablet_service.cc:1467] Processing CreateTablet for tablet b2d0ba698bb347fea3c00172f7bd00c2 (DEFAULT_TABLE table=test-table [id=393ee10b6bff4d06827f5071912291bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:45:32.239238 10561 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b2d0ba698bb347fea3c00172f7bd00c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:45:32.239785 11108 tablet_bootstrap.cc:492] T b2d0ba698bb347fea3c00172f7bd00c2 P 5d6010dd8b8f4fe58796523605f77a17: Bootstrap starting.
I20260808 14:45:32.240288 11112 tablet_bootstrap.cc:492] T b2d0ba698bb347fea3c00172f7bd00c2 P a99a92d079d84236bcdbd8ff5f0ddfad: Bootstrap starting.
I20260808 14:45:32.240634 11108 tablet_bootstrap.cc:654] T b2d0ba698bb347fea3c00172f7bd00c2 P 5d6010dd8b8f4fe58796523605f77a17: Neither blocks nor log segments found. Creating new log.
I20260808 14:45:32.240921 11112 tablet_bootstrap.cc:654] T b2d0ba698bb347fea3c00172f7bd00c2 P a99a92d079d84236bcdbd8ff5f0ddfad: Neither blocks nor log segments found. Creating new log.
I20260808 14:45:32.241009 11108 log.cc:824] T b2d0ba698bb347fea3c00172f7bd00c2 P 5d6010dd8b8f4fe58796523605f77a17: Log is configured to *not* fsync() on all Append() calls
I20260808 14:45:32.241247 11112 log.cc:824] T b2d0ba698bb347fea3c00172f7bd00c2 P a99a92d079d84236bcdbd8ff5f0ddfad: Log is configured to *not* fsync() on all Append() calls
I20260808 14:45:32.241842 11108 tablet_bootstrap.cc:492] T b2d0ba698bb347fea3c00172f7bd00c2 P 5d6010dd8b8f4fe58796523605f77a17: No bootstrap required, opened a new log
I20260808 14:45:32.241909 11108 ts_tablet_manager.cc:1397] T b2d0ba698bb347fea3c00172f7bd00c2 P 5d6010dd8b8f4fe58796523605f77a17: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:45:32.242081 11112 tablet_bootstrap.cc:492] T b2d0ba698bb347fea3c00172f7bd00c2 P a99a92d079d84236bcdbd8ff5f0ddfad: No bootstrap required, opened a new log
I20260808 14:45:32.242156 11112 ts_tablet_manager.cc:1397] T b2d0ba698bb347fea3c00172f7bd00c2 P a99a92d079d84236bcdbd8ff5f0ddfad: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260808 14:45:32.243178 11115 tablet_bootstrap.cc:492] T b2d0ba698bb347fea3c00172f7bd00c2 P 4dca6cd9810744e493c4879d080285b1: Bootstrap starting.
I20260808 14:45:32.243537 11108 raft_consensus.cc:348] T b2d0ba698bb347fea3c00172f7bd00c2 P 5d6010dd8b8f4fe58796523605f77a17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 34247 } } peers { permanent_uuid: "4dca6cd9810744e493c4879d080285b1" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34711 } } peers { permanent_uuid: "5d6010dd8b8f4fe58796523605f77a17" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 43057 } }
I20260808 14:45:32.243718 11108 raft_consensus.cc:374] T b2d0ba698bb347fea3c00172f7bd00c2 P 5d6010dd8b8f4fe58796523605f77a17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:45:32.243755 11108 raft_consensus.cc:729] T b2d0ba698bb347fea3c00172f7bd00c2 P 5d6010dd8b8f4fe58796523605f77a17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d6010dd8b8f4fe58796523605f77a17, State: Initialized, Role: FOLLOWER
I20260808 14:45:32.243901 11108 consensus_queue.cc:260] T b2d0ba698bb347fea3c00172f7bd00c2 P 5d6010dd8b8f4fe58796523605f77a17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 34247 } } peers { permanent_uuid: "4dca6cd9810744e493c4879d080285b1" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34711 } } peers { permanent_uuid: "5d6010dd8b8f4fe58796523605f77a17" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 43057 } }
I20260808 14:45:32.243981 11115 tablet_bootstrap.cc:654] T b2d0ba698bb347fea3c00172f7bd00c2 P 4dca6cd9810744e493c4879d080285b1: Neither blocks nor log segments found. Creating new log.
I20260808 14:45:32.244004 11112 raft_consensus.cc:348] T b2d0ba698bb347fea3c00172f7bd00c2 P a99a92d079d84236bcdbd8ff5f0ddfad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 34247 } } peers { permanent_uuid: "4dca6cd9810744e493c4879d080285b1" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34711 } } peers { permanent_uuid: "5d6010dd8b8f4fe58796523605f77a17" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 43057 } }
I20260808 14:45:32.244151 11112 raft_consensus.cc:374] T b2d0ba698bb347fea3c00172f7bd00c2 P a99a92d079d84236bcdbd8ff5f0ddfad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:45:32.244189 11112 raft_consensus.cc:729] T b2d0ba698bb347fea3c00172f7bd00c2 P a99a92d079d84236bcdbd8ff5f0ddfad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a99a92d079d84236bcdbd8ff5f0ddfad, State: Initialized, Role: FOLLOWER
I20260808 14:45:32.244197 11108 ts_tablet_manager.cc:1428] T b2d0ba698bb347fea3c00172f7bd00c2 P 5d6010dd8b8f4fe58796523605f77a17: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 14:45:32.244310 11070 heartbeater.cc:503] Master 127.30.214.190:46267 was elected leader, sending a full tablet report...
I20260808 14:45:32.244292 11112 consensus_queue.cc:260] T b2d0ba698bb347fea3c00172f7bd00c2 P a99a92d079d84236bcdbd8ff5f0ddfad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 34247 } } peers { permanent_uuid: "4dca6cd9810744e493c4879d080285b1" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34711 } } peers { permanent_uuid: "5d6010dd8b8f4fe58796523605f77a17" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 43057 } }
I20260808 14:45:32.244540 11112 ts_tablet_manager.cc:1428] T b2d0ba698bb347fea3c00172f7bd00c2 P a99a92d079d84236bcdbd8ff5f0ddfad: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260808 14:45:32.244570 10866 heartbeater.cc:503] Master 127.30.214.190:46267 was elected leader, sending a full tablet report...
I20260808 14:45:32.244688 11115 log.cc:824] T b2d0ba698bb347fea3c00172f7bd00c2 P 4dca6cd9810744e493c4879d080285b1: Log is configured to *not* fsync() on all Append() calls
I20260808 14:45:32.245676 11115 tablet_bootstrap.cc:492] T b2d0ba698bb347fea3c00172f7bd00c2 P 4dca6cd9810744e493c4879d080285b1: No bootstrap required, opened a new log
I20260808 14:45:32.245739 11115 ts_tablet_manager.cc:1397] T b2d0ba698bb347fea3c00172f7bd00c2 P 4dca6cd9810744e493c4879d080285b1: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260808 14:45:32.247112 11115 raft_consensus.cc:348] T b2d0ba698bb347fea3c00172f7bd00c2 P 4dca6cd9810744e493c4879d080285b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 34247 } } peers { permanent_uuid: "4dca6cd9810744e493c4879d080285b1" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34711 } } peers { permanent_uuid: "5d6010dd8b8f4fe58796523605f77a17" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 43057 } }
I20260808 14:45:32.247249 11115 raft_consensus.cc:374] T b2d0ba698bb347fea3c00172f7bd00c2 P 4dca6cd9810744e493c4879d080285b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:45:32.247269 11115 raft_consensus.cc:729] T b2d0ba698bb347fea3c00172f7bd00c2 P 4dca6cd9810744e493c4879d080285b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dca6cd9810744e493c4879d080285b1, State: Initialized, Role: FOLLOWER
I20260808 14:45:32.247362 11115 consensus_queue.cc:260] T b2d0ba698bb347fea3c00172f7bd00c2 P 4dca6cd9810744e493c4879d080285b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 34247 } } peers { permanent_uuid: "4dca6cd9810744e493c4879d080285b1" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34711 } } peers { permanent_uuid: "5d6010dd8b8f4fe58796523605f77a17" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 43057 } }
I20260808 14:45:32.247599 11115 ts_tablet_manager.cc:1428] T b2d0ba698bb347fea3c00172f7bd00c2 P 4dca6cd9810744e493c4879d080285b1: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260808 14:45:32.247661 10665 heartbeater.cc:503] Master 127.30.214.190:46267 was elected leader, sending a full tablet report...
W20260808 14:45:32.274173 10867 tablet.cc:2369] T b2d0ba698bb347fea3c00172f7bd00c2 P a99a92d079d84236bcdbd8ff5f0ddfad: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:45:32.369632 10666 tablet.cc:2369] T b2d0ba698bb347fea3c00172f7bd00c2 P 4dca6cd9810744e493c4879d080285b1: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:45:32.440775 11071 tablet.cc:2369] T b2d0ba698bb347fea3c00172f7bd00c2 P 5d6010dd8b8f4fe58796523605f77a17: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:45:32.488440 11123 raft_consensus.cc:482] T b2d0ba698bb347fea3c00172f7bd00c2 P 4dca6cd9810744e493c4879d080285b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:45:32.488590 11123 raft_consensus.cc:504] T b2d0ba698bb347fea3c00172f7bd00c2 P 4dca6cd9810744e493c4879d080285b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 34247 } } peers { permanent_uuid: "4dca6cd9810744e493c4879d080285b1" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34711 } } peers { permanent_uuid: "5d6010dd8b8f4fe58796523605f77a17" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 43057 } }
I20260808 14:45:32.488965 11123 leader_election.cc:288] T b2d0ba698bb347fea3c00172f7bd00c2 P 4dca6cd9810744e493c4879d080285b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a99a92d079d84236bcdbd8ff5f0ddfad (127.30.214.130:34247), 5d6010dd8b8f4fe58796523605f77a17 (127.30.214.131:43057)
I20260808 14:45:32.492772 11128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:32.489169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.130:34247 (local address 127.30.214.129:55865)
0808 14:45:32.489299 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:32.489311 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:32.489410 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:32.489594 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:32.489595 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:32.489597 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:45:32.489702 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:32.489704 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.490345 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.490353 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:32.491222 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:32.491225 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.492323 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.492324 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:32.492442 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:32.492447 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 14:45:32.492500 (+ 53us) client_negotiation.cc:240] Negotiation successful
0808 14:45:32.492578 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"mutex_wait_us":67,"thread_start_us":63,"threads_started":1}
I20260808 14:45:32.492895 11102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:32.489265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.129:55865 (local address 127.30.214.130:34247)
0808 14:45:32.489332 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:32.489334 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:32.489402 (+ 68us) server_negotiation.cc:407] Connection header received
0808 14:45:32.489516 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:32.489518 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:32.489528 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:32.489581 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:45:32.489773 (+ 192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.490261 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.491523 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.492151 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.492219 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:32.492233 (+ 14us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:32.492564 (+ 331us) server_negotiation.cc:299] Negotiation successful
0808 14:45:32.492654 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 14:45:32.492894 11106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:32.489336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.129:39627 (local address 127.30.214.131:43057)
0808 14:45:32.489394 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:32.489396 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:32.489456 (+ 60us) server_negotiation.cc:407] Connection header received
0808 14:45:32.489548 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:32.489549 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:32.489556 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:32.489609 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:45:32.489770 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.490252 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.491439 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.492133 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.492227 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:32.492237 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:32.492680 (+ 443us) server_negotiation.cc:299] Negotiation successful
0808 14:45:32.492793 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 14:45:32.493266 11130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:32.489169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.131:43057 (local address 127.30.214.129:39627)
0808 14:45:32.489355 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:32.489366 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:32.489471 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:32.489612 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:32.489613 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:32.489615 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:45:32.489706 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:32.489707 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.490346 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.490347 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:32.491222 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:32.491225 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.492317 (+ 1092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.492319 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:32.492450 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:32.492501 (+ 51us) client_negotiation.cc:769] Sending connection context
0808 14:45:32.493030 (+ 529us) client_negotiation.cc:240] Negotiation successful
0808 14:45:32.493127 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168,"mutex_wait_us":44,"thread_start_us":65,"threads_started":1}
I20260808 14:45:32.493352 10802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2d0ba698bb347fea3c00172f7bd00c2" candidate_uuid: "4dca6cd9810744e493c4879d080285b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad" is_pre_election: true
I20260808 14:45:32.493566 10802 raft_consensus.cc:2454] T b2d0ba698bb347fea3c00172f7bd00c2 P a99a92d079d84236bcdbd8ff5f0ddfad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dca6cd9810744e493c4879d080285b1 in term 0.
I20260808 14:45:32.493845 10487 leader_election.cc:302] T b2d0ba698bb347fea3c00172f7bd00c2 P 4dca6cd9810744e493c4879d080285b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dca6cd9810744e493c4879d080285b1, a99a92d079d84236bcdbd8ff5f0ddfad; no voters:
I20260808 14:45:32.493985 11002 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2d0ba698bb347fea3c00172f7bd00c2" candidate_uuid: "4dca6cd9810744e493c4879d080285b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d6010dd8b8f4fe58796523605f77a17" is_pre_election: true
I20260808 14:45:32.494154 11123 raft_consensus.cc:2781] T b2d0ba698bb347fea3c00172f7bd00c2 P 4dca6cd9810744e493c4879d080285b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:45:32.494218 11002 raft_consensus.cc:2454] T b2d0ba698bb347fea3c00172f7bd00c2 P 5d6010dd8b8f4fe58796523605f77a17 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dca6cd9810744e493c4879d080285b1 in term 0.
I20260808 14:45:32.494226 11123 raft_consensus.cc:482] T b2d0ba698bb347fea3c00172f7bd00c2 P 4dca6cd9810744e493c4879d080285b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:45:32.494278 11123 raft_consensus.cc:3037] T b2d0ba698bb347fea3c00172f7bd00c2 P 4dca6cd9810744e493c4879d080285b1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:32.495023 11123 raft_consensus.cc:504] T b2d0ba698bb347fea3c00172f7bd00c2 P 4dca6cd9810744e493c4879d080285b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 34247 } } peers { permanent_uuid: "4dca6cd9810744e493c4879d080285b1" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34711 } } peers { permanent_uuid: "5d6010dd8b8f4fe58796523605f77a17" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 43057 } }
I20260808 14:45:32.495160 11123 leader_election.cc:288] T b2d0ba698bb347fea3c00172f7bd00c2 P 4dca6cd9810744e493c4879d080285b1 [CANDIDATE]: Term 1 election: Requested vote from peers a99a92d079d84236bcdbd8ff5f0ddfad (127.30.214.130:34247), 5d6010dd8b8f4fe58796523605f77a17 (127.30.214.131:43057)
I20260808 14:45:32.495306 11002 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2d0ba698bb347fea3c00172f7bd00c2" candidate_uuid: "4dca6cd9810744e493c4879d080285b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d6010dd8b8f4fe58796523605f77a17"
I20260808 14:45:32.495349 10802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2d0ba698bb347fea3c00172f7bd00c2" candidate_uuid: "4dca6cd9810744e493c4879d080285b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad"
I20260808 14:45:32.495395 11002 raft_consensus.cc:3037] T b2d0ba698bb347fea3c00172f7bd00c2 P 5d6010dd8b8f4fe58796523605f77a17 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:32.495420 10802 raft_consensus.cc:3037] T b2d0ba698bb347fea3c00172f7bd00c2 P a99a92d079d84236bcdbd8ff5f0ddfad [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:32.496299 11002 raft_consensus.cc:2454] T b2d0ba698bb347fea3c00172f7bd00c2 P 5d6010dd8b8f4fe58796523605f77a17 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dca6cd9810744e493c4879d080285b1 in term 1.
I20260808 14:45:32.496299 10802 raft_consensus.cc:2454] T b2d0ba698bb347fea3c00172f7bd00c2 P a99a92d079d84236bcdbd8ff5f0ddfad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dca6cd9810744e493c4879d080285b1 in term 1.
I20260808 14:45:32.496501 10487 leader_election.cc:302] T b2d0ba698bb347fea3c00172f7bd00c2 P 4dca6cd9810744e493c4879d080285b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dca6cd9810744e493c4879d080285b1, a99a92d079d84236bcdbd8ff5f0ddfad; no voters:
I20260808 14:45:32.496640 11123 raft_consensus.cc:2781] T b2d0ba698bb347fea3c00172f7bd00c2 P 4dca6cd9810744e493c4879d080285b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:45:32.496796 11123 raft_consensus.cc:686] T b2d0ba698bb347fea3c00172f7bd00c2 P 4dca6cd9810744e493c4879d080285b1 [term 1 LEADER]: Becoming Leader. State: Replica: 4dca6cd9810744e493c4879d080285b1, State: Running, Role: LEADER
I20260808 14:45:32.496918 11123 consensus_queue.cc:237] T b2d0ba698bb347fea3c00172f7bd00c2 P 4dca6cd9810744e493c4879d080285b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 34247 } } peers { permanent_uuid: "4dca6cd9810744e493c4879d080285b1" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34711 } } peers { permanent_uuid: "5d6010dd8b8f4fe58796523605f77a17" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 43057 } }
I20260808 14:45:32.497761 10360 catalog_manager.cc:5495] T b2d0ba698bb347fea3c00172f7bd00c2 P 4dca6cd9810744e493c4879d080285b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4dca6cd9810744e493c4879d080285b1 (127.30.214.129). New cstate: current_term: 1 leader_uuid: "4dca6cd9810744e493c4879d080285b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 34247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dca6cd9810744e493c4879d080285b1" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d6010dd8b8f4fe58796523605f77a17" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 43057 } health_report { overall_health: UNKNOWN } } }
I20260808 14:45:32.518255 11107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:32.515944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57898 (local address 127.30.214.129:34711)
0808 14:45:32.516014 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:32.516016 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:32.516024 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:45:32.516060 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:32.516061 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:32.516079 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:32.516139 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:45:32.516253 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.516748 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.517511 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.517713 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.517766 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:32.517937 (+ 171us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:45:32.518042 (+ 105us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:45:32.518112 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:32.518147 (+ 35us) server_negotiation.cc:299] Negotiation successful
0808 14:45:32.518173 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 14:45:32.520099 11002 raft_consensus.cc:1261] T b2d0ba698bb347fea3c00172f7bd00c2 P 5d6010dd8b8f4fe58796523605f77a17 [term 1 FOLLOWER]: Refusing update from remote peer 4dca6cd9810744e493c4879d080285b1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:45:32.520103 10802 raft_consensus.cc:1261] T b2d0ba698bb347fea3c00172f7bd00c2 P a99a92d079d84236bcdbd8ff5f0ddfad [term 1 FOLLOWER]: Refusing update from remote peer 4dca6cd9810744e493c4879d080285b1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:45:32.520403 11123 consensus_queue.cc:1035] T b2d0ba698bb347fea3c00172f7bd00c2 P 4dca6cd9810744e493c4879d080285b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d6010dd8b8f4fe58796523605f77a17" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 43057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:45:32.520556 11131 consensus_queue.cc:1035] T b2d0ba698bb347fea3c00172f7bd00c2 P 4dca6cd9810744e493c4879d080285b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 34247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:45:32.522913 11138 mvcc.cc:205] Tried to move back new op lower bound from 7316276561999560704 to 7316276561907924992. Current Snapshot: MvccSnapshot[applied={T|T < 7316276561999560704}]
I20260808 14:45:32.523147 11135 mvcc.cc:205] Tried to move back new op lower bound from 7316276561999560704 to 7316276561907924992. Current Snapshot: MvccSnapshot[applied={T|T < 7316276561999560704}]
I20260808 14:45:32.525188 10362 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50104:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:45:32.525301 10362 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50104:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:45:32.526103 10362 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 578c10ced2184843b5084ac4b58829dd: Sending DeleteTablet for 3 replicas of tablet b2d0ba698bb347fea3c00172f7bd00c2
I20260808 14:45:32.526494 10774 tablet_service.cc:1514] Processing DeleteTablet for tablet b2d0ba698bb347fea3c00172f7bd00c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:45:32 UTC) from {username='oryx', principal='oryx/127.30.214.190@KRBTEST.COM'} at 127.0.0.1:43452
I20260808 14:45:32.526574 10561 tablet_service.cc:1514] Processing DeleteTablet for tablet b2d0ba698bb347fea3c00172f7bd00c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:45:32 UTC) from {username='oryx', principal='oryx/127.30.214.190@KRBTEST.COM'} at 127.0.0.1:57890
I20260808 14:45:32.526657 10974 tablet_service.cc:1514] Processing DeleteTablet for tablet b2d0ba698bb347fea3c00172f7bd00c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:45:32 UTC) from {username='oryx', principal='oryx/127.30.214.190@KRBTEST.COM'} at 127.0.0.1:50864
I20260808 14:45:32.526648 10362 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50104:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:45:32.526790 10362 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:45:32.526993 11151 tablet_replica.cc:330] T b2d0ba698bb347fea3c00172f7bd00c2 P a99a92d079d84236bcdbd8ff5f0ddfad: stopping tablet replica
I20260808 14:45:32.527108 11151 raft_consensus.cc:2229] T b2d0ba698bb347fea3c00172f7bd00c2 P a99a92d079d84236bcdbd8ff5f0ddfad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:45:32.527222 11151 raft_consensus.cc:2258] T b2d0ba698bb347fea3c00172f7bd00c2 P a99a92d079d84236bcdbd8ff5f0ddfad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:45:32.527704 11151 ts_tablet_manager.cc:1905] T b2d0ba698bb347fea3c00172f7bd00c2 P a99a92d079d84236bcdbd8ff5f0ddfad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:45:32.528333 10774 tablet_service.cc:1467] Processing CreateTablet for tablet df38f1bcd5f04916a62d095d10bde17b (DEFAULT_TABLE table=test-table [id=0b8561e891394c0d9c51f172d3dcd05e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:45:32.528337 10561 tablet_service.cc:1467] Processing CreateTablet for tablet df38f1bcd5f04916a62d095d10bde17b (DEFAULT_TABLE table=test-table [id=0b8561e891394c0d9c51f172d3dcd05e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:45:32.528468 10774 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df38f1bcd5f04916a62d095d10bde17b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:45:32.528468 10561 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df38f1bcd5f04916a62d095d10bde17b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:45:32.529305 11151 ts_tablet_manager.cc:1918] T b2d0ba698bb347fea3c00172f7bd00c2 P a99a92d079d84236bcdbd8ff5f0ddfad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:45:32.529371 11151 log.cc:1196] T b2d0ba698bb347fea3c00172f7bd00c2 P a99a92d079d84236bcdbd8ff5f0ddfad: Deleting WAL directory at /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/ts-1/wal/wals/b2d0ba698bb347fea3c00172f7bd00c2
I20260808 14:45:32.529631 11151 ts_tablet_manager.cc:1939] T b2d0ba698bb347fea3c00172f7bd00c2 P a99a92d079d84236bcdbd8ff5f0ddfad: Deleting consensus metadata
I20260808 14:45:32.529860 11115 tablet_bootstrap.cc:492] T df38f1bcd5f04916a62d095d10bde17b P 4dca6cd9810744e493c4879d080285b1: Bootstrap starting.
I20260808 14:45:32.529884 11112 tablet_bootstrap.cc:492] T df38f1bcd5f04916a62d095d10bde17b P a99a92d079d84236bcdbd8ff5f0ddfad: Bootstrap starting.
I20260808 14:45:32.530258 11115 tablet_bootstrap.cc:654] T df38f1bcd5f04916a62d095d10bde17b P 4dca6cd9810744e493c4879d080285b1: Neither blocks nor log segments found. Creating new log.
I20260808 14:45:32.530565 11112 tablet_bootstrap.cc:654] T df38f1bcd5f04916a62d095d10bde17b P a99a92d079d84236bcdbd8ff5f0ddfad: Neither blocks nor log segments found. Creating new log.
I20260808 14:45:32.530747 10340 catalog_manager.cc:4841] TS a99a92d079d84236bcdbd8ff5f0ddfad (127.30.214.130:34247): tablet b2d0ba698bb347fea3c00172f7bd00c2 (table test-table [id=393ee10b6bff4d06827f5071912291bb]) successfully deleted
I20260808 14:45:32.530999 11115 tablet_bootstrap.cc:492] T df38f1bcd5f04916a62d095d10bde17b P 4dca6cd9810744e493c4879d080285b1: No bootstrap required, opened a new log
I20260808 14:45:32.531054 11115 ts_tablet_manager.cc:1397] T df38f1bcd5f04916a62d095d10bde17b P 4dca6cd9810744e493c4879d080285b1: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260808 14:45:32.531201 11115 raft_consensus.cc:348] T df38f1bcd5f04916a62d095d10bde17b P 4dca6cd9810744e493c4879d080285b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dca6cd9810744e493c4879d080285b1" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34711 } } peers { permanent_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 34247 } } peers { permanent_uuid: "5d6010dd8b8f4fe58796523605f77a17" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 43057 } }
I20260808 14:45:32.531270 11115 raft_consensus.cc:374] T df38f1bcd5f04916a62d095d10bde17b P 4dca6cd9810744e493c4879d080285b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:45:32.531288 11115 raft_consensus.cc:729] T df38f1bcd5f04916a62d095d10bde17b P 4dca6cd9810744e493c4879d080285b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dca6cd9810744e493c4879d080285b1, State: Initialized, Role: FOLLOWER
I20260808 14:45:32.531334 11115 consensus_queue.cc:260] T df38f1bcd5f04916a62d095d10bde17b P 4dca6cd9810744e493c4879d080285b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dca6cd9810744e493c4879d080285b1" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34711 } } peers { permanent_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 34247 } } peers { permanent_uuid: "5d6010dd8b8f4fe58796523605f77a17" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 43057 } }
I20260808 14:45:32.531425 11115 ts_tablet_manager.cc:1428] T df38f1bcd5f04916a62d095d10bde17b P 4dca6cd9810744e493c4879d080285b1: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260808 14:45:32.531564 10974 tablet_service.cc:1467] Processing CreateTablet for tablet df38f1bcd5f04916a62d095d10bde17b (DEFAULT_TABLE table=test-table [id=0b8561e891394c0d9c51f172d3dcd05e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:45:32.531710 10974 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df38f1bcd5f04916a62d095d10bde17b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:45:32.533039 11108 tablet_bootstrap.cc:492] T df38f1bcd5f04916a62d095d10bde17b P 5d6010dd8b8f4fe58796523605f77a17: Bootstrap starting.
I20260808 14:45:32.533471 11112 tablet_bootstrap.cc:492] T df38f1bcd5f04916a62d095d10bde17b P a99a92d079d84236bcdbd8ff5f0ddfad: No bootstrap required, opened a new log
I20260808 14:45:32.533522 11108 tablet_bootstrap.cc:654] T df38f1bcd5f04916a62d095d10bde17b P 5d6010dd8b8f4fe58796523605f77a17: Neither blocks nor log segments found. Creating new log.
I20260808 14:45:32.533540 11112 ts_tablet_manager.cc:1397] T df38f1bcd5f04916a62d095d10bde17b P a99a92d079d84236bcdbd8ff5f0ddfad: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.001s
I20260808 14:45:32.533684 11112 raft_consensus.cc:348] T df38f1bcd5f04916a62d095d10bde17b P a99a92d079d84236bcdbd8ff5f0ddfad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dca6cd9810744e493c4879d080285b1" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34711 } } peers { permanent_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 34247 } } peers { permanent_uuid: "5d6010dd8b8f4fe58796523605f77a17" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 43057 } }
I20260808 14:45:32.533764 11112 raft_consensus.cc:374] T df38f1bcd5f04916a62d095d10bde17b P a99a92d079d84236bcdbd8ff5f0ddfad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:45:32.533784 11112 raft_consensus.cc:729] T df38f1bcd5f04916a62d095d10bde17b P a99a92d079d84236bcdbd8ff5f0ddfad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a99a92d079d84236bcdbd8ff5f0ddfad, State: Initialized, Role: FOLLOWER
I20260808 14:45:32.533830 11112 consensus_queue.cc:260] T df38f1bcd5f04916a62d095d10bde17b P a99a92d079d84236bcdbd8ff5f0ddfad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dca6cd9810744e493c4879d080285b1" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34711 } } peers { permanent_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 34247 } } peers { permanent_uuid: "5d6010dd8b8f4fe58796523605f77a17" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 43057 } }
I20260808 14:45:32.533921 11112 ts_tablet_manager.cc:1428] T df38f1bcd5f04916a62d095d10bde17b P a99a92d079d84236bcdbd8ff5f0ddfad: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:32.534319 11152 tablet_replica.cc:330] T b2d0ba698bb347fea3c00172f7bd00c2 P 4dca6cd9810744e493c4879d080285b1: stopping tablet replica
I20260808 14:45:32.534448 11152 raft_consensus.cc:2229] T b2d0ba698bb347fea3c00172f7bd00c2 P 4dca6cd9810744e493c4879d080285b1 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:45:32.534531 11108 tablet_bootstrap.cc:492] T df38f1bcd5f04916a62d095d10bde17b P 5d6010dd8b8f4fe58796523605f77a17: No bootstrap required, opened a new log
I20260808 14:45:32.534580 11152 raft_consensus.cc:2258] T b2d0ba698bb347fea3c00172f7bd00c2 P 4dca6cd9810744e493c4879d080285b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:45:32.534597 11108 ts_tablet_manager.cc:1397] T df38f1bcd5f04916a62d095d10bde17b P 5d6010dd8b8f4fe58796523605f77a17: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260808 14:45:32.534744 11108 raft_consensus.cc:348] T df38f1bcd5f04916a62d095d10bde17b P 5d6010dd8b8f4fe58796523605f77a17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dca6cd9810744e493c4879d080285b1" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34711 } } peers { permanent_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 34247 } } peers { permanent_uuid: "5d6010dd8b8f4fe58796523605f77a17" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 43057 } }
I20260808 14:45:32.534822 11108 raft_consensus.cc:374] T df38f1bcd5f04916a62d095d10bde17b P 5d6010dd8b8f4fe58796523605f77a17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:45:32.534842 11108 raft_consensus.cc:729] T df38f1bcd5f04916a62d095d10bde17b P 5d6010dd8b8f4fe58796523605f77a17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d6010dd8b8f4fe58796523605f77a17, State: Initialized, Role: FOLLOWER
I20260808 14:45:32.534890 11108 consensus_queue.cc:260] T df38f1bcd5f04916a62d095d10bde17b P 5d6010dd8b8f4fe58796523605f77a17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dca6cd9810744e493c4879d080285b1" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34711 } } peers { permanent_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 34247 } } peers { permanent_uuid: "5d6010dd8b8f4fe58796523605f77a17" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 43057 } }
I20260808 14:45:32.534981 11108 ts_tablet_manager.cc:1428] T df38f1bcd5f04916a62d095d10bde17b P 5d6010dd8b8f4fe58796523605f77a17: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:32.537794 11152 ts_tablet_manager.cc:1905] T b2d0ba698bb347fea3c00172f7bd00c2 P 4dca6cd9810744e493c4879d080285b1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:45:32.539028 11154 tablet_replica.cc:330] T b2d0ba698bb347fea3c00172f7bd00c2 P 5d6010dd8b8f4fe58796523605f77a17: stopping tablet replica
I20260808 14:45:32.539177 11154 raft_consensus.cc:2229] T b2d0ba698bb347fea3c00172f7bd00c2 P 5d6010dd8b8f4fe58796523605f77a17 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:45:32.539247 11152 ts_tablet_manager.cc:1918] T b2d0ba698bb347fea3c00172f7bd00c2 P 4dca6cd9810744e493c4879d080285b1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:45:32.539297 11154 raft_consensus.cc:2258] T b2d0ba698bb347fea3c00172f7bd00c2 P 5d6010dd8b8f4fe58796523605f77a17 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:45:32.539332 11152 log.cc:1196] T b2d0ba698bb347fea3c00172f7bd00c2 P 4dca6cd9810744e493c4879d080285b1: Deleting WAL directory at /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/ts-0/wal/wals/b2d0ba698bb347fea3c00172f7bd00c2
I20260808 14:45:32.539724 11154 ts_tablet_manager.cc:1905] T b2d0ba698bb347fea3c00172f7bd00c2 P 5d6010dd8b8f4fe58796523605f77a17: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:45:32.539736 11152 ts_tablet_manager.cc:1939] T b2d0ba698bb347fea3c00172f7bd00c2 P 4dca6cd9810744e493c4879d080285b1: Deleting consensus metadata
I20260808 14:45:32.540170 10340 catalog_manager.cc:4841] TS 4dca6cd9810744e493c4879d080285b1 (127.30.214.129:34711): tablet b2d0ba698bb347fea3c00172f7bd00c2 (table test-table [id=393ee10b6bff4d06827f5071912291bb]) successfully deleted
I20260808 14:45:32.541083 11154 ts_tablet_manager.cc:1918] T b2d0ba698bb347fea3c00172f7bd00c2 P 5d6010dd8b8f4fe58796523605f77a17: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:45:32.541152 11154 log.cc:1196] T b2d0ba698bb347fea3c00172f7bd00c2 P 5d6010dd8b8f4fe58796523605f77a17: Deleting WAL directory at /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/ts-2/wal/wals/b2d0ba698bb347fea3c00172f7bd00c2
I20260808 14:45:32.541354 11154 ts_tablet_manager.cc:1939] T b2d0ba698bb347fea3c00172f7bd00c2 P 5d6010dd8b8f4fe58796523605f77a17: Deleting consensus metadata
I20260808 14:45:32.541774 10343 catalog_manager.cc:4841] TS 5d6010dd8b8f4fe58796523605f77a17 (127.30.214.131:43057): tablet b2d0ba698bb347fea3c00172f7bd00c2 (table test-table [id=393ee10b6bff4d06827f5071912291bb]) successfully deleted
I20260808 14:45:32.560369 11117 raft_consensus.cc:482] T df38f1bcd5f04916a62d095d10bde17b P 5d6010dd8b8f4fe58796523605f77a17 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:45:32.560497 11117 raft_consensus.cc:504] T df38f1bcd5f04916a62d095d10bde17b P 5d6010dd8b8f4fe58796523605f77a17 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dca6cd9810744e493c4879d080285b1" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34711 } } peers { permanent_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 34247 } } peers { permanent_uuid: "5d6010dd8b8f4fe58796523605f77a17" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 43057 } }
I20260808 14:45:32.560845 11117 leader_election.cc:288] T df38f1bcd5f04916a62d095d10bde17b P 5d6010dd8b8f4fe58796523605f77a17 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dca6cd9810744e493c4879d080285b1 (127.30.214.129:34711), a99a92d079d84236bcdbd8ff5f0ddfad (127.30.214.130:34247)
I20260808 14:45:32.564415 11102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:32.561278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:53733 (local address 127.30.214.130:34247)
0808 14:45:32.561320 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:32.561322 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:32.561329 (+ 7us) server_negotiation.cc:407] Connection header received
0808 14:45:32.561381 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:32.561382 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:32.561390 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:32.561461 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:45:32.561658 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.562404 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.563661 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.564067 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.564147 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:32.564158 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:32.564300 (+ 142us) server_negotiation.cc:299] Negotiation successful
0808 14:45:32.564343 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 14:45:32.564601 10914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:32.561035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.129:34711 (local address 127.30.214.131:50547)
0808 14:45:32.561096 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:32.561110 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:32.561173 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:32.561369 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:32.561370 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:32.561371 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:45:32.561512 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:32.561515 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.562197 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.562198 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:32.563507 (+ 1309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:32.563510 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.564326 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.564327 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:32.564416 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:32.564419 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:45:32.564463 (+ 44us) client_negotiation.cc:240] Negotiation successful
0808 14:45:32.564524 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260808 14:45:32.564775 11158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:32.561141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.130:34247 (local address 127.30.214.131:53733)
0808 14:45:32.561261 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:32.561270 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:32.561320 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:32.561485 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:32.561486 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:32.561488 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:45:32.561580 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:32.561582 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.562485 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.562486 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:32.563600 (+ 1114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:32.563601 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.564142 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.564143 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:32.564212 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:32.564216 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:45:32.564632 (+ 416us) client_negotiation.cc:240] Negotiation successful
0808 14:45:32.564677 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":67,"threads_started":1}
I20260808 14:45:32.564906 11107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:32.561114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:50547 (local address 127.30.214.129:34711)
0808 14:45:32.561164 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:32.561166 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:32.561177 (+ 11us) server_negotiation.cc:407] Connection header received
0808 14:45:32.561269 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:32.561271 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:32.561282 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:32.561324 (+ 42us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:45:32.561587 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.562123 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.563611 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.564214 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.564283 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:32.564291 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:32.564797 (+ 506us) server_negotiation.cc:299] Negotiation successful
0808 14:45:32.564841 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260808 14:45:32.565140 10802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df38f1bcd5f04916a62d095d10bde17b" candidate_uuid: "5d6010dd8b8f4fe58796523605f77a17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad" is_pre_election: true
I20260808 14:45:32.565150 10593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df38f1bcd5f04916a62d095d10bde17b" candidate_uuid: "5d6010dd8b8f4fe58796523605f77a17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dca6cd9810744e493c4879d080285b1" is_pre_election: true
I20260808 14:45:32.565244 10802 raft_consensus.cc:2454] T df38f1bcd5f04916a62d095d10bde17b P a99a92d079d84236bcdbd8ff5f0ddfad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d6010dd8b8f4fe58796523605f77a17 in term 0.
I20260808 14:45:32.565286 10593 raft_consensus.cc:2454] T df38f1bcd5f04916a62d095d10bde17b P 4dca6cd9810744e493c4879d080285b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d6010dd8b8f4fe58796523605f77a17 in term 0.
I20260808 14:45:32.565431 10904 leader_election.cc:302] T df38f1bcd5f04916a62d095d10bde17b P 5d6010dd8b8f4fe58796523605f77a17 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d6010dd8b8f4fe58796523605f77a17, a99a92d079d84236bcdbd8ff5f0ddfad; no voters:
I20260808 14:45:32.565606 11117 raft_consensus.cc:2781] T df38f1bcd5f04916a62d095d10bde17b P 5d6010dd8b8f4fe58796523605f77a17 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:45:32.565653 11117 raft_consensus.cc:482] T df38f1bcd5f04916a62d095d10bde17b P 5d6010dd8b8f4fe58796523605f77a17 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:45:32.565682 11117 raft_consensus.cc:3037] T df38f1bcd5f04916a62d095d10bde17b P 5d6010dd8b8f4fe58796523605f77a17 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:32.566569 11117 raft_consensus.cc:504] T df38f1bcd5f04916a62d095d10bde17b P 5d6010dd8b8f4fe58796523605f77a17 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dca6cd9810744e493c4879d080285b1" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34711 } } peers { permanent_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 34247 } } peers { permanent_uuid: "5d6010dd8b8f4fe58796523605f77a17" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 43057 } }
I20260808 14:45:32.566713 11117 leader_election.cc:288] T df38f1bcd5f04916a62d095d10bde17b P 5d6010dd8b8f4fe58796523605f77a17 [CANDIDATE]: Term 1 election: Requested vote from peers 4dca6cd9810744e493c4879d080285b1 (127.30.214.129:34711), a99a92d079d84236bcdbd8ff5f0ddfad (127.30.214.130:34247)
I20260808 14:45:32.566866 10593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df38f1bcd5f04916a62d095d10bde17b" candidate_uuid: "5d6010dd8b8f4fe58796523605f77a17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dca6cd9810744e493c4879d080285b1"
I20260808 14:45:32.566887 10802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df38f1bcd5f04916a62d095d10bde17b" candidate_uuid: "5d6010dd8b8f4fe58796523605f77a17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad"
I20260808 14:45:32.566953 10593 raft_consensus.cc:3037] T df38f1bcd5f04916a62d095d10bde17b P 4dca6cd9810744e493c4879d080285b1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:32.566958 10802 raft_consensus.cc:3037] T df38f1bcd5f04916a62d095d10bde17b P a99a92d079d84236bcdbd8ff5f0ddfad [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:32.567696 10802 raft_consensus.cc:2454] T df38f1bcd5f04916a62d095d10bde17b P a99a92d079d84236bcdbd8ff5f0ddfad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d6010dd8b8f4fe58796523605f77a17 in term 1.
I20260808 14:45:32.567741 10593 raft_consensus.cc:2454] T df38f1bcd5f04916a62d095d10bde17b P 4dca6cd9810744e493c4879d080285b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d6010dd8b8f4fe58796523605f77a17 in term 1.
I20260808 14:45:32.567876 10904 leader_election.cc:302] T df38f1bcd5f04916a62d095d10bde17b P 5d6010dd8b8f4fe58796523605f77a17 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dca6cd9810744e493c4879d080285b1, 5d6010dd8b8f4fe58796523605f77a17; no voters:
I20260808 14:45:32.568012 11117 raft_consensus.cc:2781] T df38f1bcd5f04916a62d095d10bde17b P 5d6010dd8b8f4fe58796523605f77a17 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:45:32.568152 11117 raft_consensus.cc:686] T df38f1bcd5f04916a62d095d10bde17b P 5d6010dd8b8f4fe58796523605f77a17 [term 1 LEADER]: Becoming Leader. State: Replica: 5d6010dd8b8f4fe58796523605f77a17, State: Running, Role: LEADER
I20260808 14:45:32.568220 11117 consensus_queue.cc:237] T df38f1bcd5f04916a62d095d10bde17b P 5d6010dd8b8f4fe58796523605f77a17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dca6cd9810744e493c4879d080285b1" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34711 } } peers { permanent_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 34247 } } peers { permanent_uuid: "5d6010dd8b8f4fe58796523605f77a17" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 43057 } }
I20260808 14:45:32.568936 10362 catalog_manager.cc:5495] T df38f1bcd5f04916a62d095d10bde17b P 5d6010dd8b8f4fe58796523605f77a17 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d6010dd8b8f4fe58796523605f77a17 (127.30.214.131). New cstate: current_term: 1 leader_uuid: "5d6010dd8b8f4fe58796523605f77a17" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dca6cd9810744e493c4879d080285b1" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 34247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d6010dd8b8f4fe58796523605f77a17" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 43057 } health_report { overall_health: HEALTHY } } }
Aug 08 14:45:32 dist-test-slave-42z9 krb5kdc[10298](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200331, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.214.190@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM
I20260808 14:45:32.598912 11169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:32.590181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:46267 (local address 127.0.0.1:50108)
0808 14:45:32.590336 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:32.590347 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:32.590411 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:32.590563 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:32.590564 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:32.590860 (+ 296us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:32.590922 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:32.590925 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.591892 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.591893 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:32.592418 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:32.592420 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.593049 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.593051 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:32.593160 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:32.593943 (+ 783us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:32.593949 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:32.595904 (+ 1955us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:32.597784 (+ 1880us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:32.597794 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:32.597797 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:32.598031 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:32.598264 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:32.598265 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:32.598265 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:32.598330 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:32.598626 (+ 296us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:32.598633 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:32.598678 (+ 45us) client_negotiation.cc:769] Sending connection context
0808 14:45:32.598724 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 14:45:32.598833 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":80,"threads_started":1}
I20260808 14:45:32.599040 10435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:32.590264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50108 (local address 127.30.214.190:46267)
0808 14:45:32.590329 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:32.590331 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:32.590410 (+ 79us) server_negotiation.cc:407] Connection header received
0808 14:45:32.590459 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:32.590460 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:32.590472 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:32.590558 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:32.591003 (+ 445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.591787 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.592502 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.592793 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.592867 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:32.596007 (+ 3140us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:32.596009 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:32.596009 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:32.596018 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:32.597676 (+ 1658us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:32.598113 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:32.598114 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:32.598114 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:32.598185 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:32.598394 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:32.598396 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:32.598396 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:32.598558 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:32.598630 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:32.598772 (+ 142us) server_negotiation.cc:299] Negotiation successful
0808 14:45:32.598902 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":40,"server-negotiator.queue_time_us":36}
I20260808 14:45:32.601146 10362 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.30.214.190@KRBTEST.COM'} at 127.0.0.1:50108:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 14:45:32.601394 10362 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:45:32.602779 10774 tablet_service.cc:1467] Processing CreateTablet for tablet c1bbae2777834cba9bb4124aaf326fbe (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=2e9d1f95e95d470580e96daf288a9713]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 14:45:32.602837 10561 tablet_service.cc:1467] Processing CreateTablet for tablet c1bbae2777834cba9bb4124aaf326fbe (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=2e9d1f95e95d470580e96daf288a9713]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 14:45:32.602967 10774 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c1bbae2777834cba9bb4124aaf326fbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:45:32.603020 10561 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c1bbae2777834cba9bb4124aaf326fbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:45:32.604104 11112 tablet_bootstrap.cc:492] T c1bbae2777834cba9bb4124aaf326fbe P a99a92d079d84236bcdbd8ff5f0ddfad: Bootstrap starting.
I20260808 14:45:32.604485 11112 tablet_bootstrap.cc:654] T c1bbae2777834cba9bb4124aaf326fbe P a99a92d079d84236bcdbd8ff5f0ddfad: Neither blocks nor log segments found. Creating new log.
I20260808 14:45:32.604550 11115 tablet_bootstrap.cc:492] T c1bbae2777834cba9bb4124aaf326fbe P 4dca6cd9810744e493c4879d080285b1: Bootstrap starting.
I20260808 14:45:32.604657 10974 tablet_service.cc:1467] Processing CreateTablet for tablet c1bbae2777834cba9bb4124aaf326fbe (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=2e9d1f95e95d470580e96daf288a9713]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 14:45:32.604799 10974 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c1bbae2777834cba9bb4124aaf326fbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:45:32.604976 11115 tablet_bootstrap.cc:654] T c1bbae2777834cba9bb4124aaf326fbe P 4dca6cd9810744e493c4879d080285b1: Neither blocks nor log segments found. Creating new log.
I20260808 14:45:32.605428 11112 tablet_bootstrap.cc:492] T c1bbae2777834cba9bb4124aaf326fbe P a99a92d079d84236bcdbd8ff5f0ddfad: No bootstrap required, opened a new log
I20260808 14:45:32.605506 11112 ts_tablet_manager.cc:1397] T c1bbae2777834cba9bb4124aaf326fbe P a99a92d079d84236bcdbd8ff5f0ddfad: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 14:45:32.605665 11112 raft_consensus.cc:348] T c1bbae2777834cba9bb4124aaf326fbe P a99a92d079d84236bcdbd8ff5f0ddfad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 34247 } } peers { permanent_uuid: "5d6010dd8b8f4fe58796523605f77a17" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 43057 } } peers { permanent_uuid: "4dca6cd9810744e493c4879d080285b1" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34711 } }
I20260808 14:45:32.605744 11112 raft_consensus.cc:374] T c1bbae2777834cba9bb4124aaf326fbe P a99a92d079d84236bcdbd8ff5f0ddfad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:45:32.605764 11112 raft_consensus.cc:729] T c1bbae2777834cba9bb4124aaf326fbe P a99a92d079d84236bcdbd8ff5f0ddfad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a99a92d079d84236bcdbd8ff5f0ddfad, State: Initialized, Role: FOLLOWER
I20260808 14:45:32.605804 11112 consensus_queue.cc:260] T c1bbae2777834cba9bb4124aaf326fbe P a99a92d079d84236bcdbd8ff5f0ddfad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 34247 } } peers { permanent_uuid: "5d6010dd8b8f4fe58796523605f77a17" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 43057 } } peers { permanent_uuid: "4dca6cd9810744e493c4879d080285b1" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34711 } }
I20260808 14:45:32.605904 11112 ts_tablet_manager.cc:1428] T c1bbae2777834cba9bb4124aaf326fbe P a99a92d079d84236bcdbd8ff5f0ddfad: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:32.606359 11115 tablet_bootstrap.cc:492] T c1bbae2777834cba9bb4124aaf326fbe P 4dca6cd9810744e493c4879d080285b1: No bootstrap required, opened a new log
I20260808 14:45:32.606383 11108 tablet_bootstrap.cc:492] T c1bbae2777834cba9bb4124aaf326fbe P 5d6010dd8b8f4fe58796523605f77a17: Bootstrap starting.
I20260808 14:45:32.606410 11115 ts_tablet_manager.cc:1397] T c1bbae2777834cba9bb4124aaf326fbe P 4dca6cd9810744e493c4879d080285b1: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260808 14:45:32.606427 11118 tablet_replica.cc:439] T c1bbae2777834cba9bb4124aaf326fbe P a99a92d079d84236bcdbd8ff5f0ddfad: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 34247 } } peers { permanent_uuid: "5d6010dd8b8f4fe58796523605f77a17" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 43057 } } peers { permanent_uuid: "4dca6cd9810744e493c4879d080285b1" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34711 } } }
I20260808 14:45:32.606551 11118 tablet_replica.cc:442] T c1bbae2777834cba9bb4124aaf326fbe P a99a92d079d84236bcdbd8ff5f0ddfad: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:45:32.606563 11115 raft_consensus.cc:348] T c1bbae2777834cba9bb4124aaf326fbe P 4dca6cd9810744e493c4879d080285b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 34247 } } peers { permanent_uuid: "5d6010dd8b8f4fe58796523605f77a17" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 43057 } } peers { permanent_uuid: "4dca6cd9810744e493c4879d080285b1" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34711 } }
I20260808 14:45:32.606630 11115 raft_consensus.cc:374] T c1bbae2777834cba9bb4124aaf326fbe P 4dca6cd9810744e493c4879d080285b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:45:32.606648 11115 raft_consensus.cc:729] T c1bbae2777834cba9bb4124aaf326fbe P 4dca6cd9810744e493c4879d080285b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dca6cd9810744e493c4879d080285b1, State: Initialized, Role: FOLLOWER
I20260808 14:45:32.606684 11115 consensus_queue.cc:260] T c1bbae2777834cba9bb4124aaf326fbe P 4dca6cd9810744e493c4879d080285b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 34247 } } peers { permanent_uuid: "5d6010dd8b8f4fe58796523605f77a17" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 43057 } } peers { permanent_uuid: "4dca6cd9810744e493c4879d080285b1" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34711 } }
I20260808 14:45:32.606787 11115 ts_tablet_manager.cc:1428] T c1bbae2777834cba9bb4124aaf326fbe P 4dca6cd9810744e493c4879d080285b1: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260808 14:45:32.606796 11108 tablet_bootstrap.cc:654] T c1bbae2777834cba9bb4124aaf326fbe P 5d6010dd8b8f4fe58796523605f77a17: Neither blocks nor log segments found. Creating new log.
I20260808 14:45:32.606896 11142 tablet_replica.cc:439] T c1bbae2777834cba9bb4124aaf326fbe P 4dca6cd9810744e493c4879d080285b1: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 34247 } } peers { permanent_uuid: "5d6010dd8b8f4fe58796523605f77a17" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 43057 } } peers { permanent_uuid: "4dca6cd9810744e493c4879d080285b1" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34711 } } }
I20260808 14:45:32.606972 11142 tablet_replica.cc:442] T c1bbae2777834cba9bb4124aaf326fbe P 4dca6cd9810744e493c4879d080285b1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:45:32.607618 11108 tablet_bootstrap.cc:492] T c1bbae2777834cba9bb4124aaf326fbe P 5d6010dd8b8f4fe58796523605f77a17: No bootstrap required, opened a new log
I20260808 14:45:32.607674 11108 ts_tablet_manager.cc:1397] T c1bbae2777834cba9bb4124aaf326fbe P 5d6010dd8b8f4fe58796523605f77a17: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260808 14:45:32.607821 11108 raft_consensus.cc:348] T c1bbae2777834cba9bb4124aaf326fbe P 5d6010dd8b8f4fe58796523605f77a17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 34247 } } peers { permanent_uuid: "5d6010dd8b8f4fe58796523605f77a17" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 43057 } } peers { permanent_uuid: "4dca6cd9810744e493c4879d080285b1" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34711 } }
I20260808 14:45:32.607892 11108 raft_consensus.cc:374] T c1bbae2777834cba9bb4124aaf326fbe P 5d6010dd8b8f4fe58796523605f77a17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:45:32.607911 11108 raft_consensus.cc:729] T c1bbae2777834cba9bb4124aaf326fbe P 5d6010dd8b8f4fe58796523605f77a17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d6010dd8b8f4fe58796523605f77a17, State: Initialized, Role: FOLLOWER
I20260808 14:45:32.607966 11108 consensus_queue.cc:260] T c1bbae2777834cba9bb4124aaf326fbe P 5d6010dd8b8f4fe58796523605f77a17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 34247 } } peers { permanent_uuid: "5d6010dd8b8f4fe58796523605f77a17" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 43057 } } peers { permanent_uuid: "4dca6cd9810744e493c4879d080285b1" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34711 } }
I20260808 14:45:32.608055 11108 ts_tablet_manager.cc:1428] T c1bbae2777834cba9bb4124aaf326fbe P 5d6010dd8b8f4fe58796523605f77a17: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:32.608110 11117 tablet_replica.cc:439] T c1bbae2777834cba9bb4124aaf326fbe P 5d6010dd8b8f4fe58796523605f77a17: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 34247 } } peers { permanent_uuid: "5d6010dd8b8f4fe58796523605f77a17" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 43057 } } peers { permanent_uuid: "4dca6cd9810744e493c4879d080285b1" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34711 } } }
I20260808 14:45:32.608207 11117 tablet_replica.cc:442] T c1bbae2777834cba9bb4124aaf326fbe P 5d6010dd8b8f4fe58796523605f77a17: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:45:32.622488 11142 raft_consensus.cc:482] T c1bbae2777834cba9bb4124aaf326fbe P 4dca6cd9810744e493c4879d080285b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:45:32.622584 11142 raft_consensus.cc:504] T c1bbae2777834cba9bb4124aaf326fbe P 4dca6cd9810744e493c4879d080285b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 34247 } } peers { permanent_uuid: "5d6010dd8b8f4fe58796523605f77a17" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 43057 } } peers { permanent_uuid: "4dca6cd9810744e493c4879d080285b1" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34711 } }
I20260808 14:45:32.622743 11142 leader_election.cc:288] T c1bbae2777834cba9bb4124aaf326fbe P 4dca6cd9810744e493c4879d080285b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a99a92d079d84236bcdbd8ff5f0ddfad (127.30.214.130:34247), 5d6010dd8b8f4fe58796523605f77a17 (127.30.214.131:43057)
I20260808 14:45:32.622972 10802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c1bbae2777834cba9bb4124aaf326fbe" candidate_uuid: "4dca6cd9810744e493c4879d080285b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad" is_pre_election: true
I20260808 14:45:32.622967 11002 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c1bbae2777834cba9bb4124aaf326fbe" candidate_uuid: "4dca6cd9810744e493c4879d080285b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d6010dd8b8f4fe58796523605f77a17" is_pre_election: true
I20260808 14:45:32.623072 10802 raft_consensus.cc:2454] T c1bbae2777834cba9bb4124aaf326fbe P a99a92d079d84236bcdbd8ff5f0ddfad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dca6cd9810744e493c4879d080285b1 in term 0.
I20260808 14:45:32.623093 11002 raft_consensus.cc:2454] T c1bbae2777834cba9bb4124aaf326fbe P 5d6010dd8b8f4fe58796523605f77a17 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dca6cd9810744e493c4879d080285b1 in term 0.
I20260808 14:45:32.623222 10487 leader_election.cc:302] T c1bbae2777834cba9bb4124aaf326fbe P 4dca6cd9810744e493c4879d080285b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dca6cd9810744e493c4879d080285b1, a99a92d079d84236bcdbd8ff5f0ddfad; no voters:
I20260808 14:45:32.623322 11142 raft_consensus.cc:2781] T c1bbae2777834cba9bb4124aaf326fbe P 4dca6cd9810744e493c4879d080285b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:45:32.623368 11142 raft_consensus.cc:482] T c1bbae2777834cba9bb4124aaf326fbe P 4dca6cd9810744e493c4879d080285b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:45:32.623389 11142 raft_consensus.cc:3037] T c1bbae2777834cba9bb4124aaf326fbe P 4dca6cd9810744e493c4879d080285b1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:32.624102 11142 raft_consensus.cc:504] T c1bbae2777834cba9bb4124aaf326fbe P 4dca6cd9810744e493c4879d080285b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 34247 } } peers { permanent_uuid: "5d6010dd8b8f4fe58796523605f77a17" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 43057 } } peers { permanent_uuid: "4dca6cd9810744e493c4879d080285b1" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34711 } }
I20260808 14:45:32.624223 11142 leader_election.cc:288] T c1bbae2777834cba9bb4124aaf326fbe P 4dca6cd9810744e493c4879d080285b1 [CANDIDATE]: Term 1 election: Requested vote from peers a99a92d079d84236bcdbd8ff5f0ddfad (127.30.214.130:34247), 5d6010dd8b8f4fe58796523605f77a17 (127.30.214.131:43057)
I20260808 14:45:32.624378 10802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c1bbae2777834cba9bb4124aaf326fbe" candidate_uuid: "4dca6cd9810744e493c4879d080285b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad"
I20260808 14:45:32.624461 10802 raft_consensus.cc:3037] T c1bbae2777834cba9bb4124aaf326fbe P a99a92d079d84236bcdbd8ff5f0ddfad [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:32.624670 11002 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c1bbae2777834cba9bb4124aaf326fbe" candidate_uuid: "4dca6cd9810744e493c4879d080285b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d6010dd8b8f4fe58796523605f77a17"
I20260808 14:45:32.624748 11002 raft_consensus.cc:3037] T c1bbae2777834cba9bb4124aaf326fbe P 5d6010dd8b8f4fe58796523605f77a17 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:32.625226 10802 raft_consensus.cc:2454] T c1bbae2777834cba9bb4124aaf326fbe P a99a92d079d84236bcdbd8ff5f0ddfad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dca6cd9810744e493c4879d080285b1 in term 1.
I20260808 14:45:32.625334 11002 raft_consensus.cc:2454] T c1bbae2777834cba9bb4124aaf326fbe P 5d6010dd8b8f4fe58796523605f77a17 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dca6cd9810744e493c4879d080285b1 in term 1.
I20260808 14:45:32.625427 10487 leader_election.cc:302] T c1bbae2777834cba9bb4124aaf326fbe P 4dca6cd9810744e493c4879d080285b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dca6cd9810744e493c4879d080285b1, a99a92d079d84236bcdbd8ff5f0ddfad; no voters:
I20260808 14:45:32.625554 11142 raft_consensus.cc:2781] T c1bbae2777834cba9bb4124aaf326fbe P 4dca6cd9810744e493c4879d080285b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:45:32.625603 11142 raft_consensus.cc:686] T c1bbae2777834cba9bb4124aaf326fbe P 4dca6cd9810744e493c4879d080285b1 [term 1 LEADER]: Becoming Leader. State: Replica: 4dca6cd9810744e493c4879d080285b1, State: Running, Role: LEADER
I20260808 14:45:32.625658 11142 consensus_queue.cc:237] T c1bbae2777834cba9bb4124aaf326fbe P 4dca6cd9810744e493c4879d080285b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 34247 } } peers { permanent_uuid: "5d6010dd8b8f4fe58796523605f77a17" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 43057 } } peers { permanent_uuid: "4dca6cd9810744e493c4879d080285b1" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34711 } }
I20260808 14:45:32.625929 11123 tablet_replica.cc:439] T c1bbae2777834cba9bb4124aaf326fbe P 4dca6cd9810744e493c4879d080285b1: TxnStatusTablet state changed. Reason: New leader 4dca6cd9810744e493c4879d080285b1. Latest consensus state: current_term: 1 leader_uuid: "4dca6cd9810744e493c4879d080285b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 34247 } } peers { permanent_uuid: "5d6010dd8b8f4fe58796523605f77a17" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 43057 } } peers { permanent_uuid: "4dca6cd9810744e493c4879d080285b1" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34711 } } }
I20260808 14:45:32.626015 11123 tablet_replica.cc:442] T c1bbae2777834cba9bb4124aaf326fbe P 4dca6cd9810744e493c4879d080285b1: This TxnStatusTablet replica's current role is: LEADER
I20260808 14:45:32.626226 11175 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 14:45:32.626353 11175 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 14:45:32.626437 10362 catalog_manager.cc:5495] T c1bbae2777834cba9bb4124aaf326fbe P 4dca6cd9810744e493c4879d080285b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4dca6cd9810744e493c4879d080285b1 (127.30.214.129). New cstate: current_term: 1 leader_uuid: "4dca6cd9810744e493c4879d080285b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 34247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d6010dd8b8f4fe58796523605f77a17" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 43057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dca6cd9810744e493c4879d080285b1" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34711 } health_report { overall_health: HEALTHY } } }
I20260808 14:45:32.632278 11169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:32.629770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.129:34711 (local address 127.0.0.1:57910)
0808 14:45:32.629844 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:32.629853 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:32.629888 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:32.630038 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:32.630039 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:32.630040 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 14:45:32.630093 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:32.630096 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.630892 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.630892 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:32.631472 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:32.631474 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.631895 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.631896 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:32.631946 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:32.631970 (+ 24us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 14:45:32.632136 (+ 166us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 14:45:32.632142 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 14:45:32.632179 (+ 37us) client_negotiation.cc:240] Negotiation successful
0808 14:45:32.632218 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46}
I20260808 14:45:32.632287 11107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:32.629828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57910 (local address 127.30.214.129:34711)
0808 14:45:32.629874 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:32.629876 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:32.629885 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:45:32.629954 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:32.629955 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:32.629966 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:32.630034 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:45:32.630132 (+ 98us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.630818 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.631551 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.631823 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.631900 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:32.632042 (+ 142us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:45:32.632079 (+ 37us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:45:32.632131 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:32.632193 (+ 62us) server_negotiation.cc:299] Negotiation successful
0808 14:45:32.632217 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 14:45:32.633270 11002 raft_consensus.cc:1261] T c1bbae2777834cba9bb4124aaf326fbe P 5d6010dd8b8f4fe58796523605f77a17 [term 1 FOLLOWER]: Refusing update from remote peer 4dca6cd9810744e493c4879d080285b1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:45:32.633279 10802 raft_consensus.cc:1261] T c1bbae2777834cba9bb4124aaf326fbe P a99a92d079d84236bcdbd8ff5f0ddfad [term 1 FOLLOWER]: Refusing update from remote peer 4dca6cd9810744e493c4879d080285b1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:45:32.633545 11142 consensus_queue.cc:1035] T c1bbae2777834cba9bb4124aaf326fbe P 4dca6cd9810744e493c4879d080285b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d6010dd8b8f4fe58796523605f77a17" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 43057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:45:32.633657 11123 consensus_queue.cc:1035] T c1bbae2777834cba9bb4124aaf326fbe P 4dca6cd9810744e493c4879d080285b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 34247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:45:32.634251 11118 tablet_replica.cc:439] T c1bbae2777834cba9bb4124aaf326fbe P a99a92d079d84236bcdbd8ff5f0ddfad: TxnStatusTablet state changed. Reason: New leader 4dca6cd9810744e493c4879d080285b1. Latest consensus state: current_term: 1 leader_uuid: "4dca6cd9810744e493c4879d080285b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 34247 } } peers { permanent_uuid: "5d6010dd8b8f4fe58796523605f77a17" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 43057 } } peers { permanent_uuid: "4dca6cd9810744e493c4879d080285b1" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34711 } } }
I20260808 14:45:32.634343 11118 tablet_replica.cc:442] T c1bbae2777834cba9bb4124aaf326fbe P a99a92d079d84236bcdbd8ff5f0ddfad: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:45:32.634701 11142 tablet_replica.cc:439] T c1bbae2777834cba9bb4124aaf326fbe P 4dca6cd9810744e493c4879d080285b1: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4dca6cd9810744e493c4879d080285b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 34247 } } peers { permanent_uuid: "5d6010dd8b8f4fe58796523605f77a17" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 43057 } } peers { permanent_uuid: "4dca6cd9810744e493c4879d080285b1" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34711 } } }
I20260808 14:45:32.634778 11142 tablet_replica.cc:442] T c1bbae2777834cba9bb4124aaf326fbe P 4dca6cd9810744e493c4879d080285b1: This TxnStatusTablet replica's current role is: LEADER
I20260808 14:45:32.635186 11117 tablet_replica.cc:439] T c1bbae2777834cba9bb4124aaf326fbe P 5d6010dd8b8f4fe58796523605f77a17: TxnStatusTablet state changed. Reason: New leader 4dca6cd9810744e493c4879d080285b1. Latest consensus state: current_term: 1 leader_uuid: "4dca6cd9810744e493c4879d080285b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 34247 } } peers { permanent_uuid: "5d6010dd8b8f4fe58796523605f77a17" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 43057 } } peers { permanent_uuid: "4dca6cd9810744e493c4879d080285b1" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34711 } } }
I20260808 14:45:32.635298 11117 tablet_replica.cc:442] T c1bbae2777834cba9bb4124aaf326fbe P 5d6010dd8b8f4fe58796523605f77a17: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:45:32.635186 11159 tablet_replica.cc:439] T c1bbae2777834cba9bb4124aaf326fbe P 5d6010dd8b8f4fe58796523605f77a17: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4dca6cd9810744e493c4879d080285b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 34247 } } peers { permanent_uuid: "5d6010dd8b8f4fe58796523605f77a17" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 43057 } } peers { permanent_uuid: "4dca6cd9810744e493c4879d080285b1" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34711 } } }
I20260808 14:45:32.635705 11159 tablet_replica.cc:442] T c1bbae2777834cba9bb4124aaf326fbe P 5d6010dd8b8f4fe58796523605f77a17: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:45:32.636520 11131 tablet_replica.cc:439] T c1bbae2777834cba9bb4124aaf326fbe P 4dca6cd9810744e493c4879d080285b1: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4dca6cd9810744e493c4879d080285b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 34247 } } peers { permanent_uuid: "5d6010dd8b8f4fe58796523605f77a17" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 43057 } } peers { permanent_uuid: "4dca6cd9810744e493c4879d080285b1" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34711 } } }
I20260808 14:45:32.636615 11131 tablet_replica.cc:442] T c1bbae2777834cba9bb4124aaf326fbe P 4dca6cd9810744e493c4879d080285b1: This TxnStatusTablet replica's current role is: LEADER
I20260808 14:45:32.636765 11118 tablet_replica.cc:439] T c1bbae2777834cba9bb4124aaf326fbe P a99a92d079d84236bcdbd8ff5f0ddfad: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4dca6cd9810744e493c4879d080285b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 34247 } } peers { permanent_uuid: "5d6010dd8b8f4fe58796523605f77a17" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 43057 } } peers { permanent_uuid: "4dca6cd9810744e493c4879d080285b1" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34711 } } }
I20260808 14:45:32.636847 11118 tablet_replica.cc:442] T c1bbae2777834cba9bb4124aaf326fbe P a99a92d079d84236bcdbd8ff5f0ddfad: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:45:32.636875 11136 mvcc.cc:205] Tried to move back new op lower bound from 7316276562464174080 to 7316276562434977792. Current Snapshot: MvccSnapshot[applied={T|T < 7316276562464174080 or (T in {7316276562464174080})}]
I20260808 14:45:32.640103 11106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:32.637516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50868 (local address 127.30.214.131:43057)
0808 14:45:32.637560 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:32.637562 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:32.637572 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:45:32.637639 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:32.637639 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:32.637659 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:32.637724 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:45:32.637827 (+ 103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.638560 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.639244 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.639544 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.639613 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:32.639752 (+ 139us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:45:32.639878 (+ 126us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:45:32.639951 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:32.639977 (+ 26us) server_negotiation.cc:299] Negotiation successful
0808 14:45:32.640001 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 14:45:32.644927 11107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:32.642670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:51579 (local address 127.30.214.129:34711)
0808 14:45:32.642725 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:32.642726 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:32.642733 (+ 7us) server_negotiation.cc:407] Connection header received
0808 14:45:32.642752 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:32.642753 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:32.642763 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:32.642805 (+ 42us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:45:32.642933 (+ 128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.643365 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.644376 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.644548 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.644588 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:32.644751 (+ 163us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:45:32.644775 (+ 24us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:45:32.644804 (+ 29us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:32.644852 (+ 48us) server_negotiation.cc:299] Negotiation successful
0808 14:45:32.644868 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 14:45:32.644964 11076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:32.642467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.129:34711 (local address 127.30.214.131:51579)
0808 14:45:32.642532 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:32.642543 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:32.642584 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:32.642820 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:32.642821 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:32.642822 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 14:45:32.642879 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:32.642880 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.643424 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.643425 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:32.644306 (+ 881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:32.644309 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.644602 (+ 293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.644603 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:32.644667 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:32.644684 (+ 17us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 14:45:32.644807 (+ 123us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 14:45:32.644808 (+ 1us) client_negotiation.cc:769] Sending connection context
0808 14:45:32.644850 (+ 42us) client_negotiation.cc:240] Negotiation successful
0808 14:45:32.644890 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260808 14:45:32.647468 10802 raft_consensus.cc:1261] T df38f1bcd5f04916a62d095d10bde17b P a99a92d079d84236bcdbd8ff5f0ddfad [term 1 FOLLOWER]: Refusing update from remote peer 5d6010dd8b8f4fe58796523605f77a17: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:45:32.647562 10593 raft_consensus.cc:1261] T df38f1bcd5f04916a62d095d10bde17b P 4dca6cd9810744e493c4879d080285b1 [term 1 FOLLOWER]: Refusing update from remote peer 5d6010dd8b8f4fe58796523605f77a17: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:45:32.647855 11117 consensus_queue.cc:1035] T df38f1bcd5f04916a62d095d10bde17b P 5d6010dd8b8f4fe58796523605f77a17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 34247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:45:32.647985 11159 consensus_queue.cc:1035] T df38f1bcd5f04916a62d095d10bde17b P 5d6010dd8b8f4fe58796523605f77a17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dca6cd9810744e493c4879d080285b1" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:45:32.656296 11106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:32.653552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.129:45923 (local address 127.30.214.131:43057)
0808 14:45:32.653588 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:32.653590 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:32.653744 (+ 154us) server_negotiation.cc:407] Connection header received
0808 14:45:32.653812 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:32.653813 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:32.653824 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:32.653873 (+ 49us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:45:32.653975 (+ 102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.654573 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.655727 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.655910 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.655962 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:32.656118 (+ 156us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:45:32.656141 (+ 23us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:45:32.656170 (+ 29us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:32.656222 (+ 52us) server_negotiation.cc:299] Negotiation successful
0808 14:45:32.656240 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 14:45:32.656350 11188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:32.653510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.131:43057 (local address 127.30.214.129:45923)
0808 14:45:32.653681 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:32.653692 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:32.653753 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:32.653876 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:32.653877 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:32.653878 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 14:45:32.653931 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:32.653932 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.654646 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.654647 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:32.655650 (+ 1003us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:32.655651 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.655978 (+ 327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.655979 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:32.656031 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:32.656049 (+ 18us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 14:45:32.656175 (+ 126us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 14:45:32.656176 (+ 1us) client_negotiation.cc:769] Sending connection context
0808 14:45:32.656220 (+ 44us) client_negotiation.cc:240] Negotiation successful
0808 14:45:32.656263 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":99,"threads_started":1}
I20260808 14:45:32.663597 10360 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50104:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:45:32.663733 10360 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50104:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:45:32.664610 10360 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 578c10ced2184843b5084ac4b58829dd: Sending DeleteTablet for 3 replicas of tablet df38f1bcd5f04916a62d095d10bde17b
I20260808 14:45:32.665126 10561 tablet_service.cc:1514] Processing DeleteTablet for tablet df38f1bcd5f04916a62d095d10bde17b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:45:32 UTC) from {username='oryx', principal='oryx/127.30.214.190@KRBTEST.COM'} at 127.0.0.1:57890
I20260808 14:45:32.665133 10974 tablet_service.cc:1514] Processing DeleteTablet for tablet df38f1bcd5f04916a62d095d10bde17b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:45:32 UTC) from {username='oryx', principal='oryx/127.30.214.190@KRBTEST.COM'} at 127.0.0.1:50864
I20260808 14:45:32.665257 11154 tablet_replica.cc:330] T df38f1bcd5f04916a62d095d10bde17b P 5d6010dd8b8f4fe58796523605f77a17: stopping tablet replica
I20260808 14:45:32.665242 10774 tablet_service.cc:1514] Processing DeleteTablet for tablet df38f1bcd5f04916a62d095d10bde17b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:45:32 UTC) from {username='oryx', principal='oryx/127.30.214.190@KRBTEST.COM'} at 127.0.0.1:43452
I20260808 14:45:32.665323 11154 raft_consensus.cc:2229] T df38f1bcd5f04916a62d095d10bde17b P 5d6010dd8b8f4fe58796523605f77a17 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:45:32.665342 11152 tablet_replica.cc:330] T df38f1bcd5f04916a62d095d10bde17b P 4dca6cd9810744e493c4879d080285b1: stopping tablet replica
I20260808 14:45:32.665359 11151 tablet_replica.cc:330] T df38f1bcd5f04916a62d095d10bde17b P a99a92d079d84236bcdbd8ff5f0ddfad: stopping tablet replica
I20260808 14:45:32.665405 11152 raft_consensus.cc:2229] T df38f1bcd5f04916a62d095d10bde17b P 4dca6cd9810744e493c4879d080285b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:45:32.665418 11154 raft_consensus.cc:2258] T df38f1bcd5f04916a62d095d10bde17b P 5d6010dd8b8f4fe58796523605f77a17 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:45:32.665422 11151 raft_consensus.cc:2229] T df38f1bcd5f04916a62d095d10bde17b P a99a92d079d84236bcdbd8ff5f0ddfad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:45:32.665472 11152 raft_consensus.cc:2258] T df38f1bcd5f04916a62d095d10bde17b P 4dca6cd9810744e493c4879d080285b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:45:32.665510 11151 raft_consensus.cc:2258] T df38f1bcd5f04916a62d095d10bde17b P a99a92d079d84236bcdbd8ff5f0ddfad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:45:32.665856 11151 ts_tablet_manager.cc:1905] T df38f1bcd5f04916a62d095d10bde17b P a99a92d079d84236bcdbd8ff5f0ddfad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:45:32.666083 11152 ts_tablet_manager.cc:1905] T df38f1bcd5f04916a62d095d10bde17b P 4dca6cd9810744e493c4879d080285b1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:45:32.667521 11151 ts_tablet_manager.cc:1918] T df38f1bcd5f04916a62d095d10bde17b P a99a92d079d84236bcdbd8ff5f0ddfad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:45:32.667577 11151 log.cc:1196] T df38f1bcd5f04916a62d095d10bde17b P a99a92d079d84236bcdbd8ff5f0ddfad: Deleting WAL directory at /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/ts-1/wal/wals/df38f1bcd5f04916a62d095d10bde17b
I20260808 14:45:32.667735 11152 ts_tablet_manager.cc:1918] T df38f1bcd5f04916a62d095d10bde17b P 4dca6cd9810744e493c4879d080285b1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:45:32.667793 11152 log.cc:1196] T df38f1bcd5f04916a62d095d10bde17b P 4dca6cd9810744e493c4879d080285b1: Deleting WAL directory at /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/ts-0/wal/wals/df38f1bcd5f04916a62d095d10bde17b
I20260808 14:45:32.667793 11151 ts_tablet_manager.cc:1939] T df38f1bcd5f04916a62d095d10bde17b P a99a92d079d84236bcdbd8ff5f0ddfad: Deleting consensus metadata
I20260808 14:45:32.668045 11152 ts_tablet_manager.cc:1939] T df38f1bcd5f04916a62d095d10bde17b P 4dca6cd9810744e493c4879d080285b1: Deleting consensus metadata
I20260808 14:45:32.668175 10340 catalog_manager.cc:4841] TS a99a92d079d84236bcdbd8ff5f0ddfad (127.30.214.130:34247): tablet df38f1bcd5f04916a62d095d10bde17b (table test-table [id=0b8561e891394c0d9c51f172d3dcd05e]) successfully deleted
I20260808 14:45:32.668815 11154 ts_tablet_manager.cc:1905] T df38f1bcd5f04916a62d095d10bde17b P 5d6010dd8b8f4fe58796523605f77a17: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:45:32.669703 10340 catalog_manager.cc:4841] TS 4dca6cd9810744e493c4879d080285b1 (127.30.214.129:34711): tablet df38f1bcd5f04916a62d095d10bde17b (table test-table [id=0b8561e891394c0d9c51f172d3dcd05e]) successfully deleted
I20260808 14:45:32.670405 11154 ts_tablet_manager.cc:1918] T df38f1bcd5f04916a62d095d10bde17b P 5d6010dd8b8f4fe58796523605f77a17: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:45:32.670467 11154 log.cc:1196] T df38f1bcd5f04916a62d095d10bde17b P 5d6010dd8b8f4fe58796523605f77a17: Deleting WAL directory at /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/ts-2/wal/wals/df38f1bcd5f04916a62d095d10bde17b
I20260808 14:45:32.670682 11154 ts_tablet_manager.cc:1939] T df38f1bcd5f04916a62d095d10bde17b P 5d6010dd8b8f4fe58796523605f77a17: Deleting consensus metadata
I20260808 14:45:32.671001 10343 catalog_manager.cc:4841] TS 5d6010dd8b8f4fe58796523605f77a17 (127.30.214.131:43057): tablet df38f1bcd5f04916a62d095d10bde17b (table test-table [id=0b8561e891394c0d9c51f172d3dcd05e]) successfully deleted
Aug 08 14:45:32 dist-test-slave-42z9 krb5kdc[10298](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200332, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 14:45:32 dist-test-slave-42z9 krb5kdc[10298](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:45:32 dist-test-slave-42z9 krb5kdc[10298](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
W20260808 14:45:32.707504 10435 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:45:32.700359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50118 (local address 127.30.214.190:46267)
0808 14:45:32.700407 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:32.700409 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:32.700582 (+ 173us) server_negotiation.cc:407] Connection header received
0808 14:45:32.700640 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:32.700641 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:32.700654 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:32.700707 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:32.701464 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.702263 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.703423 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.703740 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.703829 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:32.707434 (+ 3605us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50118: BlockingRecv error: recv got EOF from 127.0.0.1:50118 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
Aug 08 14:45:32 dist-test-slave-42z9 krb5kdc[10298](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200332, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM
I20260808 14:45:32.717130 10435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:32.708713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50130 (local address 127.30.214.190:46267)
0808 14:45:32.708756 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:32.708758 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:32.708866 (+ 108us) server_negotiation.cc:407] Connection header received
0808 14:45:32.708932 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:32.708933 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:32.708945 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:32.709006 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:32.709612 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.710396 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.711287 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.711591 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.711657 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:32.714359 (+ 2702us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:32.714360 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:32.714361 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:32.714369 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:32.715944 (+ 1575us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:32.716336 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:32.716336 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:32.716337 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:32.716397 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:32.716588 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:32.716589 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:32.716590 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:32.716726 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:32.716822 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:32.716946 (+ 124us) server_negotiation.cc:299] Negotiation successful
0808 14:45:32.717029 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 14:45:32.719053 10360 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50130:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:45:32.719249 10360 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:45:32.720773 10974 tablet_service.cc:1467] Processing CreateTablet for tablet ff92a74f9911496493a042de18e7cd46 (DEFAULT_TABLE table=test-table [id=f0f31003122442829e486591d40e70bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:45:32.720950 10974 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff92a74f9911496493a042de18e7cd46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:45:32.720923 10561 tablet_service.cc:1467] Processing CreateTablet for tablet ff92a74f9911496493a042de18e7cd46 (DEFAULT_TABLE table=test-table [id=f0f31003122442829e486591d40e70bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:45:32.721035 10561 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff92a74f9911496493a042de18e7cd46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:45:32.722337 11115 tablet_bootstrap.cc:492] T ff92a74f9911496493a042de18e7cd46 P 4dca6cd9810744e493c4879d080285b1: Bootstrap starting.
I20260808 14:45:32.722424 11108 tablet_bootstrap.cc:492] T ff92a74f9911496493a042de18e7cd46 P 5d6010dd8b8f4fe58796523605f77a17: Bootstrap starting.
I20260808 14:45:32.722702 11115 tablet_bootstrap.cc:654] T ff92a74f9911496493a042de18e7cd46 P 4dca6cd9810744e493c4879d080285b1: Neither blocks nor log segments found. Creating new log.
I20260808 14:45:32.722808 11108 tablet_bootstrap.cc:654] T ff92a74f9911496493a042de18e7cd46 P 5d6010dd8b8f4fe58796523605f77a17: Neither blocks nor log segments found. Creating new log.
I20260808 14:45:32.722997 10774 tablet_service.cc:1467] Processing CreateTablet for tablet ff92a74f9911496493a042de18e7cd46 (DEFAULT_TABLE table=test-table [id=f0f31003122442829e486591d40e70bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:45:32.723126 10774 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff92a74f9911496493a042de18e7cd46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:45:32.724085 11108 tablet_bootstrap.cc:492] T ff92a74f9911496493a042de18e7cd46 P 5d6010dd8b8f4fe58796523605f77a17: No bootstrap required, opened a new log
I20260808 14:45:32.724139 11108 ts_tablet_manager.cc:1397] T ff92a74f9911496493a042de18e7cd46 P 5d6010dd8b8f4fe58796523605f77a17: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260808 14:45:32.724280 11108 raft_consensus.cc:348] T ff92a74f9911496493a042de18e7cd46 P 5d6010dd8b8f4fe58796523605f77a17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dca6cd9810744e493c4879d080285b1" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34711 } } peers { permanent_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 34247 } } peers { permanent_uuid: "5d6010dd8b8f4fe58796523605f77a17" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 43057 } }
I20260808 14:45:32.724350 11108 raft_consensus.cc:374] T ff92a74f9911496493a042de18e7cd46 P 5d6010dd8b8f4fe58796523605f77a17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:45:32.724368 11108 raft_consensus.cc:729] T ff92a74f9911496493a042de18e7cd46 P 5d6010dd8b8f4fe58796523605f77a17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d6010dd8b8f4fe58796523605f77a17, State: Initialized, Role: FOLLOWER
I20260808 14:45:32.724406 11108 consensus_queue.cc:260] T ff92a74f9911496493a042de18e7cd46 P 5d6010dd8b8f4fe58796523605f77a17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dca6cd9810744e493c4879d080285b1" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34711 } } peers { permanent_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 34247 } } peers { permanent_uuid: "5d6010dd8b8f4fe58796523605f77a17" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 43057 } }
I20260808 14:45:32.724438 11112 tablet_bootstrap.cc:492] T ff92a74f9911496493a042de18e7cd46 P a99a92d079d84236bcdbd8ff5f0ddfad: Bootstrap starting.
I20260808 14:45:32.724490 11108 ts_tablet_manager.cc:1428] T ff92a74f9911496493a042de18e7cd46 P 5d6010dd8b8f4fe58796523605f77a17: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:32.724612 11190 raft_consensus.cc:482] T ff92a74f9911496493a042de18e7cd46 P 5d6010dd8b8f4fe58796523605f77a17 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:45:32.724649 11190 raft_consensus.cc:504] T ff92a74f9911496493a042de18e7cd46 P 5d6010dd8b8f4fe58796523605f77a17 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dca6cd9810744e493c4879d080285b1" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34711 } } peers { permanent_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 34247 } } peers { permanent_uuid: "5d6010dd8b8f4fe58796523605f77a17" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 43057 } }
I20260808 14:45:32.724772 11190 leader_election.cc:288] T ff92a74f9911496493a042de18e7cd46 P 5d6010dd8b8f4fe58796523605f77a17 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dca6cd9810744e493c4879d080285b1 (127.30.214.129:34711), a99a92d079d84236bcdbd8ff5f0ddfad (127.30.214.130:34247)
I20260808 14:45:32.724852 11112 tablet_bootstrap.cc:654] T ff92a74f9911496493a042de18e7cd46 P a99a92d079d84236bcdbd8ff5f0ddfad: Neither blocks nor log segments found. Creating new log.
I20260808 14:45:32.725317 10593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff92a74f9911496493a042de18e7cd46" candidate_uuid: "5d6010dd8b8f4fe58796523605f77a17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dca6cd9810744e493c4879d080285b1" is_pre_election: true
I20260808 14:45:32.725616 10802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff92a74f9911496493a042de18e7cd46" candidate_uuid: "5d6010dd8b8f4fe58796523605f77a17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad" is_pre_election: true
W20260808 14:45:32.725679 10904 leader_election.cc:341] T ff92a74f9911496493a042de18e7cd46 P 5d6010dd8b8f4fe58796523605f77a17 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dca6cd9810744e493c4879d080285b1 (127.30.214.129:34711): Illegal state: must be running to vote when last-logged opid is not known
I20260808 14:45:32.726207 11115 tablet_bootstrap.cc:492] T ff92a74f9911496493a042de18e7cd46 P 4dca6cd9810744e493c4879d080285b1: No bootstrap required, opened a new log
I20260808 14:45:32.726254 11115 ts_tablet_manager.cc:1397] T ff92a74f9911496493a042de18e7cd46 P 4dca6cd9810744e493c4879d080285b1: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.001s
W20260808 14:45:32.726349 10904 leader_election.cc:341] T ff92a74f9911496493a042de18e7cd46 P 5d6010dd8b8f4fe58796523605f77a17 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a99a92d079d84236bcdbd8ff5f0ddfad (127.30.214.130:34247): Illegal state: must be running to vote when last-logged opid is not known
I20260808 14:45:32.726392 10904 leader_election.cc:302] T ff92a74f9911496493a042de18e7cd46 P 5d6010dd8b8f4fe58796523605f77a17 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d6010dd8b8f4fe58796523605f77a17; no voters: 4dca6cd9810744e493c4879d080285b1, a99a92d079d84236bcdbd8ff5f0ddfad
I20260808 14:45:32.726356 11115 raft_consensus.cc:348] T ff92a74f9911496493a042de18e7cd46 P 4dca6cd9810744e493c4879d080285b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dca6cd9810744e493c4879d080285b1" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34711 } } peers { permanent_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 34247 } } peers { permanent_uuid: "5d6010dd8b8f4fe58796523605f77a17" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 43057 } }
I20260808 14:45:32.726428 11115 raft_consensus.cc:374] T ff92a74f9911496493a042de18e7cd46 P 4dca6cd9810744e493c4879d080285b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:45:32.726447 11115 raft_consensus.cc:729] T ff92a74f9911496493a042de18e7cd46 P 4dca6cd9810744e493c4879d080285b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dca6cd9810744e493c4879d080285b1, State: Initialized, Role: FOLLOWER
I20260808 14:45:32.726482 11159 raft_consensus.cc:2726] T ff92a74f9911496493a042de18e7cd46 P 5d6010dd8b8f4fe58796523605f77a17 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260808 14:45:32.726487 11115 consensus_queue.cc:260] T ff92a74f9911496493a042de18e7cd46 P 4dca6cd9810744e493c4879d080285b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dca6cd9810744e493c4879d080285b1" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34711 } } peers { permanent_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 34247 } } peers { permanent_uuid: "5d6010dd8b8f4fe58796523605f77a17" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 43057 } }
I20260808 14:45:32.726578 11115 ts_tablet_manager.cc:1428] T ff92a74f9911496493a042de18e7cd46 P 4dca6cd9810744e493c4879d080285b1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:32.727080 11112 tablet_bootstrap.cc:492] T ff92a74f9911496493a042de18e7cd46 P a99a92d079d84236bcdbd8ff5f0ddfad: No bootstrap required, opened a new log
I20260808 14:45:32.727136 11112 ts_tablet_manager.cc:1397] T ff92a74f9911496493a042de18e7cd46 P a99a92d079d84236bcdbd8ff5f0ddfad: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.000s
I20260808 14:45:32.727291 11112 raft_consensus.cc:348] T ff92a74f9911496493a042de18e7cd46 P a99a92d079d84236bcdbd8ff5f0ddfad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dca6cd9810744e493c4879d080285b1" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34711 } } peers { permanent_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 34247 } } peers { permanent_uuid: "5d6010dd8b8f4fe58796523605f77a17" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 43057 } }
I20260808 14:45:32.727345 11112 raft_consensus.cc:374] T ff92a74f9911496493a042de18e7cd46 P a99a92d079d84236bcdbd8ff5f0ddfad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:45:32.727361 11112 raft_consensus.cc:729] T ff92a74f9911496493a042de18e7cd46 P a99a92d079d84236bcdbd8ff5f0ddfad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a99a92d079d84236bcdbd8ff5f0ddfad, State: Initialized, Role: FOLLOWER
I20260808 14:45:32.727398 11112 consensus_queue.cc:260] T ff92a74f9911496493a042de18e7cd46 P a99a92d079d84236bcdbd8ff5f0ddfad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dca6cd9810744e493c4879d080285b1" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34711 } } peers { permanent_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 34247 } } peers { permanent_uuid: "5d6010dd8b8f4fe58796523605f77a17" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 43057 } }
I20260808 14:45:32.727485 11112 ts_tablet_manager.cc:1428] T ff92a74f9911496493a042de18e7cd46 P a99a92d079d84236bcdbd8ff5f0ddfad: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:32.819538 11142 raft_consensus.cc:482] T ff92a74f9911496493a042de18e7cd46 P 4dca6cd9810744e493c4879d080285b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:45:32.819650 11142 raft_consensus.cc:504] T ff92a74f9911496493a042de18e7cd46 P 4dca6cd9810744e493c4879d080285b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dca6cd9810744e493c4879d080285b1" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34711 } } peers { permanent_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 34247 } } peers { permanent_uuid: "5d6010dd8b8f4fe58796523605f77a17" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 43057 } }
I20260808 14:45:32.819824 11142 leader_election.cc:288] T ff92a74f9911496493a042de18e7cd46 P 4dca6cd9810744e493c4879d080285b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a99a92d079d84236bcdbd8ff5f0ddfad (127.30.214.130:34247), 5d6010dd8b8f4fe58796523605f77a17 (127.30.214.131:43057)
I20260808 14:45:32.820044 10802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff92a74f9911496493a042de18e7cd46" candidate_uuid: "4dca6cd9810744e493c4879d080285b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad" is_pre_election: true
I20260808 14:45:32.820043 11002 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff92a74f9911496493a042de18e7cd46" candidate_uuid: "4dca6cd9810744e493c4879d080285b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d6010dd8b8f4fe58796523605f77a17" is_pre_election: true
I20260808 14:45:32.820137 10802 raft_consensus.cc:2454] T ff92a74f9911496493a042de18e7cd46 P a99a92d079d84236bcdbd8ff5f0ddfad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dca6cd9810744e493c4879d080285b1 in term 0.
I20260808 14:45:32.820143 11002 raft_consensus.cc:2454] T ff92a74f9911496493a042de18e7cd46 P 5d6010dd8b8f4fe58796523605f77a17 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dca6cd9810744e493c4879d080285b1 in term 0.
I20260808 14:45:32.820294 10487 leader_election.cc:302] T ff92a74f9911496493a042de18e7cd46 P 4dca6cd9810744e493c4879d080285b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dca6cd9810744e493c4879d080285b1, a99a92d079d84236bcdbd8ff5f0ddfad; no voters:
I20260808 14:45:32.820391 11142 raft_consensus.cc:2781] T ff92a74f9911496493a042de18e7cd46 P 4dca6cd9810744e493c4879d080285b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:45:32.820416 11142 raft_consensus.cc:482] T ff92a74f9911496493a042de18e7cd46 P 4dca6cd9810744e493c4879d080285b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:45:32.820432 11142 raft_consensus.cc:3037] T ff92a74f9911496493a042de18e7cd46 P 4dca6cd9810744e493c4879d080285b1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:32.821179 11142 raft_consensus.cc:504] T ff92a74f9911496493a042de18e7cd46 P 4dca6cd9810744e493c4879d080285b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dca6cd9810744e493c4879d080285b1" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34711 } } peers { permanent_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 34247 } } peers { permanent_uuid: "5d6010dd8b8f4fe58796523605f77a17" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 43057 } }
I20260808 14:45:32.821309 11142 leader_election.cc:288] T ff92a74f9911496493a042de18e7cd46 P 4dca6cd9810744e493c4879d080285b1 [CANDIDATE]: Term 1 election: Requested vote from peers a99a92d079d84236bcdbd8ff5f0ddfad (127.30.214.130:34247), 5d6010dd8b8f4fe58796523605f77a17 (127.30.214.131:43057)
I20260808 14:45:32.821529 11002 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff92a74f9911496493a042de18e7cd46" candidate_uuid: "4dca6cd9810744e493c4879d080285b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d6010dd8b8f4fe58796523605f77a17"
I20260808 14:45:32.821529 10802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff92a74f9911496493a042de18e7cd46" candidate_uuid: "4dca6cd9810744e493c4879d080285b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad"
I20260808 14:45:32.821600 11002 raft_consensus.cc:3037] T ff92a74f9911496493a042de18e7cd46 P 5d6010dd8b8f4fe58796523605f77a17 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:32.821610 10802 raft_consensus.cc:3037] T ff92a74f9911496493a042de18e7cd46 P a99a92d079d84236bcdbd8ff5f0ddfad [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:32.822357 10802 raft_consensus.cc:2454] T ff92a74f9911496493a042de18e7cd46 P a99a92d079d84236bcdbd8ff5f0ddfad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dca6cd9810744e493c4879d080285b1 in term 1.
I20260808 14:45:32.822357 11002 raft_consensus.cc:2454] T ff92a74f9911496493a042de18e7cd46 P 5d6010dd8b8f4fe58796523605f77a17 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dca6cd9810744e493c4879d080285b1 in term 1.
I20260808 14:45:32.822537 10490 leader_election.cc:302] T ff92a74f9911496493a042de18e7cd46 P 4dca6cd9810744e493c4879d080285b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dca6cd9810744e493c4879d080285b1, 5d6010dd8b8f4fe58796523605f77a17; no voters:
I20260808 14:45:32.822656 11142 raft_consensus.cc:2781] T ff92a74f9911496493a042de18e7cd46 P 4dca6cd9810744e493c4879d080285b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:45:32.822695 11142 raft_consensus.cc:686] T ff92a74f9911496493a042de18e7cd46 P 4dca6cd9810744e493c4879d080285b1 [term 1 LEADER]: Becoming Leader. State: Replica: 4dca6cd9810744e493c4879d080285b1, State: Running, Role: LEADER
I20260808 14:45:32.822737 11142 consensus_queue.cc:237] T ff92a74f9911496493a042de18e7cd46 P 4dca6cd9810744e493c4879d080285b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dca6cd9810744e493c4879d080285b1" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34711 } } peers { permanent_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 34247 } } peers { permanent_uuid: "5d6010dd8b8f4fe58796523605f77a17" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 43057 } }
I20260808 14:45:32.823621 10360 catalog_manager.cc:5495] T ff92a74f9911496493a042de18e7cd46 P 4dca6cd9810744e493c4879d080285b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4dca6cd9810744e493c4879d080285b1 (127.30.214.129). New cstate: current_term: 1 leader_uuid: "4dca6cd9810744e493c4879d080285b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dca6cd9810744e493c4879d080285b1" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 34247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d6010dd8b8f4fe58796523605f77a17" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 43057 } health_report { overall_health: UNKNOWN } } }
I20260808 14:45:32.844014 11107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:32.841980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57914 (local address 127.30.214.129:34711)
0808 14:45:32.842032 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:32.842034 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:32.842060 (+ 26us) server_negotiation.cc:407] Connection header received
0808 14:45:32.842131 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:32.842131 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:32.842141 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:32.842187 (+ 46us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:45:32.842290 (+ 103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.842764 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.843486 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.843679 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.843728 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:32.843821 (+ 93us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:45:32.843847 (+ 26us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:45:32.843879 (+ 32us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:32.843917 (+ 38us) server_negotiation.cc:299] Negotiation successful
0808 14:45:32.843933 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 14:45:32.844825 11002 raft_consensus.cc:1261] T ff92a74f9911496493a042de18e7cd46 P 5d6010dd8b8f4fe58796523605f77a17 [term 1 FOLLOWER]: Refusing update from remote peer 4dca6cd9810744e493c4879d080285b1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:45:32.844887 10802 raft_consensus.cc:1261] T ff92a74f9911496493a042de18e7cd46 P a99a92d079d84236bcdbd8ff5f0ddfad [term 1 FOLLOWER]: Refusing update from remote peer 4dca6cd9810744e493c4879d080285b1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:45:32.845078 11142 consensus_queue.cc:1035] T ff92a74f9911496493a042de18e7cd46 P 4dca6cd9810744e493c4879d080285b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d6010dd8b8f4fe58796523605f77a17" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 43057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:45:32.845206 11131 consensus_queue.cc:1035] T ff92a74f9911496493a042de18e7cd46 P 4dca6cd9810744e493c4879d080285b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 34247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:45:32.847582 10362 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50130:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:45:32.847683 10362 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50130:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:45:32.848284 10362 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 578c10ced2184843b5084ac4b58829dd: Sending DeleteTablet for 3 replicas of tablet ff92a74f9911496493a042de18e7cd46
I20260808 14:45:32.848513 10974 tablet_service.cc:1514] Processing DeleteTablet for tablet ff92a74f9911496493a042de18e7cd46 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:45:32 UTC) from {username='oryx', principal='oryx/127.30.214.190@KRBTEST.COM'} at 127.0.0.1:50864
I20260808 14:45:32.848637 11154 tablet_replica.cc:330] T ff92a74f9911496493a042de18e7cd46 P 5d6010dd8b8f4fe58796523605f77a17: stopping tablet replica
I20260808 14:45:32.848639 10561 tablet_service.cc:1514] Processing DeleteTablet for tablet ff92a74f9911496493a042de18e7cd46 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:45:32 UTC) from {username='oryx', principal='oryx/127.30.214.190@KRBTEST.COM'} at 127.0.0.1:57890
I20260808 14:45:32.848714 11154 raft_consensus.cc:2229] T ff92a74f9911496493a042de18e7cd46 P 5d6010dd8b8f4fe58796523605f77a17 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:45:32.848760 11154 raft_consensus.cc:2258] T ff92a74f9911496493a042de18e7cd46 P 5d6010dd8b8f4fe58796523605f77a17 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:45:32.848737 10774 tablet_service.cc:1514] Processing DeleteTablet for tablet ff92a74f9911496493a042de18e7cd46 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:45:32 UTC) from {username='oryx', principal='oryx/127.30.214.190@KRBTEST.COM'} at 127.0.0.1:43452
I20260808 14:45:32.848834 11152 tablet_replica.cc:330] T ff92a74f9911496493a042de18e7cd46 P 4dca6cd9810744e493c4879d080285b1: stopping tablet replica
I20260808 14:45:32.848852 11151 tablet_replica.cc:330] T ff92a74f9911496493a042de18e7cd46 P a99a92d079d84236bcdbd8ff5f0ddfad: stopping tablet replica
I20260808 14:45:32.848893 11152 raft_consensus.cc:2229] T ff92a74f9911496493a042de18e7cd46 P 4dca6cd9810744e493c4879d080285b1 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:45:32.848896 11151 raft_consensus.cc:2229] T ff92a74f9911496493a042de18e7cd46 P a99a92d079d84236bcdbd8ff5f0ddfad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:45:32.848939 11151 raft_consensus.cc:2258] T ff92a74f9911496493a042de18e7cd46 P a99a92d079d84236bcdbd8ff5f0ddfad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:45:32.848959 11152 raft_consensus.cc:2258] T ff92a74f9911496493a042de18e7cd46 P 4dca6cd9810744e493c4879d080285b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:45:32.849071 10362 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50130:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:45:32.849217 10362 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:45:32.849375 11151 ts_tablet_manager.cc:1905] T ff92a74f9911496493a042de18e7cd46 P a99a92d079d84236bcdbd8ff5f0ddfad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:45:32.849649 11154 ts_tablet_manager.cc:1905] T ff92a74f9911496493a042de18e7cd46 P 5d6010dd8b8f4fe58796523605f77a17: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:45:32.849771 11152 ts_tablet_manager.cc:1905] T ff92a74f9911496493a042de18e7cd46 P 4dca6cd9810744e493c4879d080285b1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:45:32.850904 11154 ts_tablet_manager.cc:1918] T ff92a74f9911496493a042de18e7cd46 P 5d6010dd8b8f4fe58796523605f77a17: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:45:32.850937 11151 ts_tablet_manager.cc:1918] T ff92a74f9911496493a042de18e7cd46 P a99a92d079d84236bcdbd8ff5f0ddfad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:45:32.850961 11154 log.cc:1196] T ff92a74f9911496493a042de18e7cd46 P 5d6010dd8b8f4fe58796523605f77a17: Deleting WAL directory at /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/ts-2/wal/wals/ff92a74f9911496493a042de18e7cd46
I20260808 14:45:32.850994 11151 log.cc:1196] T ff92a74f9911496493a042de18e7cd46 P a99a92d079d84236bcdbd8ff5f0ddfad: Deleting WAL directory at /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/ts-1/wal/wals/ff92a74f9911496493a042de18e7cd46
I20260808 14:45:32.851171 11154 ts_tablet_manager.cc:1939] T ff92a74f9911496493a042de18e7cd46 P 5d6010dd8b8f4fe58796523605f77a17: Deleting consensus metadata
I20260808 14:45:32.851217 11152 ts_tablet_manager.cc:1918] T ff92a74f9911496493a042de18e7cd46 P 4dca6cd9810744e493c4879d080285b1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:45:32.851241 11151 ts_tablet_manager.cc:1939] T ff92a74f9911496493a042de18e7cd46 P a99a92d079d84236bcdbd8ff5f0ddfad: Deleting consensus metadata
I20260808 14:45:32.851279 11152 log.cc:1196] T ff92a74f9911496493a042de18e7cd46 P 4dca6cd9810744e493c4879d080285b1: Deleting WAL directory at /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/ts-0/wal/wals/ff92a74f9911496493a042de18e7cd46
I20260808 14:45:32.851459 11152 ts_tablet_manager.cc:1939] T ff92a74f9911496493a042de18e7cd46 P 4dca6cd9810744e493c4879d080285b1: Deleting consensus metadata
I20260808 14:45:32.851478 10343 catalog_manager.cc:4841] TS 5d6010dd8b8f4fe58796523605f77a17 (127.30.214.131:43057): tablet ff92a74f9911496493a042de18e7cd46 (table test-table [id=f0f31003122442829e486591d40e70bf]) successfully deleted
I20260808 14:45:32.851809 10340 catalog_manager.cc:4841] TS a99a92d079d84236bcdbd8ff5f0ddfad (127.30.214.130:34247): tablet ff92a74f9911496493a042de18e7cd46 (table test-table [id=f0f31003122442829e486591d40e70bf]) successfully deleted
I20260808 14:45:32.851881 10340 catalog_manager.cc:4841] TS 4dca6cd9810744e493c4879d080285b1 (127.30.214.129:34711): tablet ff92a74f9911496493a042de18e7cd46 (table test-table [id=f0f31003122442829e486591d40e70bf]) successfully deleted
I20260808 14:45:32.852371 10561 tablet_service.cc:1467] Processing CreateTablet for tablet c0e322eb35fb43c59917b8d0b3667215 (DEFAULT_TABLE table=test-table [id=4889720f55e044e9bfb4dbaf559382b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:45:32.852473 10561 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c0e322eb35fb43c59917b8d0b3667215. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:45:32.853242 11115 tablet_bootstrap.cc:492] T c0e322eb35fb43c59917b8d0b3667215 P 4dca6cd9810744e493c4879d080285b1: Bootstrap starting.
I20260808 14:45:32.853271 10774 tablet_service.cc:1467] Processing CreateTablet for tablet c0e322eb35fb43c59917b8d0b3667215 (DEFAULT_TABLE table=test-table [id=4889720f55e044e9bfb4dbaf559382b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:45:32.853376 10774 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c0e322eb35fb43c59917b8d0b3667215. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:45:32.853582 11115 tablet_bootstrap.cc:654] T c0e322eb35fb43c59917b8d0b3667215 P 4dca6cd9810744e493c4879d080285b1: Neither blocks nor log segments found. Creating new log.
I20260808 14:45:32.854072 11115 tablet_bootstrap.cc:492] T c0e322eb35fb43c59917b8d0b3667215 P 4dca6cd9810744e493c4879d080285b1: No bootstrap required, opened a new log
I20260808 14:45:32.854113 11115 ts_tablet_manager.cc:1397] T c0e322eb35fb43c59917b8d0b3667215 P 4dca6cd9810744e493c4879d080285b1: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 14:45:32.854212 11115 raft_consensus.cc:348] T c0e322eb35fb43c59917b8d0b3667215 P 4dca6cd9810744e493c4879d080285b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dca6cd9810744e493c4879d080285b1" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34711 } } peers { permanent_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 34247 } } peers { permanent_uuid: "5d6010dd8b8f4fe58796523605f77a17" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 43057 } }
I20260808 14:45:32.854269 11115 raft_consensus.cc:374] T c0e322eb35fb43c59917b8d0b3667215 P 4dca6cd9810744e493c4879d080285b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:45:32.854286 11115 raft_consensus.cc:729] T c0e322eb35fb43c59917b8d0b3667215 P 4dca6cd9810744e493c4879d080285b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dca6cd9810744e493c4879d080285b1, State: Initialized, Role: FOLLOWER
I20260808 14:45:32.854336 11115 consensus_queue.cc:260] T c0e322eb35fb43c59917b8d0b3667215 P 4dca6cd9810744e493c4879d080285b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dca6cd9810744e493c4879d080285b1" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34711 } } peers { permanent_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 34247 } } peers { permanent_uuid: "5d6010dd8b8f4fe58796523605f77a17" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 43057 } }
I20260808 14:45:32.854429 11115 ts_tablet_manager.cc:1428] T c0e322eb35fb43c59917b8d0b3667215 P 4dca6cd9810744e493c4879d080285b1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:32.854465 11112 tablet_bootstrap.cc:492] T c0e322eb35fb43c59917b8d0b3667215 P a99a92d079d84236bcdbd8ff5f0ddfad: Bootstrap starting.
I20260808 14:45:32.854832 11112 tablet_bootstrap.cc:654] T c0e322eb35fb43c59917b8d0b3667215 P a99a92d079d84236bcdbd8ff5f0ddfad: Neither blocks nor log segments found. Creating new log.
I20260808 14:45:32.855360 10974 tablet_service.cc:1467] Processing CreateTablet for tablet c0e322eb35fb43c59917b8d0b3667215 (DEFAULT_TABLE table=test-table [id=4889720f55e044e9bfb4dbaf559382b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:45:32.855477 10974 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c0e322eb35fb43c59917b8d0b3667215. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:45:32.855670 11112 tablet_bootstrap.cc:492] T c0e322eb35fb43c59917b8d0b3667215 P a99a92d079d84236bcdbd8ff5f0ddfad: No bootstrap required, opened a new log
I20260808 14:45:32.855717 11112 ts_tablet_manager.cc:1397] T c0e322eb35fb43c59917b8d0b3667215 P a99a92d079d84236bcdbd8ff5f0ddfad: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260808 14:45:32.855854 11112 raft_consensus.cc:348] T c0e322eb35fb43c59917b8d0b3667215 P a99a92d079d84236bcdbd8ff5f0ddfad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dca6cd9810744e493c4879d080285b1" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34711 } } peers { permanent_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 34247 } } peers { permanent_uuid: "5d6010dd8b8f4fe58796523605f77a17" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 43057 } }
I20260808 14:45:32.855921 11112 raft_consensus.cc:374] T c0e322eb35fb43c59917b8d0b3667215 P a99a92d079d84236bcdbd8ff5f0ddfad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:45:32.855938 11112 raft_consensus.cc:729] T c0e322eb35fb43c59917b8d0b3667215 P a99a92d079d84236bcdbd8ff5f0ddfad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a99a92d079d84236bcdbd8ff5f0ddfad, State: Initialized, Role: FOLLOWER
I20260808 14:45:32.855983 11112 consensus_queue.cc:260] T c0e322eb35fb43c59917b8d0b3667215 P a99a92d079d84236bcdbd8ff5f0ddfad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dca6cd9810744e493c4879d080285b1" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34711 } } peers { permanent_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 34247 } } peers { permanent_uuid: "5d6010dd8b8f4fe58796523605f77a17" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 43057 } }
I20260808 14:45:32.856073 11112 ts_tablet_manager.cc:1428] T c0e322eb35fb43c59917b8d0b3667215 P a99a92d079d84236bcdbd8ff5f0ddfad: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:32.856472 11108 tablet_bootstrap.cc:492] T c0e322eb35fb43c59917b8d0b3667215 P 5d6010dd8b8f4fe58796523605f77a17: Bootstrap starting.
I20260808 14:45:32.856803 11108 tablet_bootstrap.cc:654] T c0e322eb35fb43c59917b8d0b3667215 P 5d6010dd8b8f4fe58796523605f77a17: Neither blocks nor log segments found. Creating new log.
I20260808 14:45:32.857295 11108 tablet_bootstrap.cc:492] T c0e322eb35fb43c59917b8d0b3667215 P 5d6010dd8b8f4fe58796523605f77a17: No bootstrap required, opened a new log
I20260808 14:45:32.857338 11108 ts_tablet_manager.cc:1397] T c0e322eb35fb43c59917b8d0b3667215 P 5d6010dd8b8f4fe58796523605f77a17: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260808 14:45:32.857461 11108 raft_consensus.cc:348] T c0e322eb35fb43c59917b8d0b3667215 P 5d6010dd8b8f4fe58796523605f77a17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dca6cd9810744e493c4879d080285b1" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34711 } } peers { permanent_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 34247 } } peers { permanent_uuid: "5d6010dd8b8f4fe58796523605f77a17" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 43057 } }
I20260808 14:45:32.857532 11108 raft_consensus.cc:374] T c0e322eb35fb43c59917b8d0b3667215 P 5d6010dd8b8f4fe58796523605f77a17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:45:32.857550 11108 raft_consensus.cc:729] T c0e322eb35fb43c59917b8d0b3667215 P 5d6010dd8b8f4fe58796523605f77a17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d6010dd8b8f4fe58796523605f77a17, State: Initialized, Role: FOLLOWER
I20260808 14:45:32.857600 11108 consensus_queue.cc:260] T c0e322eb35fb43c59917b8d0b3667215 P 5d6010dd8b8f4fe58796523605f77a17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dca6cd9810744e493c4879d080285b1" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34711 } } peers { permanent_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 34247 } } peers { permanent_uuid: "5d6010dd8b8f4fe58796523605f77a17" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 43057 } }
I20260808 14:45:32.857693 11108 ts_tablet_manager.cc:1428] T c0e322eb35fb43c59917b8d0b3667215 P 5d6010dd8b8f4fe58796523605f77a17: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:32.907927 11142 raft_consensus.cc:482] T c0e322eb35fb43c59917b8d0b3667215 P 4dca6cd9810744e493c4879d080285b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:45:32.908046 11142 raft_consensus.cc:504] T c0e322eb35fb43c59917b8d0b3667215 P 4dca6cd9810744e493c4879d080285b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dca6cd9810744e493c4879d080285b1" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34711 } } peers { permanent_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 34247 } } peers { permanent_uuid: "5d6010dd8b8f4fe58796523605f77a17" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 43057 } }
I20260808 14:45:32.908229 11142 leader_election.cc:288] T c0e322eb35fb43c59917b8d0b3667215 P 4dca6cd9810744e493c4879d080285b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a99a92d079d84236bcdbd8ff5f0ddfad (127.30.214.130:34247), 5d6010dd8b8f4fe58796523605f77a17 (127.30.214.131:43057)
I20260808 14:45:32.908461 10802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0e322eb35fb43c59917b8d0b3667215" candidate_uuid: "4dca6cd9810744e493c4879d080285b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad" is_pre_election: true
I20260808 14:45:32.908468 11002 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0e322eb35fb43c59917b8d0b3667215" candidate_uuid: "4dca6cd9810744e493c4879d080285b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d6010dd8b8f4fe58796523605f77a17" is_pre_election: true
I20260808 14:45:32.908561 10802 raft_consensus.cc:2454] T c0e322eb35fb43c59917b8d0b3667215 P a99a92d079d84236bcdbd8ff5f0ddfad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dca6cd9810744e493c4879d080285b1 in term 0.
I20260808 14:45:32.908576 11002 raft_consensus.cc:2454] T c0e322eb35fb43c59917b8d0b3667215 P 5d6010dd8b8f4fe58796523605f77a17 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dca6cd9810744e493c4879d080285b1 in term 0.
I20260808 14:45:32.908735 10490 leader_election.cc:302] T c0e322eb35fb43c59917b8d0b3667215 P 4dca6cd9810744e493c4879d080285b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dca6cd9810744e493c4879d080285b1, 5d6010dd8b8f4fe58796523605f77a17; no voters:
I20260808 14:45:32.908847 11142 raft_consensus.cc:2781] T c0e322eb35fb43c59917b8d0b3667215 P 4dca6cd9810744e493c4879d080285b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:45:32.908887 11142 raft_consensus.cc:482] T c0e322eb35fb43c59917b8d0b3667215 P 4dca6cd9810744e493c4879d080285b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:45:32.908900 11142 raft_consensus.cc:3037] T c0e322eb35fb43c59917b8d0b3667215 P 4dca6cd9810744e493c4879d080285b1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:32.909647 11142 raft_consensus.cc:504] T c0e322eb35fb43c59917b8d0b3667215 P 4dca6cd9810744e493c4879d080285b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dca6cd9810744e493c4879d080285b1" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34711 } } peers { permanent_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 34247 } } peers { permanent_uuid: "5d6010dd8b8f4fe58796523605f77a17" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 43057 } }
I20260808 14:45:32.909770 11142 leader_election.cc:288] T c0e322eb35fb43c59917b8d0b3667215 P 4dca6cd9810744e493c4879d080285b1 [CANDIDATE]: Term 1 election: Requested vote from peers a99a92d079d84236bcdbd8ff5f0ddfad (127.30.214.130:34247), 5d6010dd8b8f4fe58796523605f77a17 (127.30.214.131:43057)
I20260808 14:45:32.909951 11002 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0e322eb35fb43c59917b8d0b3667215" candidate_uuid: "4dca6cd9810744e493c4879d080285b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d6010dd8b8f4fe58796523605f77a17"
I20260808 14:45:32.909965 10802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0e322eb35fb43c59917b8d0b3667215" candidate_uuid: "4dca6cd9810744e493c4879d080285b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad"
I20260808 14:45:32.910043 10802 raft_consensus.cc:3037] T c0e322eb35fb43c59917b8d0b3667215 P a99a92d079d84236bcdbd8ff5f0ddfad [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:32.910046 11002 raft_consensus.cc:3037] T c0e322eb35fb43c59917b8d0b3667215 P 5d6010dd8b8f4fe58796523605f77a17 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:32.910610 10802 raft_consensus.cc:2454] T c0e322eb35fb43c59917b8d0b3667215 P a99a92d079d84236bcdbd8ff5f0ddfad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dca6cd9810744e493c4879d080285b1 in term 1.
I20260808 14:45:32.910697 11002 raft_consensus.cc:2454] T c0e322eb35fb43c59917b8d0b3667215 P 5d6010dd8b8f4fe58796523605f77a17 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dca6cd9810744e493c4879d080285b1 in term 1.
I20260808 14:45:32.910796 10487 leader_election.cc:302] T c0e322eb35fb43c59917b8d0b3667215 P 4dca6cd9810744e493c4879d080285b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dca6cd9810744e493c4879d080285b1, a99a92d079d84236bcdbd8ff5f0ddfad; no voters:
I20260808 14:45:32.910892 11142 raft_consensus.cc:2781] T c0e322eb35fb43c59917b8d0b3667215 P 4dca6cd9810744e493c4879d080285b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:45:32.910960 11142 raft_consensus.cc:686] T c0e322eb35fb43c59917b8d0b3667215 P 4dca6cd9810744e493c4879d080285b1 [term 1 LEADER]: Becoming Leader. State: Replica: 4dca6cd9810744e493c4879d080285b1, State: Running, Role: LEADER
I20260808 14:45:32.911015 11142 consensus_queue.cc:237] T c0e322eb35fb43c59917b8d0b3667215 P 4dca6cd9810744e493c4879d080285b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dca6cd9810744e493c4879d080285b1" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34711 } } peers { permanent_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 34247 } } peers { permanent_uuid: "5d6010dd8b8f4fe58796523605f77a17" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 43057 } }
I20260808 14:45:32.911654 10360 catalog_manager.cc:5495] T c0e322eb35fb43c59917b8d0b3667215 P 4dca6cd9810744e493c4879d080285b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4dca6cd9810744e493c4879d080285b1 (127.30.214.129). New cstate: current_term: 1 leader_uuid: "4dca6cd9810744e493c4879d080285b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dca6cd9810744e493c4879d080285b1" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 34247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d6010dd8b8f4fe58796523605f77a17" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 43057 } health_report { overall_health: UNKNOWN } } }
I20260808 14:45:32.920606 11107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:32.918633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.129:58123 (local address 127.30.214.129:34711)
0808 14:45:32.918673 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:32.918674 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:32.918682 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:45:32.918720 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:32.918721 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:32.918730 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:32.918775 (+ 45us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:45:32.918885 (+ 110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.919359 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.920031 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.920208 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.920262 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:32.920376 (+ 114us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:45:32.920404 (+ 28us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:45:32.920443 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:32.920492 (+ 49us) server_negotiation.cc:299] Negotiation successful
0808 14:45:32.920510 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 14:45:32.920606 11188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:32.918566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.129:34711 (local address 127.30.214.129:58123)
0808 14:45:32.918614 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:32.918626 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:32.918671 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:32.918781 (+ 110us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:32.918782 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:32.918783 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 14:45:32.918828 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:32.918830 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.919425 (+ 595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.919426 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:32.919955 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:32.919956 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:32.920264 (+ 308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:32.920264 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:32.920313 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:32.920319 (+ 6us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 14:45:32.920448 (+ 129us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 14:45:32.920449 (+ 1us) client_negotiation.cc:769] Sending connection context
0808 14:45:32.920490 (+ 41us) client_negotiation.cc:240] Negotiation successful
0808 14:45:32.920534 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
I20260808 14:45:32.922432 11002 raft_consensus.cc:1261] T c0e322eb35fb43c59917b8d0b3667215 P 5d6010dd8b8f4fe58796523605f77a17 [term 1 FOLLOWER]: Refusing update from remote peer 4dca6cd9810744e493c4879d080285b1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:45:32.922453 10802 raft_consensus.cc:1261] T c0e322eb35fb43c59917b8d0b3667215 P a99a92d079d84236bcdbd8ff5f0ddfad [term 1 FOLLOWER]: Refusing update from remote peer 4dca6cd9810744e493c4879d080285b1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:45:32.922662 11123 consensus_queue.cc:1035] T c0e322eb35fb43c59917b8d0b3667215 P 4dca6cd9810744e493c4879d080285b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a99a92d079d84236bcdbd8ff5f0ddfad" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 34247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:45:32.922780 11142 consensus_queue.cc:1035] T c0e322eb35fb43c59917b8d0b3667215 P 4dca6cd9810744e493c4879d080285b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d6010dd8b8f4fe58796523605f77a17" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 43057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:45:32.933184 10362 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50130:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:45:32.933295 10362 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50130:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:45:32.933926 10362 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 578c10ced2184843b5084ac4b58829dd: Sending DeleteTablet for 3 replicas of tablet c0e322eb35fb43c59917b8d0b3667215
I20260808 14:45:32.934180 10974 tablet_service.cc:1514] Processing DeleteTablet for tablet c0e322eb35fb43c59917b8d0b3667215 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:45:32 UTC) from {username='oryx', principal='oryx/127.30.214.190@KRBTEST.COM'} at 127.0.0.1:50864
I20260808 14:45:32.934208 10774 tablet_service.cc:1514] Processing DeleteTablet for tablet c0e322eb35fb43c59917b8d0b3667215 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:45:32 UTC) from {username='oryx', principal='oryx/127.30.214.190@KRBTEST.COM'} at 127.0.0.1:43452
I20260808 14:45:32.934288 11154 tablet_replica.cc:330] T c0e322eb35fb43c59917b8d0b3667215 P 5d6010dd8b8f4fe58796523605f77a17: stopping tablet replica
I20260808 14:45:32.934297 11151 tablet_replica.cc:330] T c0e322eb35fb43c59917b8d0b3667215 P a99a92d079d84236bcdbd8ff5f0ddfad: stopping tablet replica
I20260808 14:45:32.934346 11154 raft_consensus.cc:2229] T c0e322eb35fb43c59917b8d0b3667215 P 5d6010dd8b8f4fe58796523605f77a17 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:45:32.934351 11151 raft_consensus.cc:2229] T c0e322eb35fb43c59917b8d0b3667215 P a99a92d079d84236bcdbd8ff5f0ddfad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:45:32.934382 11154 raft_consensus.cc:2258] T c0e322eb35fb43c59917b8d0b3667215 P 5d6010dd8b8f4fe58796523605f77a17 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:45:32.934387 11151 raft_consensus.cc:2258] T c0e322eb35fb43c59917b8d0b3667215 P a99a92d079d84236bcdbd8ff5f0ddfad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:45:32.934454 10561 tablet_service.cc:1514] Processing DeleteTablet for tablet c0e322eb35fb43c59917b8d0b3667215 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:45:32 UTC) from {username='oryx', principal='oryx/127.30.214.190@KRBTEST.COM'} at 127.0.0.1:57890
I20260808 14:45:32.934541 11152 tablet_replica.cc:330] T c0e322eb35fb43c59917b8d0b3667215 P 4dca6cd9810744e493c4879d080285b1: stopping tablet replica
I20260808 14:45:32.934592 11152 raft_consensus.cc:2229] T c0e322eb35fb43c59917b8d0b3667215 P 4dca6cd9810744e493c4879d080285b1 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:45:32.934646 11152 raft_consensus.cc:2258] T c0e322eb35fb43c59917b8d0b3667215 P 4dca6cd9810744e493c4879d080285b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:45:32.934659 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 10465
I20260808 14:45:32.934734 11154 ts_tablet_manager.cc:1905] T c0e322eb35fb43c59917b8d0b3667215 P 5d6010dd8b8f4fe58796523605f77a17: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:45:32.937211 11154 ts_tablet_manager.cc:1918] T c0e322eb35fb43c59917b8d0b3667215 P 5d6010dd8b8f4fe58796523605f77a17: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:45:32.937282 11154 log.cc:1196] T c0e322eb35fb43c59917b8d0b3667215 P 5d6010dd8b8f4fe58796523605f77a17: Deleting WAL directory at /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/ts-2/wal/wals/c0e322eb35fb43c59917b8d0b3667215
I20260808 14:45:32.937525 11154 ts_tablet_manager.cc:1939] T c0e322eb35fb43c59917b8d0b3667215 P 5d6010dd8b8f4fe58796523605f77a17: Deleting consensus metadata
I20260808 14:45:32.937948 11151 ts_tablet_manager.cc:1905] T c0e322eb35fb43c59917b8d0b3667215 P a99a92d079d84236bcdbd8ff5f0ddfad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:45:32.939580 11151 ts_tablet_manager.cc:1918] T c0e322eb35fb43c59917b8d0b3667215 P a99a92d079d84236bcdbd8ff5f0ddfad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:45:32.939633 11151 log.cc:1196] T c0e322eb35fb43c59917b8d0b3667215 P a99a92d079d84236bcdbd8ff5f0ddfad: Deleting WAL directory at /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786200295877777-31578-0/minicluster-data/ts-1/wal/wals/c0e322eb35fb43c59917b8d0b3667215
I20260808 14:45:32.939818 11151 ts_tablet_manager.cc:1939] T c0e322eb35fb43c59917b8d0b3667215 P a99a92d079d84236bcdbd8ff5f0ddfad: Deleting consensus metadata
I20260808 14:45:32.940068 10343 catalog_manager.cc:4841] TS 5d6010dd8b8f4fe58796523605f77a17 (127.30.214.131:43057): tablet c0e322eb35fb43c59917b8d0b3667215 (table test-table [id=4889720f55e044e9bfb4dbaf559382b7]) successfully deleted
I20260808 14:45:32.940436 10340 catalog_manager.cc:4841] TS a99a92d079d84236bcdbd8ff5f0ddfad (127.30.214.130:34247): tablet c0e322eb35fb43c59917b8d0b3667215 (table test-table [id=4889720f55e044e9bfb4dbaf559382b7]) successfully deleted
W20260808 14:45:32.947561 10340 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.30.214.129:34711 (error 108)
I20260808 14:45:32.947706 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 10681
I20260808 14:45:32.951428 11240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:32.951211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.129:34711 (local address 127.0.0.1:57926)
0808 14:45:32.951344 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:32.951386 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.129:34711: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":43,"threads_started":1}
W20260808 14:45:32.951556 10340 catalog_manager.cc:4584] TS 4dca6cd9810744e493c4879d080285b1 (127.30.214.129:34711): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c0e322eb35fb43c59917b8d0b3667215: Network error: Client connection negotiation failed: client connection to 127.30.214.129:34711: connect: Connection refused (error 111)
I20260808 14:45:32.956072 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 10875
I20260808 14:45:32.966601 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 10315
2026-08-08T14:45:32Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (2661 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786200295877777-31578-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:45:33 dist-test-slave-42z9 krb5kdc[11244](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:45:33 dist-test-slave-42z9 krb5kdc[11244](info): set up 2 sockets
Aug 08 14:45:33 dist-test-slave-42z9 krb5kdc[11244](info): commencing operation
krb5kdc: starting...
W20260808 14:45:34.097026 31578 mini_kdc.cc:121] Time spent starting KDC: real 1.104s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Aug 08 14:45:34 dist-test-slave-42z9 krb5kdc[11244](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200334, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:45:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:45:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.214.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab.
Entry for principal kudu/127.30.214.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab.
I20260808 14:45:34.216506 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786200295877777-31578-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786200295877777-31578-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786200295877777-31578-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:44715
--webserver_interface=127.30.214.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab
--principal=kudu/127.30.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:32769
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.214.190:44715
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:45:34.299007 11261 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:45:34.299233 11261 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:45:34.299256 11261 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:45:34.300472 11261 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:45:34.300527 11261 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:45:34.300541 11261 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:45:34.300554 11261 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:45:34.300565 11261 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:45:34.302187 11261 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:32769
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786200295877777-31578-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786200295877777-31578-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.214.190:44715
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:44715
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11261
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786200295877777-31578-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:45:34.302446 11261 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:45:34.302692 11261 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:45:34.307636 11269 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:34.307677 11271 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:34.307819 11261 server_base.cc:1034] running on GCE node
W20260808 14:45:34.307636 11274 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:34.308168 11261 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:45:34.308455 11261 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:45:34.309602 11261 hybrid_clock.cc:648] HybridClock initialized: now 1786200334309589 us; error 32 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-08T14:45:34Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1341 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:45:34 dist-test-slave-42z9 krb5kdc[11281](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:45:34 dist-test-slave-42z9 krb5kdc[11281](info): set up 2 sockets
Aug 08 14:45:34 dist-test-slave-42z9 krb5kdc[11281](info): commencing operation
krb5kdc: starting...
W20260808 14:45:35.444833 31578 mini_kdc.cc:121] Time spent starting KDC: real 1.110s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Aug 08 14:45:35 dist-test-slave-42z9 krb5kdc[11281](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200335, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:45:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:45:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.214.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab.
Entry for principal kudu/127.30.214.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab.
I20260808 14:45:35.569620 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:43133
--webserver_interface=127.30.214.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab
--principal=kudu/127.30.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:38583
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.214.190:43133
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:45:35.652391 11298 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:45:35.652649 11298 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:45:35.652684 11298 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:45:35.654197 11298 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:45:35.654254 11298 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:45:35.654304 11298 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:45:35.654323 11298 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:45:35.654335 11298 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:45:35.655956 11298 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:38583
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.214.190:43133
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab
--principal=kudu/127.30.214.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:43133
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11298
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:45:35.656174 11298 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:45:35.656352 11298 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:45:35.661166 11306 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:35.661140 11310 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:35.661150 11307 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:35.661278 11298 server_base.cc:1034] running on GCE node
I20260808 14:45:35.661640 11298 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:45:35.661973 11298 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:45:35.663120 11298 hybrid_clock.cc:648] HybridClock initialized: now 1786200335663105 us; error 31 us; skew 500 ppm
Aug 08 14:45:35 dist-test-slave-42z9 krb5kdc[11281](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200335, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:45:35.668540 11298 init.cc:377] Logged in from keytab as kudu/127.30.214.190@KRBTEST.COM (short username kudu)
I20260808 14:45:35.669005 11298 webserver.cc:460] Webserver started at http://127.30.214.190:40311/ using document root <none> and password file <none>
I20260808 14:45:35.669219 11298 fs_manager.cc:359] Metadata directory not provided
I20260808 14:45:35.669268 11298 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:45:35.669409 11298 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:45:35.670534 11298 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/master-0/data/instance:
uuid: "870afb8345b44e13b8e7c1c022bd289c"
format_stamp: "Formatted at 2026-08-08 14:45:35 on dist-test-slave-42z9"
server_key: "c6aa38fbdfe4bb209d53b8901b1388ad"
server_key_iv: "addd5e60cd1537a3bf560fa2993706e4"
server_key_version: "encryptionkey@0"
I20260808 14:45:35.670892 11298 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/master-0/wal/instance:
uuid: "870afb8345b44e13b8e7c1c022bd289c"
format_stamp: "Formatted at 2026-08-08 14:45:35 on dist-test-slave-42z9"
server_key: "c6aa38fbdfe4bb209d53b8901b1388ad"
server_key_iv: "addd5e60cd1537a3bf560fa2993706e4"
server_key_version: "encryptionkey@0"
I20260808 14:45:35.672255 11298 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:45:35.672994 11318 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:35.673162 11298 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:45:35.673252 11298 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/master-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/master-0/wal
uuid: "870afb8345b44e13b8e7c1c022bd289c"
format_stamp: "Formatted at 2026-08-08 14:45:35 on dist-test-slave-42z9"
server_key: "c6aa38fbdfe4bb209d53b8901b1388ad"
server_key_iv: "addd5e60cd1537a3bf560fa2993706e4"
server_key_version: "encryptionkey@0"
I20260808 14:45:35.673316 11298 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:45:35.681337 11298 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:45:35.683261 11298 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:45:35.683414 11298 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:45:35.687460 11298 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.190:43133
I20260808 14:45:35.687516 11395 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.190:43133 every 8 connection(s)
I20260808 14:45:35.687850 11298 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
I20260808 14:45:35.688741 11396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:45:35.691177 11396 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 870afb8345b44e13b8e7c1c022bd289c: Bootstrap starting.
I20260808 14:45:35.691794 11396 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 870afb8345b44e13b8e7c1c022bd289c: Neither blocks nor log segments found. Creating new log.
I20260808 14:45:35.692066 11396 log.cc:824] T 00000000000000000000000000000000 P 870afb8345b44e13b8e7c1c022bd289c: Log is configured to *not* fsync() on all Append() calls
I20260808 14:45:35.692795 11396 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 870afb8345b44e13b8e7c1c022bd289c: No bootstrap required, opened a new log
I20260808 14:45:35.694451 11396 raft_consensus.cc:348] T 00000000000000000000000000000000 P 870afb8345b44e13b8e7c1c022bd289c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "870afb8345b44e13b8e7c1c022bd289c" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 43133 } }
I20260808 14:45:35.694609 11396 raft_consensus.cc:374] T 00000000000000000000000000000000 P 870afb8345b44e13b8e7c1c022bd289c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:45:35.694633 11396 raft_consensus.cc:729] T 00000000000000000000000000000000 P 870afb8345b44e13b8e7c1c022bd289c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 870afb8345b44e13b8e7c1c022bd289c, State: Initialized, Role: FOLLOWER
I20260808 14:45:35.694782 11396 consensus_queue.cc:260] T 00000000000000000000000000000000 P 870afb8345b44e13b8e7c1c022bd289c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "870afb8345b44e13b8e7c1c022bd289c" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 43133 } }
I20260808 14:45:35.694847 11396 raft_consensus.cc:388] T 00000000000000000000000000000000 P 870afb8345b44e13b8e7c1c022bd289c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:45:35.694871 11396 raft_consensus.cc:482] T 00000000000000000000000000000000 P 870afb8345b44e13b8e7c1c022bd289c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:45:35.694919 11396 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 870afb8345b44e13b8e7c1c022bd289c [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:35.695447 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 11298
I20260808 14:45:35.695459 11396 raft_consensus.cc:504] T 00000000000000000000000000000000 P 870afb8345b44e13b8e7c1c022bd289c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "870afb8345b44e13b8e7c1c022bd289c" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 43133 } }
I20260808 14:45:35.695534 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/master-0/wal/instance
I20260808 14:45:35.695561 11396 leader_election.cc:302] T 00000000000000000000000000000000 P 870afb8345b44e13b8e7c1c022bd289c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 870afb8345b44e13b8e7c1c022bd289c; no voters:
I20260808 14:45:35.695704 31578 external_mini_cluster.cc:1428] Setting key ec8012d1f5ce910ab77992ba3139a287
I20260808 14:45:35.695729 11396 leader_election.cc:288] T 00000000000000000000000000000000 P 870afb8345b44e13b8e7c1c022bd289c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:45:35.695770 11399 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 870afb8345b44e13b8e7c1c022bd289c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:45:35.695932 11399 raft_consensus.cc:686] T 00000000000000000000000000000000 P 870afb8345b44e13b8e7c1c022bd289c [term 1 LEADER]: Becoming Leader. State: Replica: 870afb8345b44e13b8e7c1c022bd289c, State: Running, Role: LEADER
I20260808 14:45:35.696111 11399 consensus_queue.cc:237] T 00000000000000000000000000000000 P 870afb8345b44e13b8e7c1c022bd289c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "870afb8345b44e13b8e7c1c022bd289c" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 43133 } }
I20260808 14:45:35.696004 11396 sys_catalog.cc:564] T 00000000000000000000000000000000 P 870afb8345b44e13b8e7c1c022bd289c [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:45:35.696575 11404 sys_catalog.cc:455] T 00000000000000000000000000000000 P 870afb8345b44e13b8e7c1c022bd289c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "870afb8345b44e13b8e7c1c022bd289c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "870afb8345b44e13b8e7c1c022bd289c" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 43133 } } }
I20260808 14:45:35.696635 11404 sys_catalog.cc:458] T 00000000000000000000000000000000 P 870afb8345b44e13b8e7c1c022bd289c [sys.catalog]: This master's current role is: LEADER
I20260808 14:45:35.696548 11403 sys_catalog.cc:455] T 00000000000000000000000000000000 P 870afb8345b44e13b8e7c1c022bd289c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 870afb8345b44e13b8e7c1c022bd289c. Latest consensus state: current_term: 1 leader_uuid: "870afb8345b44e13b8e7c1c022bd289c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "870afb8345b44e13b8e7c1c022bd289c" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 43133 } } }
I20260808 14:45:35.696764 11403 sys_catalog.cc:458] T 00000000000000000000000000000000 P 870afb8345b44e13b8e7c1c022bd289c [sys.catalog]: This master's current role is: LEADER
I20260808 14:45:35.696986 11413 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:45:35.697628 11413 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:45:35.699332 11413 catalog_manager.cc:1347] Generated new cluster ID: ae4c3da032274ad6820ee60254a7ea0c
I20260808 14:45:35.699405 11413 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 14:45:35 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200335, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:45:35.707682 11410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:35.696186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50884 (local address 127.30.214.190:43133)
0808 14:45:35.696383 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:35.696393 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:35.696454 (+ 61us) server_negotiation.cc:407] Connection header received
0808 14:45:35.696580 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:35.696587 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:35.696648 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:35.697622 (+ 974us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:35.697732 (+ 110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:35.699023 (+ 1291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:35.700069 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:35.700717 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:35.700831 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:35.703586 (+ 2755us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:35.703590 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:35.703591 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:35.703603 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:35.706074 (+ 2471us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:35.706479 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:35.706482 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:35.706482 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:35.706581 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:35.706767 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:35.706767 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:35.706768 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:35.707057 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:35.707213 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:35.707304 (+ 91us) server_negotiation.cc:299] Negotiation successful
0808 14:45:35.707447 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":70,"threads_started":1}
I20260808 14:45:35.712071 11413 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:45:35.712555 11413 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:45:35.714460 11413 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 870afb8345b44e13b8e7c1c022bd289c: Generated new TSK 0
I20260808 14:45:35.714623 11413 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.214.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab.
Entry for principal kudu/127.30.214.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab.
I20260808 14:45:35.741659 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.129:0
--local_ip_for_outbound_sockets=127.30.214.129
--webserver_interface=127.30.214.129
--webserver_port=0
--tserver_master_addrs=127.30.214.190:43133
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab
--principal=kudu/127.30.214.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:38583
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:45:35.829504 11435 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:45:35.829731 11435 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:45:35.829766 11435 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:45:35.830993 11435 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:45:35.831039 11435 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:45:35.831076 11435 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.129
I20260808 14:45:35.832603 11435 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:38583
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab
--principal=kudu/127.30.214.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.214.129
--webserver_port=0
--tserver_master_addrs=127.30.214.190:43133
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11435
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.129
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:45:35.832866 11435 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:45:35.833091 11435 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:45:35.838140 11441 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:35.838145 11443 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:35.840035 11440 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:35.840013 11435 server_base.cc:1034] running on GCE node
I20260808 14:45:35.840327 11435 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:45:35.840621 11435 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:45:35.841758 11435 hybrid_clock.cc:648] HybridClock initialized: now 1786200335841744 us; error 34 us; skew 500 ppm
Aug 08 14:45:35 dist-test-slave-42z9 krb5kdc[11281](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200335, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:45:35.844337 11435 init.cc:377] Logged in from keytab as kudu/127.30.214.129@KRBTEST.COM (short username kudu)
I20260808 14:45:35.844825 11435 webserver.cc:460] Webserver started at http://127.30.214.129:45423/ using document root <none> and password file <none>
I20260808 14:45:35.845047 11435 fs_manager.cc:359] Metadata directory not provided
I20260808 14:45:35.845098 11435 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:45:35.845230 11435 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:45:35.846347 11435 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-0/data/instance:
uuid: "0ad423d6e7b941d2b70f02ed6bbf27c1"
format_stamp: "Formatted at 2026-08-08 14:45:35 on dist-test-slave-42z9"
server_key: "94f004055f9668c2a31380925b709ce5"
server_key_iv: "5aa204be9ce6688c4b8ee4972eed1a8b"
server_key_version: "encryptionkey@0"
I20260808 14:45:35.846688 11435 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-0/wal/instance:
uuid: "0ad423d6e7b941d2b70f02ed6bbf27c1"
format_stamp: "Formatted at 2026-08-08 14:45:35 on dist-test-slave-42z9"
server_key: "94f004055f9668c2a31380925b709ce5"
server_key_iv: "5aa204be9ce6688c4b8ee4972eed1a8b"
server_key_version: "encryptionkey@0"
I20260808 14:45:35.847962 11435 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 14:45:35.848641 11457 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:35.848801 11435 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:45:35.848897 11435 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-0/wal
uuid: "0ad423d6e7b941d2b70f02ed6bbf27c1"
format_stamp: "Formatted at 2026-08-08 14:45:35 on dist-test-slave-42z9"
server_key: "94f004055f9668c2a31380925b709ce5"
server_key_iv: "5aa204be9ce6688c4b8ee4972eed1a8b"
server_key_version: "encryptionkey@0"
I20260808 14:45:35.848973 11435 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:45:35.866593 11435 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:45:35.868367 11435 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:45:35.868516 11435 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:45:35.868744 11435 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:45:35.869060 11435 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:45:35.869095 11435 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:35.869125 11435 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:45:35.869149 11435 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:35.874804 11435 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.129:46047
I20260808 14:45:35.874856 11628 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.129:46047 every 8 connection(s)
I20260808 14:45:35.875185 11435 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
I20260808 14:45:35.877381 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 11435
I20260808 14:45:35.877504 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-0/wal/instance
I20260808 14:45:35.877671 31578 external_mini_cluster.cc:1428] Setting key beda2e2f75bc42e88939aab8715ab6cf
Aug 08 14:45:35 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200335, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.129@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:45:35.884922 11410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:35.875963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.129:58081 (local address 127.30.214.190:43133)
0808 14:45:35.876031 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:35.876034 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:35.876222 (+ 188us) server_negotiation.cc:407] Connection header received
0808 14:45:35.876698 (+ 476us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:35.876699 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:35.876711 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:35.876760 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:35.877916 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:35.878510 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:35.879526 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:35.879736 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:35.879791 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:35.881937 (+ 2146us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:35.881939 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:35.881939 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:35.881947 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:35.883244 (+ 1297us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:35.883729 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:35.883730 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:35.883730 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:35.883781 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:35.884057 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:35.884057 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:35.884057 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:35.884160 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:35.884205 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:35.884618 (+ 413us) server_negotiation.cc:299] Negotiation successful
0808 14:45:35.884771 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 14:45:35.885000 11632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:35.875927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:43133 (local address 127.30.214.129:58081)
0808 14:45:35.876096 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:35.876134 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:35.876620 (+ 486us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:35.876864 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:35.876867 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:35.877554 (+ 687us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:35.877807 (+ 253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:35.877815 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:35.878605 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:35.878606 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:35.879437 (+ 831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:35.879439 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:35.879809 (+ 370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:35.879810 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:35.879945 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:35.880445 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:35.880454 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:35.881839 (+ 1385us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:35.883324 (+ 1485us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:35.883335 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:35.883337 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:35.883655 (+ 318us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:35.883837 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:35.883837 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:35.883838 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:35.883997 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:35.884215 (+ 218us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:35.884221 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:35.884429 (+ 208us) client_negotiation.cc:769] Sending connection context
0808 14:45:35.884550 (+ 121us) client_negotiation.cc:240] Negotiation successful
0808 14:45:35.884737 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":98,"threads_started":1}
I20260808 14:45:35.885802 11630 heartbeater.cc:347] Connected to a master server at 127.30.214.190:43133
I20260808 14:45:35.885908 11630 heartbeater.cc:464] Registering TS with master...
I20260808 14:45:35.886099 11630 heartbeater.cc:511] Master 127.30.214.190:43133 requested a full tablet report, sending...
I20260808 14:45:35.886705 11341 ts_manager.cc:194] Registered new tserver with Master: 0ad423d6e7b941d2b70f02ed6bbf27c1 (127.30.214.129:46047)
WARNING: no policy specified for kudu/127.30.214.130@KRBTEST.COM; defaulting to no policy
I20260808 14:45:35.887359 11341 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.214.129@KRBTEST.COM'} at 127.30.214.129:58081
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab.
Entry for principal kudu/127.30.214.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab.
I20260808 14:45:35.904886 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.130:0
--local_ip_for_outbound_sockets=127.30.214.130
--webserver_interface=127.30.214.130
--webserver_port=0
--tserver_master_addrs=127.30.214.190:43133
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab
--principal=kudu/127.30.214.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:38583
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:45:35.987509 11638 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:45:35.987732 11638 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:45:35.987758 11638 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:45:35.988938 11638 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:45:35.988981 11638 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:45:35.989006 11638 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.130
I20260808 14:45:35.990507 11638 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:38583
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab
--principal=kudu/127.30.214.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.214.130
--webserver_port=0
--tserver_master_addrs=127.30.214.190:43133
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11638
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.130
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:45:35.990723 11638 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:45:35.990919 11638 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 14:45:35.996256 11638 server_base.cc:1034] running on GCE node
W20260808 14:45:35.996225 11647 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:35.996224 11649 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:35.996217 11653 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:35.996730 11638 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:45:35.997013 11638 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:45:35.998180 11638 hybrid_clock.cc:648] HybridClock initialized: now 1786200335998165 us; error 33 us; skew 500 ppm
Aug 08 14:45:35 dist-test-slave-42z9 krb5kdc[11281](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200335, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:45:36.000737 11638 init.cc:377] Logged in from keytab as kudu/127.30.214.130@KRBTEST.COM (short username kudu)
I20260808 14:45:36.001200 11638 webserver.cc:460] Webserver started at http://127.30.214.130:46563/ using document root <none> and password file <none>
I20260808 14:45:36.001474 11638 fs_manager.cc:359] Metadata directory not provided
I20260808 14:45:36.001538 11638 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:45:36.001677 11638 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:45:36.002736 11638 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-1/data/instance:
uuid: "74e9e616e1ef422e875736adb1a98141"
format_stamp: "Formatted at 2026-08-08 14:45:36 on dist-test-slave-42z9"
server_key: "f49a9492f3bf05f79dbf71632968c107"
server_key_iv: "20e6ec9da305a0c7730fd66be4abc9c3"
server_key_version: "encryptionkey@0"
I20260808 14:45:36.003078 11638 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-1/wal/instance:
uuid: "74e9e616e1ef422e875736adb1a98141"
format_stamp: "Formatted at 2026-08-08 14:45:36 on dist-test-slave-42z9"
server_key: "f49a9492f3bf05f79dbf71632968c107"
server_key_iv: "20e6ec9da305a0c7730fd66be4abc9c3"
server_key_version: "encryptionkey@0"
I20260808 14:45:36.004643 11638 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:45:36.005470 11662 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:36.005643 11638 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:45:36.005731 11638 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-1/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-1/wal
uuid: "74e9e616e1ef422e875736adb1a98141"
format_stamp: "Formatted at 2026-08-08 14:45:36 on dist-test-slave-42z9"
server_key: "f49a9492f3bf05f79dbf71632968c107"
server_key_iv: "20e6ec9da305a0c7730fd66be4abc9c3"
server_key_version: "encryptionkey@0"
I20260808 14:45:36.005805 11638 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:45:36.021296 11638 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:45:36.023496 11638 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:45:36.023643 11638 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:45:36.023875 11638 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:45:36.024186 11638 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:45:36.024221 11638 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:36.024250 11638 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:45:36.024268 11638 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:36.029917 11638 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.130:37735
I20260808 14:45:36.029963 11828 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.130:37735 every 8 connection(s)
I20260808 14:45:36.030274 11638 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
I20260808 14:45:36.030578 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 11638
I20260808 14:45:36.030716 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-1/wal/instance
I20260808 14:45:36.030921 31578 external_mini_cluster.cc:1428] Setting key deb0beb8d9952fddb7955b490342eb2d
Aug 08 14:45:36 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200335, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.130@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.30.214.131@KRBTEST.COM; defaulting to no policy
I20260808 14:45:36.040576 11410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:36.031173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.130:56571 (local address 127.30.214.190:43133)
0808 14:45:36.031239 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:36.031240 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:36.031422 (+ 182us) server_negotiation.cc:407] Connection header received
0808 14:45:36.032002 (+ 580us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:36.032003 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:36.032015 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:36.032085 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:36.032993 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:36.033683 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:36.034989 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:36.035249 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:36.035320 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:36.037499 (+ 2179us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:36.037501 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:36.037501 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:36.037510 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:36.039154 (+ 1644us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:36.039619 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:36.039620 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:36.039621 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:36.039685 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:36.039905 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:36.039906 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:36.039906 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:36.040049 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:36.040127 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:36.040406 (+ 279us) server_negotiation.cc:299] Negotiation successful
0808 14:45:36.040498 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 14:45:36.040724 11831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:36.031045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:43133 (local address 127.30.214.130:56571)
0808 14:45:36.031300 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:36.031343 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:36.031898 (+ 555us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:36.032140 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:36.032143 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:36.032707 (+ 564us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:36.032901 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:36.032906 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:36.033771 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:36.033773 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:36.034904 (+ 1131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:36.034908 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:36.035325 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:36.035325 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:36.035440 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:36.035930 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:36.035940 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:36.037368 (+ 1428us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:36.039255 (+ 1887us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:36.039264 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:36.039266 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:36.039524 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:36.039753 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:36.039754 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:36.039754 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:36.039853 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:36.040119 (+ 266us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:36.040125 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:36.040272 (+ 147us) client_negotiation.cc:769] Sending connection context
0808 14:45:36.040360 (+ 88us) client_negotiation.cc:240] Negotiation successful
0808 14:45:36.040501 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":90,"threads_started":1}
I20260808 14:45:36.041237 11829 heartbeater.cc:347] Connected to a master server at 127.30.214.190:43133
I20260808 14:45:36.041345 11829 heartbeater.cc:464] Registering TS with master...
I20260808 14:45:36.041579 11829 heartbeater.cc:511] Master 127.30.214.190:43133 requested a full tablet report, sending...
I20260808 14:45:36.042236 11341 ts_manager.cc:194] Registered new tserver with Master: 74e9e616e1ef422e875736adb1a98141 (127.30.214.130:37735)
I20260808 14:45:36.042657 11341 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.214.130@KRBTEST.COM'} at 127.30.214.130:56571
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab.
Entry for principal kudu/127.30.214.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab.
I20260808 14:45:36.058697 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.131:0
--local_ip_for_outbound_sockets=127.30.214.131
--webserver_interface=127.30.214.131
--webserver_port=0
--tserver_master_addrs=127.30.214.190:43133
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab
--principal=kudu/127.30.214.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:38583
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:45:36.141665 11834 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:45:36.141886 11834 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:45:36.141911 11834 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:45:36.143080 11834 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:45:36.143119 11834 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:45:36.143146 11834 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.131
I20260808 14:45:36.144641 11834 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:38583
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab
--principal=kudu/127.30.214.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.214.131
--webserver_port=0
--tserver_master_addrs=127.30.214.190:43133
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11834
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.131
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:45:36.144860 11834 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:45:36.145066 11834 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:45:36.150205 11839 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:36.150205 11844 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:36.150208 11840 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:36.150470 11834 server_base.cc:1034] running on GCE node
I20260808 14:45:36.150686 11834 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:45:36.150909 11834 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:45:36.152050 11834 hybrid_clock.cc:648] HybridClock initialized: now 1786200336152016 us; error 51 us; skew 500 ppm
Aug 08 14:45:36 dist-test-slave-42z9 krb5kdc[11281](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200336, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:45:36.154878 11834 init.cc:377] Logged in from keytab as kudu/127.30.214.131@KRBTEST.COM (short username kudu)
I20260808 14:45:36.155341 11834 webserver.cc:460] Webserver started at http://127.30.214.131:35203/ using document root <none> and password file <none>
I20260808 14:45:36.155558 11834 fs_manager.cc:359] Metadata directory not provided
I20260808 14:45:36.155611 11834 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:45:36.155740 11834 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:45:36.156783 11834 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-2/data/instance:
uuid: "7a68d6c620434e029b95016ddb9570ef"
format_stamp: "Formatted at 2026-08-08 14:45:36 on dist-test-slave-42z9"
server_key: "31ad8291d9ebfc7ddfd82ee788348f47"
server_key_iv: "62462547d13ce1f3f87a054dd9d3a3cc"
server_key_version: "encryptionkey@0"
I20260808 14:45:36.157158 11834 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-2/wal/instance:
uuid: "7a68d6c620434e029b95016ddb9570ef"
format_stamp: "Formatted at 2026-08-08 14:45:36 on dist-test-slave-42z9"
server_key: "31ad8291d9ebfc7ddfd82ee788348f47"
server_key_iv: "62462547d13ce1f3f87a054dd9d3a3cc"
server_key_version: "encryptionkey@0"
I20260808 14:45:36.158550 11834 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 14:45:36.159242 11855 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:36.159418 11834 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:36.159507 11834 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-2/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-2/wal
uuid: "7a68d6c620434e029b95016ddb9570ef"
format_stamp: "Formatted at 2026-08-08 14:45:36 on dist-test-slave-42z9"
server_key: "31ad8291d9ebfc7ddfd82ee788348f47"
server_key_iv: "62462547d13ce1f3f87a054dd9d3a3cc"
server_key_version: "encryptionkey@0"
I20260808 14:45:36.159571 11834 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:45:36.173192 11834 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:45:36.175457 11834 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:45:36.175621 11834 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:45:36.175853 11834 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:45:36.176167 11834 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:45:36.176209 11834 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:36.176240 11834 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:45:36.176265 11834 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:36.182117 11834 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.131:45449
I20260808 14:45:36.182160 12024 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.131:45449 every 8 connection(s)
I20260808 14:45:36.182482 11834 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
I20260808 14:45:36.184459 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 11834
I20260808 14:45:36.184605 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-2/wal/instance
I20260808 14:45:36.184798 31578 external_mini_cluster.cc:1428] Setting key 1b87a8bbf3c1d657f5f204cda21ea56d
Aug 08 14:45:36 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200336, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.131@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:45:36.192368 11410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:36.183198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:56297 (local address 127.30.214.190:43133)
0808 14:45:36.183281 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:36.183284 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:36.183449 (+ 165us) server_negotiation.cc:407] Connection header received
0808 14:45:36.184012 (+ 563us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:36.184014 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:36.184032 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:36.184145 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:36.185297 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:36.186001 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:36.187020 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:36.187367 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:36.187430 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:36.189725 (+ 2295us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:36.189727 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:36.189727 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:36.189736 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:36.191045 (+ 1309us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:36.191441 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:36.191442 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:36.191442 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:36.191499 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:36.191727 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:36.191729 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:36.191729 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:36.191847 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:36.191904 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:36.192182 (+ 278us) server_negotiation.cc:299] Negotiation successful
0808 14:45:36.192273 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 14:45:36.192576 12027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:36.183166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:43133 (local address 127.30.214.131:56297)
0808 14:45:36.183325 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:36.183363 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:36.183837 (+ 474us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:36.184233 (+ 396us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:36.184236 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:36.184928 (+ 692us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:36.185204 (+ 276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:36.185211 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:36.186122 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:36.186123 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:36.186925 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:36.186927 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:36.187453 (+ 526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:36.187454 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:36.187584 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:36.188103 (+ 519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:36.188113 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:36.189615 (+ 1502us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:36.191130 (+ 1515us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:36.191139 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:36.191141 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:36.191370 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:36.191556 (+ 186us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:36.191557 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:36.191557 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:36.191670 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:36.191903 (+ 233us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:36.191910 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:36.192057 (+ 147us) client_negotiation.cc:769] Sending connection context
0808 14:45:36.192150 (+ 93us) client_negotiation.cc:240] Negotiation successful
0808 14:45:36.192319 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":80,"threads_started":1}
I20260808 14:45:36.193008 12025 heartbeater.cc:347] Connected to a master server at 127.30.214.190:43133
I20260808 14:45:36.193112 12025 heartbeater.cc:464] Registering TS with master...
I20260808 14:45:36.193297 12025 heartbeater.cc:511] Master 127.30.214.190:43133 requested a full tablet report, sending...
I20260808 14:45:36.193718 11341 ts_manager.cc:194] Registered new tserver with Master: 7a68d6c620434e029b95016ddb9570ef (127.30.214.131:45449)
I20260808 14:45:36.194087 11341 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.214.131@KRBTEST.COM'} at 127.30.214.131:56297
I20260808 14:45:36.197037 31578 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.30.214.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.30.214.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.30.214.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/krb5kdc/oryx_127.30.214.129.keytab.
Entry for principal oryx/127.30.214.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/krb5kdc/oryx_127.30.214.129.keytab.
WARNING: no policy specified for oryx/127.30.214.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.30.214.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.30.214.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/krb5kdc/oryx_127.30.214.130.keytab.
Entry for principal oryx/127.30.214.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/krb5kdc/oryx_127.30.214.130.keytab.
WARNING: no policy specified for oryx/127.30.214.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.30.214.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.30.214.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/krb5kdc/oryx_127.30.214.131.keytab.
Entry for principal oryx/127.30.214.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/krb5kdc/oryx_127.30.214.131.keytab.
I20260808 14:45:36.272181 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 11435
I20260808 14:45:36.282068 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 11638
I20260808 14:45:36.306137 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 11834
I20260808 14:45:36.315362 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 11298
I20260808 14:45:36.324605 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:43133
--webserver_interface=127.30.214.190
--webserver_port=40311
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab
--principal=kudu/127.30.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:38583
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.214.190:43133
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:45:36.407330 12040 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:45:36.407552 12040 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:45:36.407574 12040 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:45:36.408774 12040 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:45:36.408829 12040 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:45:36.408842 12040 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:45:36.408854 12040 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:45:36.408865 12040 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:45:36.410452 12040 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:38583
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.214.190:43133
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab
--principal=kudu/127.30.214.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:43133
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.214.190
--webserver_port=40311
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12040
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:45:36.410720 12040 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:45:36.410970 12040 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:45:36.415773 12054 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:36.415798 12048 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:36.415803 12049 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:36.416021 12040 server_base.cc:1034] running on GCE node
I20260808 14:45:36.416229 12040 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:45:36.416486 12040 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:45:36.417634 12040 hybrid_clock.cc:648] HybridClock initialized: now 1786200336417621 us; error 31 us; skew 500 ppm
Aug 08 14:45:36 dist-test-slave-42z9 krb5kdc[11281](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200336, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:45:36.420140 12040 init.cc:377] Logged in from keytab as kudu/127.30.214.190@KRBTEST.COM (short username kudu)
I20260808 14:45:36.420619 12040 webserver.cc:460] Webserver started at http://127.30.214.190:40311/ using document root <none> and password file <none>
I20260808 14:45:36.420825 12040 fs_manager.cc:359] Metadata directory not provided
I20260808 14:45:36.420898 12040 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:45:36.422329 12040 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:45:36.423014 12062 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:36.423167 12040 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:45:36.423254 12040 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/master-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/master-0/wal
uuid: "870afb8345b44e13b8e7c1c022bd289c"
format_stamp: "Formatted at 2026-08-08 14:45:35 on dist-test-slave-42z9"
server_key: "c6aa38fbdfe4bb209d53b8901b1388ad"
server_key_iv: "addd5e60cd1537a3bf560fa2993706e4"
server_key_version: "encryptionkey@0"
I20260808 14:45:36.423619 12040 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:45:36.442970 12040 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:45:36.444802 12040 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:45:36.444948 12040 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:45:36.448985 12040 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.190:43133
I20260808 14:45:36.449029 12139 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.190:43133 every 8 connection(s)
I20260808 14:45:36.449405 12040 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
I20260808 14:45:36.449882 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 12040
I20260808 14:45:36.450142 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.129:46047
--local_ip_for_outbound_sockets=127.30.214.129
--tserver_master_addrs=127.30.214.190:43133
--webserver_port=45423
--webserver_interface=127.30.214.129
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab
--principal=kudu/127.30.214.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:38583
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.30.214.129
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/krb5kdc/oryx_127.30.214.129.keytab with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:45:36.451035 12140 sys_catalog.cc:263] Verifying existing consensus state
I20260808 14:45:36.451707 12140 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 870afb8345b44e13b8e7c1c022bd289c: Bootstrap starting.
I20260808 14:45:36.460355 12140 log.cc:824] T 00000000000000000000000000000000 P 870afb8345b44e13b8e7c1c022bd289c: Log is configured to *not* fsync() on all Append() calls
I20260808 14:45:36.462145 12140 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 870afb8345b44e13b8e7c1c022bd289c: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 14:45:36.462421 12140 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 870afb8345b44e13b8e7c1c022bd289c: Bootstrap complete.
I20260808 14:45:36.464586 12140 raft_consensus.cc:348] T 00000000000000000000000000000000 P 870afb8345b44e13b8e7c1c022bd289c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "870afb8345b44e13b8e7c1c022bd289c" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 43133 } }
I20260808 14:45:36.464820 12140 raft_consensus.cc:729] T 00000000000000000000000000000000 P 870afb8345b44e13b8e7c1c022bd289c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 870afb8345b44e13b8e7c1c022bd289c, State: Initialized, Role: FOLLOWER
I20260808 14:45:36.464987 12140 consensus_queue.cc:260] T 00000000000000000000000000000000 P 870afb8345b44e13b8e7c1c022bd289c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "870afb8345b44e13b8e7c1c022bd289c" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 43133 } }
I20260808 14:45:36.465056 12140 raft_consensus.cc:388] T 00000000000000000000000000000000 P 870afb8345b44e13b8e7c1c022bd289c [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:45:36.465108 12140 raft_consensus.cc:482] T 00000000000000000000000000000000 P 870afb8345b44e13b8e7c1c022bd289c [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:45:36.465155 12140 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 870afb8345b44e13b8e7c1c022bd289c [term 1 FOLLOWER]: Advancing to term 2
I20260808 14:45:36.466231 12140 raft_consensus.cc:504] T 00000000000000000000000000000000 P 870afb8345b44e13b8e7c1c022bd289c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "870afb8345b44e13b8e7c1c022bd289c" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 43133 } }
I20260808 14:45:36.466336 12140 leader_election.cc:302] T 00000000000000000000000000000000 P 870afb8345b44e13b8e7c1c022bd289c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 870afb8345b44e13b8e7c1c022bd289c; no voters:
I20260808 14:45:36.466514 12140 leader_election.cc:288] T 00000000000000000000000000000000 P 870afb8345b44e13b8e7c1c022bd289c [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 14:45:36.466562 12145 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 870afb8345b44e13b8e7c1c022bd289c [term 2 FOLLOWER]: Leader election won for term 2
I20260808 14:45:36.466719 12145 raft_consensus.cc:686] T 00000000000000000000000000000000 P 870afb8345b44e13b8e7c1c022bd289c [term 2 LEADER]: Becoming Leader. State: Replica: 870afb8345b44e13b8e7c1c022bd289c, State: Running, Role: LEADER
I20260808 14:45:36.466809 12140 sys_catalog.cc:564] T 00000000000000000000000000000000 P 870afb8345b44e13b8e7c1c022bd289c [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:45:36.466882 12145 consensus_queue.cc:237] T 00000000000000000000000000000000 P 870afb8345b44e13b8e7c1c022bd289c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "870afb8345b44e13b8e7c1c022bd289c" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 43133 } }
I20260808 14:45:36.467214 12147 sys_catalog.cc:455] T 00000000000000000000000000000000 P 870afb8345b44e13b8e7c1c022bd289c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "870afb8345b44e13b8e7c1c022bd289c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "870afb8345b44e13b8e7c1c022bd289c" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 43133 } } }
I20260808 14:45:36.467293 12147 sys_catalog.cc:458] T 00000000000000000000000000000000 P 870afb8345b44e13b8e7c1c022bd289c [sys.catalog]: This master's current role is: LEADER
I20260808 14:45:36.467664 12149 sys_catalog.cc:455] T 00000000000000000000000000000000 P 870afb8345b44e13b8e7c1c022bd289c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 870afb8345b44e13b8e7c1c022bd289c. Latest consensus state: current_term: 2 leader_uuid: "870afb8345b44e13b8e7c1c022bd289c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "870afb8345b44e13b8e7c1c022bd289c" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 43133 } } }
I20260808 14:45:36.467738 12149 sys_catalog.cc:458] T 00000000000000000000000000000000 P 870afb8345b44e13b8e7c1c022bd289c [sys.catalog]: This master's current role is: LEADER
I20260808 14:45:36.467882 12154 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:45:36.468437 12154 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:45:36.468622 12154 catalog_manager.cc:1259] Loaded cluster ID: ae4c3da032274ad6820ee60254a7ea0c
I20260808 14:45:36.468791 12154 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:45:36.469985 12154 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:45:36.470178 12154 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 870afb8345b44e13b8e7c1c022bd289c: Loaded TSK: 0
I20260808 14:45:36.470396 12154 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 14:45:36.539470 12143 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:45:36.539695 12143 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:45:36.539731 12143 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:45:36.540958 12143 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:45:36.541009 12143 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:45:36.541046 12143 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.129
I20260808 14:45:36.542634 12143 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:38583
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/krb5kdc/oryx_127.30.214.129.keytab
--principal=oryx/127.30.214.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.129:46047
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.214.129
--webserver_port=45423
--tserver_master_addrs=127.30.214.190:43133
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12143
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.129
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:45:36.542904 12143 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:45:36.543130 12143 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:45:36.549080 12190 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:36.549080 12188 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:36.549367 12143 server_base.cc:1034] running on GCE node
W20260808 14:45:36.549391 12186 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:36.549644 12143 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:45:36.549890 12143 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:45:36.551054 12143 hybrid_clock.cc:648] HybridClock initialized: now 1786200336551045 us; error 28 us; skew 500 ppm
Aug 08 14:45:36 dist-test-slave-42z9 krb5kdc[11281](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200336, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.214.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:45:36.553604 12143 init.cc:377] Logged in from keytab as oryx/127.30.214.129@KRBTEST.COM (short username oryx)
I20260808 14:45:36.554091 12143 webserver.cc:460] Webserver started at http://127.30.214.129:45423/ using document root <none> and password file <none>
I20260808 14:45:36.554338 12143 fs_manager.cc:359] Metadata directory not provided
I20260808 14:45:36.554399 12143 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:45:36.555732 12143 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:45:36.556339 12202 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:36.556532 12143 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:45:36.556617 12143 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-0/wal
uuid: "0ad423d6e7b941d2b70f02ed6bbf27c1"
format_stamp: "Formatted at 2026-08-08 14:45:35 on dist-test-slave-42z9"
server_key: "94f004055f9668c2a31380925b709ce5"
server_key_iv: "5aa204be9ce6688c4b8ee4972eed1a8b"
server_key_version: "encryptionkey@0"
I20260808 14:45:36.557075 12143 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:45:36.581382 12143 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:45:36.583840 12143 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:45:36.584029 12143 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:45:36.584327 12143 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:45:36.584712 12143 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:45:36.584767 12143 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:36.584810 12143 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:45:36.584836 12143 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:36.592458 12143 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.129:46047
I20260808 14:45:36.592499 12380 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.129:46047 every 8 connection(s)
I20260808 14:45:36.593010 12143 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
I20260808 14:45:36.596956 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 12143
I20260808 14:45:36.597278 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.130:37735
--local_ip_for_outbound_sockets=127.30.214.130
--tserver_master_addrs=127.30.214.190:43133
--webserver_port=46563
--webserver_interface=127.30.214.130
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab
--principal=kudu/127.30.214.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:38583
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.30.214.130
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/krb5kdc/oryx_127.30.214.130.keytab with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 14:45:36 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.129@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:45:36 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.129@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:45:36.603951 12385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:36.593753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:43133 (local address 127.30.214.129:40183)
0808 14:45:36.593947 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:36.593999 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:36.594632 (+ 633us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:36.595087 (+ 455us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:36.595091 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:36.595870 (+ 779us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:36.596161 (+ 291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:36.596168 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:36.597694 (+ 1526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:36.597695 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:36.598968 (+ 1273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:36.598972 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:36.599843 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:36.599844 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:36.600016 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:36.600750 (+ 734us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:36.600763 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:36.603735 (+ 2972us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.214.190:43133: Server oryx/127.30.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":94,"threads_started":1}
W20260808 14:45:36.604419 12381 heartbeater.cc:644] Failed to heartbeat to 127.30.214.190:43133 (0 consecutive failures): Not authorized: Failed to ping master at 127.30.214.190:43133: Client connection negotiation failed: client connection to 127.30.214.190:43133: Server oryx/127.30.214.190@KRBTEST.COM not found in Kerberos database
W20260808 14:45:36.604792 12387 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:45:36.593871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.129:40183 (local address 127.30.214.190:43133)
0808 14:45:36.594068 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:36.594076 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:36.594104 (+ 28us) server_negotiation.cc:407] Connection header received
0808 14:45:36.594845 (+ 741us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:36.594850 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:36.594898 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:36.595017 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:36.596286 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:36.597565 (+ 1279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:36.599075 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:36.599731 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:36.599855 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:36.603932 (+ 4077us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.214.129:40183: BlockingRecv error: recv got EOF from 127.30.214.129:40183 (error 108)
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":86,"threads_started":1}
Aug 08 14:45:36 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.129@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:45:36 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.129@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:45:36.610523 12385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:36.604705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:43133 (local address 127.30.214.129:59413)
0808 14:45:36.604946 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:36.604958 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:36.605012 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:36.605186 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:36.605187 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:36.605347 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:36.605411 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:36.605413 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:36.606450 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:36.606452 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:36.607272 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:36.607276 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:36.607716 (+ 440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:36.607717 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:36.607788 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:36.608265 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:36.608271 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:36.610445 (+ 2174us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.214.190:43133: Server oryx/127.30.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":213}
W20260808 14:45:36.610602 12387 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:45:36.604761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.129:59413 (local address 127.30.214.190:43133)
0808 14:45:36.604901 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:36.604903 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:36.605063 (+ 160us) server_negotiation.cc:407] Connection header received
0808 14:45:36.605092 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:36.605093 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:36.605109 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:36.605162 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:36.605574 (+ 412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:36.606355 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:36.607368 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:36.607630 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:36.607700 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:36.610542 (+ 2842us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.214.129:59413: BlockingRecv error: recv got EOF from 127.30.214.129:59413 (error 108)
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":89,"threads_started":1}
Aug 08 14:45:36 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.129@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:45:36 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.129@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:45:36.615337 12385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:36.610889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:43133 (local address 127.30.214.129:39097)
0808 14:45:36.610947 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:36.610959 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:36.611006 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:36.611133 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:36.611134 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:36.611244 (+ 110us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:36.611278 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:36.611280 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:36.612184 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:36.612184 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:36.612702 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:36.612703 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:36.613144 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:36.613145 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:36.613183 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:36.613610 (+ 427us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:36.613615 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:36.615285 (+ 1670us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.214.190:43133: Server oryx/127.30.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":35}
W20260808 14:45:36.615492 12381 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 14:45:36.615516 12387 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:45:36.610945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.129:39097 (local address 127.30.214.190:43133)
0808 14:45:36.610990 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:36.610992 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:36.611002 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:45:36.611068 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:36.611069 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:36.611079 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:36.611125 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:36.611333 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:36.612118 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:36.612771 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:36.613078 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:36.613145 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:36.615455 (+ 2310us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.214.129:39097: BlockingRecv error: recv got EOF from 127.30.214.129:39097 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260808 14:45:36.683743 12388 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:45:36.683959 12388 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:45:36.683984 12388 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:45:36.685132 12388 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:45:36.685170 12388 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:45:36.685194 12388 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.130
I20260808 14:45:36.686712 12388 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:38583
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/krb5kdc/oryx_127.30.214.130.keytab
--principal=oryx/127.30.214.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.130:37735
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.214.130
--webserver_port=46563
--tserver_master_addrs=127.30.214.190:43133
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12388
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.130
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:45:36.686923 12388 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:45:36.687126 12388 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:45:36.692440 12398 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:36.692445 12402 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:36.692646 12388 server_base.cc:1034] running on GCE node
W20260808 14:45:36.692445 12399 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:36.693161 12388 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:45:36.693425 12388 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:45:36.694605 12388 hybrid_clock.cc:648] HybridClock initialized: now 1786200336694588 us; error 37 us; skew 500 ppm
Aug 08 14:45:36 dist-test-slave-42z9 krb5kdc[11281](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200336, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.214.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:45:36.697186 12388 init.cc:377] Logged in from keytab as oryx/127.30.214.130@KRBTEST.COM (short username oryx)
I20260808 14:45:36.697680 12388 webserver.cc:460] Webserver started at http://127.30.214.130:46563/ using document root <none> and password file <none>
I20260808 14:45:36.697897 12388 fs_manager.cc:359] Metadata directory not provided
I20260808 14:45:36.697953 12388 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:45:36.699280 12388 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:45:36.699819 12412 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:36.699980 12388 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:36.700064 12388 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-1/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-1/wal
uuid: "74e9e616e1ef422e875736adb1a98141"
format_stamp: "Formatted at 2026-08-08 14:45:36 on dist-test-slave-42z9"
server_key: "f49a9492f3bf05f79dbf71632968c107"
server_key_iv: "20e6ec9da305a0c7730fd66be4abc9c3"
server_key_version: "encryptionkey@0"
I20260808 14:45:36.700404 12388 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:45:36.710583 12388 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:45:36.712402 12388 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:45:36.712544 12388 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:45:36.712771 12388 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:45:36.713083 12388 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:45:36.713116 12388 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:36.713145 12388 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:45:36.713160 12388 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:36.718995 12388 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.130:37735
I20260808 14:45:36.719051 12583 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.130:37735 every 8 connection(s)
I20260808 14:45:36.719406 12388 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
I20260808 14:45:36.723457 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 12388
I20260808 14:45:36.723737 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.131:45449
--local_ip_for_outbound_sockets=127.30.214.131
--tserver_master_addrs=127.30.214.190:43133
--webserver_port=35203
--webserver_interface=127.30.214.131
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab
--principal=kudu/127.30.214.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:38583
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.30.214.131
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/krb5kdc/oryx_127.30.214.131.keytab with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 14:45:36 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.130@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:45:36 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.130@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
W20260808 14:45:36.726958 12387 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:45:36.720120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.130:56549 (local address 127.30.214.190:43133)
0808 14:45:36.720168 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:36.720171 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:36.720383 (+ 212us) server_negotiation.cc:407] Connection header received
0808 14:45:36.720858 (+ 475us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:36.720859 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:36.720875 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:36.720915 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:36.721916 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:36.722419 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:36.723487 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:36.723718 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:36.723777 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:36.726909 (+ 3132us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.214.130:56549: BlockingRecv error: recv got EOF from 127.30.214.130:56549 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 14:45:36.727057 12593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:36.720105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:43133 (local address 127.30.214.130:56549)
0808 14:45:36.720251 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:36.720289 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:36.720765 (+ 476us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:36.720974 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:36.720977 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:36.721607 (+ 630us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:36.721812 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:36.721817 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:36.722552 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:36.722553 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:36.723372 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:36.723374 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:36.723810 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:36.723811 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:36.723932 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:36.724433 (+ 501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:36.724441 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:36.726823 (+ 2382us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.214.190:43133: Server oryx/127.30.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":78,"threads_started":1}
W20260808 14:45:36.729794 12584 heartbeater.cc:644] Failed to heartbeat to 127.30.214.190:43133 (0 consecutive failures): Not authorized: Failed to ping master at 127.30.214.190:43133: Client connection negotiation failed: client connection to 127.30.214.190:43133: Server oryx/127.30.214.190@KRBTEST.COM not found in Kerberos database
Aug 08 14:45:36 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.130@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:45:36 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.130@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:45:36.735194 12593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:36.730216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:43133 (local address 127.30.214.130:58947)
0808 14:45:36.730286 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:36.730300 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:36.730347 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:36.730528 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:36.730529 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:36.730747 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:36.730821 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:36.730824 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:36.731531 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:36.731533 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:36.732072 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:36.732075 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:36.732423 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:36.732424 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:36.732486 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:36.733132 (+ 646us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:36.733139 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:36.735136 (+ 1997us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.214.190:43133: Server oryx/127.30.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":41}
W20260808 14:45:36.735369 12387 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:45:36.730313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.130:58947 (local address 127.30.214.190:43133)
0808 14:45:36.730407 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:36.730409 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:36.730418 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:45:36.730457 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:36.730458 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:36.730469 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:36.730516 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:36.730906 (+ 390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:36.731456 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:36.732159 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:36.732361 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:36.732419 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:36.735300 (+ 2881us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.214.130:58947: BlockingRecv error: recv got EOF from 127.30.214.130:58947 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Aug 08 14:45:36 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.130@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:45:36 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.130@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:45:36.740460 12595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:36.735483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:43133 (local address 127.30.214.130:54685)
0808 14:45:36.735662 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:36.735672 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:36.735738 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:36.735878 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:36.735879 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:36.736014 (+ 135us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:36.736076 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:36.736078 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:36.737027 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:36.737027 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:36.737663 (+ 636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:36.737665 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:36.738139 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:36.738140 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:36.738191 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:36.738666 (+ 475us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:36.738671 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:36.740394 (+ 1723us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.214.190:43133: Server oryx/127.30.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":108,"threads_started":1}
W20260808 14:45:36.740597 12387 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:45:36.735540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.130:54685 (local address 127.30.214.190:43133)
0808 14:45:36.735601 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:36.735603 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:36.735740 (+ 137us) server_negotiation.cc:407] Connection header received
0808 14:45:36.735802 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:36.735803 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:36.735815 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:36.735867 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:36.736135 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:36.736950 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:36.737732 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:36.738047 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:36.738114 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:36.740522 (+ 2408us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.214.130:54685: BlockingRecv error: recv got EOF from 127.30.214.130:54685 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
W20260808 14:45:36.740767 12584 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 14:45:36.809247 12594 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:45:36.809477 12594 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:45:36.809505 12594 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:45:36.810766 12594 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:45:36.810837 12594 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:45:36.810870 12594 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.131
I20260808 14:45:36.812445 12594 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:38583
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/krb5kdc/oryx_127.30.214.131.keytab
--principal=oryx/127.30.214.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.131:45449
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.214.131
--webserver_port=35203
--tserver_master_addrs=127.30.214.190:43133
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12594
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.131
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:45:36.812676 12594 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:45:36.812911 12594 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:45:36.817818 12603 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:36.817826 12605 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:36.817909 12594 server_base.cc:1034] running on GCE node
W20260808 14:45:36.817842 12602 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:36.818312 12594 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:45:36.818583 12594 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:45:36.819736 12594 hybrid_clock.cc:648] HybridClock initialized: now 1786200336819725 us; error 29 us; skew 500 ppm
Aug 08 14:45:36 dist-test-slave-42z9 krb5kdc[11281](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200336, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.214.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:45:36.822290 12594 init.cc:377] Logged in from keytab as oryx/127.30.214.131@KRBTEST.COM (short username oryx)
I20260808 14:45:36.822777 12594 webserver.cc:460] Webserver started at http://127.30.214.131:35203/ using document root <none> and password file <none>
I20260808 14:45:36.823017 12594 fs_manager.cc:359] Metadata directory not provided
I20260808 14:45:36.823086 12594 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:45:36.824458 12594 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:45:36.825006 12618 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:36.825141 12594 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:45:36.825227 12594 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-2/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-2/wal
uuid: "7a68d6c620434e029b95016ddb9570ef"
format_stamp: "Formatted at 2026-08-08 14:45:36 on dist-test-slave-42z9"
server_key: "31ad8291d9ebfc7ddfd82ee788348f47"
server_key_iv: "62462547d13ce1f3f87a054dd9d3a3cc"
server_key_version: "encryptionkey@0"
I20260808 14:45:36.825628 12594 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:45:36.854013 12594 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:45:36.856244 12594 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:45:36.856400 12594 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:45:36.856650 12594 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:45:36.856964 12594 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:45:36.857000 12594 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:36.857030 12594 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:45:36.857049 12594 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:36.863056 12594 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.131:45449
I20260808 14:45:36.863103 12786 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.131:45449 every 8 connection(s)
I20260808 14:45:36.863462 12594 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
Aug 08 14:45:36 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.131@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:45:36 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.131@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:45:36.870137 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 12594
W20260808 14:45:36.870985 12387 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:45:36.864222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:43773 (local address 127.30.214.190:43133)
0808 14:45:36.864293 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:36.864296 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:36.864498 (+ 202us) server_negotiation.cc:407] Connection header received
0808 14:45:36.865013 (+ 515us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:36.865014 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:36.865025 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:36.865083 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:36.866030 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:36.866571 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:36.867569 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:36.867784 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:36.867855 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:36.870926 (+ 3071us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.214.131:43773: BlockingRecv error: recv got EOF from 127.30.214.131:43773 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 14:45:36.871050 12791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:36.864213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:43133 (local address 127.30.214.131:43773)
0808 14:45:36.864378 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:36.864420 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:36.864895 (+ 475us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:36.865140 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:36.865144 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:36.865749 (+ 605us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:36.865956 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:36.865960 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:36.866648 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:36.866649 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:36.867503 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:36.867506 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:36.867858 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:36.867859 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:36.867975 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:36.868497 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:36.868506 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:36.870844 (+ 2338us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.214.190:43133: Server oryx/127.30.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":96,"threads_started":1}
W20260808 14:45:36.871310 12789 heartbeater.cc:644] Failed to heartbeat to 127.30.214.190:43133 (0 consecutive failures): Not authorized: Failed to ping master at 127.30.214.190:43133: Client connection negotiation failed: client connection to 127.30.214.190:43133: Server oryx/127.30.214.190@KRBTEST.COM not found in Kerberos database
Aug 08 14:45:36 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.131@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:45:36 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.131@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:45:36.876068 12791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:36.871544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:43133 (local address 127.30.214.131:60863)
0808 14:45:36.871593 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:36.871601 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:36.871632 (+ 31us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:36.872271 (+ 639us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:36.872271 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:36.872415 (+ 144us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:36.872467 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:36.872469 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:36.873041 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:36.873042 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:36.873659 (+ 617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:36.873662 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:36.874021 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:36.874022 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:36.874109 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:36.874442 (+ 333us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:36.874447 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:36.876015 (+ 1568us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.214.190:43133: Server oryx/127.30.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":34}
W20260808 14:45:36.876191 12387 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:45:36.871589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:60863 (local address 127.30.214.190:43133)
0808 14:45:36.872189 (+ 600us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:36.872190 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:36.872195 (+ 5us) server_negotiation.cc:407] Connection header received
0808 14:45:36.872209 (+ 14us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:36.872209 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:36.872216 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:36.872249 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:36.872534 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:36.872972 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:36.873748 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:36.873944 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:36.873992 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:36.876128 (+ 2136us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.214.131:60863: BlockingRecv error: recv got EOF from 127.30.214.131:60863 (error 108)
Metrics: {"server-negotiator.queue_time_us":583}
I20260808 14:45:36.877668 12389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:36.870668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50892 (local address 127.30.214.190:43133)
0808 14:45:36.870735 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:36.870737 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:36.870817 (+ 80us) server_negotiation.cc:407] Connection header received
0808 14:45:36.870880 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:36.870881 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:36.870892 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:36.870954 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:36.871617 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:36.872108 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:36.872941 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:36.873195 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:36.873243 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:36.874556 (+ 1313us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:36.874560 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:36.874561 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:36.874573 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:36.876240 (+ 1667us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:36.876629 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:36.876633 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:36.876633 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:36.876737 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:36.876916 (+ 179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:36.876917 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:36.876918 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:36.877167 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:36.877300 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:36.877420 (+ 120us) server_negotiation.cc:299] Negotiation successful
0808 14:45:36.877560 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
Aug 08 14:45:36 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.131@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:45:36 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.131@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:45:36.880394 12791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:36.876309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:43133 (local address 127.30.214.131:33725)
0808 14:45:36.876461 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:36.876470 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:36.876516 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:36.876635 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:36.876636 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:36.876748 (+ 112us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:36.876778 (+ 30us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:36.876779 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:36.877355 (+ 576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:36.877356 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:36.878098 (+ 742us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:36.878100 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:36.878498 (+ 398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:36.878499 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:36.878552 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:36.878861 (+ 309us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:36.878865 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:36.880327 (+ 1462us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.214.190:43133: Server oryx/127.30.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":107,"threads_started":1}
W20260808 14:45:36.880468 12387 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:45:36.876370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:33725 (local address 127.30.214.190:43133)
0808 14:45:36.876418 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:36.876421 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:36.876520 (+ 99us) server_negotiation.cc:407] Connection header received
0808 14:45:36.876571 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:36.876571 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:36.876580 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:36.876627 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:36.876839 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:36.877289 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:36.878220 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:36.878433 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:36.878497 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:36.880417 (+ 1920us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.214.131:33725: BlockingRecv error: recv got EOF from 127.30.214.131:33725 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
W20260808 14:45:36.880573 12789 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 08 14:45:37 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.129@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:45:37 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.129@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:45:37.620416 12795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:37.615921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:43133 (local address 127.30.214.129:55913)
0808 14:45:37.616058 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:37.616070 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:37.616134 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:37.616259 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:37.616260 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:37.616442 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:37.616493 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:37.616495 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:37.617156 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:37.617157 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:37.617739 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:37.617741 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:37.618124 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:37.618125 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:37.618178 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:37.618624 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:37.618629 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:37.620342 (+ 1713us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.214.190:43133: Server oryx/127.30.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":70,"threads_started":1}
W20260808 14:45:37.620508 12798 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:45:37.615993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.129:55913 (local address 127.30.214.190:43133)
0808 14:45:37.616111 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:37.616113 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:37.616121 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:45:37.616186 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:37.616186 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:37.616199 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:37.616253 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:37.616573 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:37.617076 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:37.617822 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:37.618029 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:37.618086 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:37.620439 (+ 2353us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.214.129:55913: BlockingRecv error: recv got EOF from 127.30.214.129:55913 (error 108)
Metrics: {"server-negotiator.queue_time_us":100,"thread_start_us":58,"threads_started":1}
Aug 08 14:45:37 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.130@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:45:37 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.130@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:45:37.745784 12799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:37.741214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:43133 (local address 127.30.214.130:37767)
0808 14:45:37.741372 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:37.741385 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:37.741471 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:37.741603 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:37.741604 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:37.741786 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:37.741837 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:37.741840 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:37.742496 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:37.742497 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:37.743033 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:37.743035 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:37.743364 (+ 329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:37.743365 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:37.743416 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:37.743885 (+ 469us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:37.743890 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:37.745705 (+ 1815us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.214.190:43133: Server oryx/127.30.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":63,"threads_started":1}
W20260808 14:45:37.746007 12798 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:45:37.741349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.130:37767 (local address 127.30.214.190:43133)
0808 14:45:37.741418 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:37.741420 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:37.741432 (+ 12us) server_negotiation.cc:407] Connection header received
0808 14:45:37.741529 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:37.741530 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:37.741543 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:37.741588 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:37.741911 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:37.742418 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:37.743116 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:37.743303 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:37.743358 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:37.745807 (+ 2449us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.214.130:37767: BlockingRecv error: recv got EOF from 127.30.214.130:37767 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 08 14:45:37 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.131@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:45:37 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.131@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:45:37.885684 12800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:37.881063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:43133 (local address 127.30.214.131:46427)
0808 14:45:37.881230 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:37.881243 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:37.881327 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:37.881493 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:37.881494 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:37.881683 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:37.881734 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:37.881736 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:37.882391 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:37.882414 (+ 23us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:37.882967 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:37.882970 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:37.883309 (+ 339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:37.883310 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:37.883364 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:37.883833 (+ 469us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:37.883837 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:37.885609 (+ 1772us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.214.190:43133: Server oryx/127.30.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":78,"threads_started":1}
W20260808 14:45:37.885785 12798 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:45:37.881181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:46427 (local address 127.30.214.190:43133)
0808 14:45:37.881244 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:37.881246 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:37.881314 (+ 68us) server_negotiation.cc:407] Connection header received
0808 14:45:37.881385 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:37.881386 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:37.881400 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:37.881482 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:37.881813 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:37.882308 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:37.883056 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:37.883244 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:37.883301 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:37.885723 (+ 2422us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.214.131:46427: BlockingRecv error: recv got EOF from 127.30.214.131:46427 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
Aug 08 14:45:38 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.129@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:45:38 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.129@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:45:38.625380 12801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:38.620912 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:43133 (local address 127.30.214.129:42701)
0808 14:45:38.621045 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:38.621059 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:38.621124 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:38.621254 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:38.621255 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:38.621425 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:38.621511 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:38.621513 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:38.622212 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:38.622214 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:38.622759 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:38.622760 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:38.623063 (+ 303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:38.623063 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:38.623101 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:38.623558 (+ 457us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:38.623563 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:38.625319 (+ 1756us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.214.190:43133: Server oryx/127.30.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":61,"threads_started":1}
W20260808 14:45:38.625550 12802 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:45:38.620978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.129:42701 (local address 127.30.214.190:43133)
0808 14:45:38.621132 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:38.621134 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:38.621143 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:45:38.621169 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:38.621170 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:38.621181 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:38.621243 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:38.621573 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:38.622081 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:38.622827 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:38.623011 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:38.623054 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:38.625432 (+ 2378us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.214.129:42701: BlockingRecv error: recv got EOF from 127.30.214.129:42701 (error 108)
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":75,"threads_started":1}
Aug 08 14:45:38 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.130@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:45:38 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.130@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:45:38.752103 12803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:38.746465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:43133 (local address 127.30.214.130:49777)
0808 14:45:38.746765 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:38.746783 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:38.746904 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:38.747153 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:38.747155 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:38.747372 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:38.747448 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:38.747451 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:38.748208 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:38.748209 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:38.748872 (+ 663us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:38.748874 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:38.749296 (+ 422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:38.749299 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:38.749394 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:38.750015 (+ 621us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:38.750020 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:38.752021 (+ 2001us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.214.190:43133: Server oryx/127.30.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":207,"threads_started":1}
W20260808 14:45:38.752205 12802 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:45:38.746658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.130:49777 (local address 127.30.214.190:43133)
0808 14:45:38.746770 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:38.746773 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:38.746931 (+ 158us) server_negotiation.cc:407] Connection header received
0808 14:45:38.746974 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:38.746975 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:38.746996 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:38.747061 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:38.747583 (+ 522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:38.748094 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:38.748968 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:38.749213 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:38.749267 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:38.752149 (+ 2882us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.214.130:49777: BlockingRecv error: recv got EOF from 127.30.214.130:49777 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 08 14:45:38 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.131@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:45:38 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.131@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:45:38.890827 12804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:38.886238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:43133 (local address 127.30.214.131:51391)
0808 14:45:38.886400 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:38.886411 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:38.886469 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:38.886596 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:38.886597 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:38.886764 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:38.886817 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:38.886818 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:38.887465 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:38.887466 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:38.888007 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:38.888008 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:38.888294 (+ 286us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:38.888294 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:38.888330 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:38.888737 (+ 407us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:38.888742 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:38.890765 (+ 2023us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.214.190:43133: Server oryx/127.30.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":87,"threads_started":1}
W20260808 14:45:38.890966 12802 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:45:38.886388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:51391 (local address 127.30.214.190:43133)
0808 14:45:38.886447 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:38.886448 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:38.886458 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:45:38.886520 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:38.886521 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:38.886532 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:38.886580 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:38.886868 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:38.887387 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:38.888069 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:38.888245 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:38.888290 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:38.890897 (+ 2607us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.214.131:51391: BlockingRecv error: recv got EOF from 127.30.214.131:51391 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
Aug 08 14:45:39 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.129@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:45:39 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.129@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:45:39.631063 12805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:39.626100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:43133 (local address 127.30.214.129:45541)
0808 14:45:39.626316 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:39.626328 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:39.626391 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:39.626633 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:39.626635 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:39.626820 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:39.626882 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:39.626884 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:39.627624 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:39.627625 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:39.628163 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:39.628165 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:39.628505 (+ 340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:39.628505 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:39.628546 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:39.629022 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:39.629027 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:39.631001 (+ 1974us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.214.190:43133: Server oryx/127.30.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":113,"threads_started":1}
W20260808 14:45:39.631175 12806 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:45:39.626192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.129:45541 (local address 127.30.214.190:43133)
0808 14:45:39.626362 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:39.626365 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:39.626412 (+ 47us) server_negotiation.cc:407] Connection header received
0808 14:45:39.626468 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:39.626469 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:39.626483 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:39.626551 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:39.626967 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:39.627544 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:39.628245 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:39.628445 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:39.628494 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:39.631090 (+ 2596us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.214.129:45541: BlockingRecv error: recv got EOF from 127.30.214.129:45541 (error 108)
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":103,"threads_started":1}
Aug 08 14:45:39 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.130@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:45:39 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.130@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:45:39.757893 12807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:39.752824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:43133 (local address 127.30.214.130:36997)
0808 14:45:39.753035 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:39.753049 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:39.753121 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:39.753332 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:39.753333 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:39.753583 (+ 250us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:39.753664 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:39.753667 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:39.754417 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:39.754418 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:39.755018 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:39.755020 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:39.755324 (+ 304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:39.755325 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:39.755364 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:39.755824 (+ 460us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:39.755828 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:39.757829 (+ 2001us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.214.190:43133: Server oryx/127.30.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":113,"threads_started":1}
W20260808 14:45:39.758044 12806 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:45:39.752952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.130:36997 (local address 127.30.214.190:43133)
0808 14:45:39.753016 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:39.753017 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:39.753106 (+ 89us) server_negotiation.cc:407] Connection header received
0808 14:45:39.753183 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:39.753184 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:39.753197 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:39.753268 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:39.753820 (+ 552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:39.754321 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:39.755091 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:39.755272 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:39.755317 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:39.757980 (+ 2663us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.214.130:36997: BlockingRecv error: recv got EOF from 127.30.214.130:36997 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
Aug 08 14:45:39 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.131@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:45:39 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.131@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:45:39.896238 12808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:39.891432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:43133 (local address 127.30.214.131:51183)
0808 14:45:39.891592 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:39.891602 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:39.891664 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:39.891792 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:39.891793 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:39.891964 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:39.892018 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:39.892019 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:39.892722 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:39.892723 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:39.893252 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:39.893253 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:39.893791 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:39.893792 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:39.893859 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:39.894404 (+ 545us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:39.894410 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:39.896175 (+ 1765us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.214.190:43133: Server oryx/127.30.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":77,"threads_started":1}
W20260808 14:45:39.896353 12806 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:45:39.891525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:51183 (local address 127.30.214.190:43133)
0808 14:45:39.891583 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:39.891584 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:39.891661 (+ 77us) server_negotiation.cc:407] Connection header received
0808 14:45:39.891710 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:39.891710 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:39.891721 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:39.891774 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:39.892095 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:39.892583 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:39.893363 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:39.893649 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:39.893728 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:39.896277 (+ 2549us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.214.131:51183: BlockingRecv error: recv got EOF from 127.30.214.131:51183 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
Aug 08 14:45:40 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.129@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:45:40 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.129@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:45:40.636127 12810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:40.631603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:43133 (local address 127.30.214.129:55673)
0808 14:45:40.631742 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:40.631753 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:40.631812 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:40.631958 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:40.631959 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:40.632121 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:40.632170 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:40.632171 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:40.632856 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:40.632856 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:40.633608 (+ 752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:40.633611 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:40.633933 (+ 322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:40.633933 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:40.633969 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:40.634435 (+ 466us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:40.634441 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:40.636067 (+ 1626us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.214.190:43133: Server oryx/127.30.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":81,"threads_started":1}
W20260808 14:45:40.636248 12812 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:45:40.631706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.129:55673 (local address 127.30.214.190:43133)
0808 14:45:40.631844 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:40.631846 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:40.631855 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:45:40.631879 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:40.631879 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:40.631889 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:40.631948 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:40.632241 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:40.632763 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:40.633675 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:40.633874 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:40.633930 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:40.636163 (+ 2233us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.214.129:55673: BlockingRecv error: recv got EOF from 127.30.214.129:55673 (error 108)
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":78,"threads_started":1}
Aug 08 14:45:40 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.130@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:45:40 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.130@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:45:40.765872 12813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:40.758469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:43133 (local address 127.30.214.130:52013)
0808 14:45:40.758646 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:40.758659 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:40.758738 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:40.758870 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:40.758871 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:40.759083 (+ 212us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:40.759133 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:40.759135 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:40.759812 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:40.759813 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:40.760333 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:40.760334 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:40.760682 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:40.760683 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:40.760741 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:40.763922 (+ 3181us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:40.763928 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:40.765812 (+ 1884us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.214.190:43133: Server oryx/127.30.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":110,"threads_started":1}
W20260808 14:45:40.765993 12812 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:45:40.758601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.130:52013 (local address 127.30.214.190:43133)
0808 14:45:40.758660 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:40.758662 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:40.758723 (+ 61us) server_negotiation.cc:407] Connection header received
0808 14:45:40.758799 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:40.758800 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:40.758812 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:40.758860 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:40.759205 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:40.759737 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:40.760404 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:40.760614 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:40.760674 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:40.765924 (+ 5250us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.214.130:52013: BlockingRecv error: recv got EOF from 127.30.214.130:52013 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
Aug 08 14:45:40 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.131@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:45:40 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.131@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:45:40.901314 12814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:40.896747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:43133 (local address 127.30.214.131:34377)
0808 14:45:40.896916 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:40.896929 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:40.897010 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:40.897141 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:40.897142 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:40.897321 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:40.897371 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:40.897372 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:40.898043 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:40.898044 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:40.898567 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:40.898568 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:40.898892 (+ 324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:40.898893 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:40.898945 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:40.899392 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:40.899396 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:40.901253 (+ 1857us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.214.190:43133: Server oryx/127.30.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":69,"threads_started":1}
W20260808 14:45:40.901434 12812 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:45:40.896858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:34377 (local address 127.30.214.190:43133)
0808 14:45:40.896920 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:40.896922 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:40.896985 (+ 63us) server_negotiation.cc:407] Connection header received
0808 14:45:40.897064 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:40.897065 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:40.897078 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:40.897126 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:40.897476 (+ 350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:40.897970 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:40.898644 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:40.898831 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:40.898893 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:40.901361 (+ 2468us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.214.131:34377: BlockingRecv error: recv got EOF from 127.30.214.131:34377 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 08 14:45:41 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.129@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:45:41 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.129@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:45:41.640727 12817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:41.636580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:43133 (local address 127.30.214.129:45889)
0808 14:45:41.636715 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:41.636727 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:41.636780 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:41.636907 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:41.636908 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:41.637074 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:41.637126 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:41.637128 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:41.637763 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:41.637764 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:41.638291 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:41.638293 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:41.638572 (+ 279us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:41.638572 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:41.638608 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:41.639001 (+ 393us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:41.639005 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:41.640668 (+ 1663us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.214.190:43133: Server oryx/127.30.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":69,"threads_started":1}
W20260808 14:45:41.640865 12819 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:45:41.636669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.129:45889 (local address 127.30.214.190:43133)
0808 14:45:41.636778 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:41.636780 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:41.636789 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:45:41.636824 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:41.636825 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:41.636836 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:41.636892 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:41.637176 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:41.637701 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:41.638344 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:41.638526 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:41.638568 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:41.640773 (+ 2205us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.214.129:45889: BlockingRecv error: recv got EOF from 127.30.214.129:45889 (error 108)
Metrics: {"server-negotiator.queue_time_us":89,"thread_start_us":51,"threads_started":1}
Aug 08 14:45:41 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.130@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:45:41 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.130@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:45:41.770797 12820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:41.766361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:43133 (local address 127.30.214.130:36643)
0808 14:45:41.766516 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:41.766527 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:41.766583 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:41.766749 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:41.766750 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:41.766922 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:41.766972 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:41.766973 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:41.767607 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:41.767608 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:41.768178 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:41.768181 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:41.768504 (+ 323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:41.768505 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:41.768556 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:41.768996 (+ 440us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:41.769001 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:41.770739 (+ 1738us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.214.190:43133: Server oryx/127.30.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":64,"threads_started":1}
W20260808 14:45:41.770901 12819 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:45:41.766528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.130:36643 (local address 127.30.214.190:43133)
0808 14:45:41.766587 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:41.766589 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:41.766598 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:45:41.766638 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:41.766639 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:41.766649 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:41.766736 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:41.767039 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:41.767536 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:41.768256 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:41.768447 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:41.768499 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:41.770833 (+ 2334us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.214.130:36643: BlockingRecv error: recv got EOF from 127.30.214.130:36643 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
Aug 08 14:45:41 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.131@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:45:41 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.131@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:45:41.906314 12821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:41.901829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:43133 (local address 127.30.214.131:53301)
0808 14:45:41.901953 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:41.901963 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:41.902021 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:41.902125 (+ 104us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:41.902125 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:41.902286 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:41.902338 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:41.902339 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:41.903030 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:41.903031 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:41.903577 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:41.903579 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:41.903959 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:41.903961 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:41.904013 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:41.904463 (+ 450us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:41.904467 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:41.906254 (+ 1787us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.214.190:43133: Server oryx/127.30.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":71,"threads_started":1}
W20260808 14:45:41.906399 12819 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:45:41.901907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:53301 (local address 127.30.214.190:43133)
0808 14:45:41.901956 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:41.901958 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:41.902007 (+ 49us) server_negotiation.cc:407] Connection header received
0808 14:45:41.902059 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:41.902060 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:41.902070 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:41.902113 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:41.902385 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:41.902972 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:41.903654 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:41.903875 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:41.903937 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:41.906339 (+ 2402us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.214.131:53301: BlockingRecv error: recv got EOF from 127.30.214.131:53301 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
Aug 08 14:45:42 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.129@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:45:42 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.129@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:45:42.645540 12824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:42.641211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:43133 (local address 127.30.214.129:37143)
0808 14:45:42.641340 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:42.641351 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:42.641410 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:42.641553 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:42.641554 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:42.641715 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:42.641767 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:42.641768 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:42.642408 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:42.642408 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:42.642957 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:42.642958 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:42.643245 (+ 287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:42.643246 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:42.643281 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:42.643744 (+ 463us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:42.643748 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:42.645434 (+ 1686us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.214.190:43133: Server oryx/127.30.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":74,"threads_started":1}
W20260808 14:45:42.645642 12825 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:45:42.641294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.129:37143 (local address 127.30.214.190:43133)
0808 14:45:42.641408 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:42.641410 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:42.641421 (+ 11us) server_negotiation.cc:407] Connection header received
0808 14:45:42.641467 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:42.641468 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:42.641481 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:42.641549 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:42.641820 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:42.642328 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:42.643020 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:42.643201 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:42.643242 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:42.645569 (+ 2327us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.214.129:37143: BlockingRecv error: recv got EOF from 127.30.214.129:37143 (error 108)
Metrics: {"server-negotiator.queue_time_us":93,"thread_start_us":51,"threads_started":1}
Aug 08 14:45:42 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.130@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:45:42 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.130@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:45:42.775354 12827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:42.771262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:43133 (local address 127.30.214.130:45463)
0808 14:45:42.771414 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:42.771424 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:42.771481 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:42.771611 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:42.771612 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:42.771769 (+ 157us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:42.771819 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:42.771821 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:42.772429 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:42.772430 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:42.772953 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:42.772954 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:42.773226 (+ 272us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:42.773227 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:42.773262 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:42.773678 (+ 416us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:42.773682 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:42.775294 (+ 1612us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.214.190:43133: Server oryx/127.30.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":85,"threads_started":1}
W20260808 14:45:42.775509 12825 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:45:42.771336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.130:45463 (local address 127.30.214.190:43133)
0808 14:45:42.771393 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:42.771395 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:42.771475 (+ 80us) server_negotiation.cc:407] Connection header received
0808 14:45:42.771531 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:42.771532 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:42.771542 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:42.771600 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:42.771867 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:42.772365 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:42.773007 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:42.773182 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:42.773223 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:42.775445 (+ 2222us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.214.130:45463: BlockingRecv error: recv got EOF from 127.30.214.130:45463 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
Aug 08 14:45:42 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.131@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:45:42 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.131@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:45:42.911109 12828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:42.906822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:43133 (local address 127.30.214.131:39529)
0808 14:45:42.906991 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:42.907001 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:42.907057 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:42.907172 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:42.907173 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:42.907333 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:42.907392 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:42.907394 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:42.907982 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:42.907983 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:42.908517 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:42.908518 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:42.908843 (+ 325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:42.908843 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:42.908880 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:42.909316 (+ 436us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:42.909321 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:42.911050 (+ 1729us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.214.190:43133: Server oryx/127.30.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":88,"threads_started":1}
W20260808 14:45:42.911208 12825 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:45:42.906900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:39529 (local address 127.30.214.190:43133)
0808 14:45:42.906952 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:42.906954 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:42.907051 (+ 97us) server_negotiation.cc:407] Connection header received
0808 14:45:42.907103 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:42.907104 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:42.907113 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:42.907160 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:42.907436 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:42.907929 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:42.908592 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:42.908782 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:42.908842 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:42.911140 (+ 2298us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.214.131:39529: BlockingRecv error: recv got EOF from 127.30.214.131:39529 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
Aug 08 14:45:43 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.129@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:45:43 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.129@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:45:43.650713 12830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:43.646116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:43133 (local address 127.30.214.129:48327)
0808 14:45:43.646251 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:43.646261 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:43.646312 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:43.646505 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:43.646506 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:43.646681 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:43.646735 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:43.646737 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:43.647500 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:43.647502 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:43.648102 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:43.648105 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:43.648464 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:43.648465 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:43.648519 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:43.648953 (+ 434us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:43.648957 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:43.650655 (+ 1698us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.214.190:43133: Server oryx/127.30.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":61,"threads_started":1}
W20260808 14:45:43.650820 12834 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:45:43.646228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.129:48327 (local address 127.30.214.190:43133)
0808 14:45:43.646367 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:43.646369 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:43.646377 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:45:43.646402 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:43.646402 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:43.646413 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:43.646493 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:43.646829 (+ 336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:43.647421 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:43.648164 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:43.648356 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:43.648419 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:43.650749 (+ 2330us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.214.129:48327: BlockingRecv error: recv got EOF from 127.30.214.129:48327 (error 108)
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":78,"threads_started":1}
Aug 08 14:45:43 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.130@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:45:43 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.130@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:45:43.780414 12835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:43.776032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:43133 (local address 127.30.214.130:57345)
0808 14:45:43.776201 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:43.776213 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:43.776284 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:43.776425 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:43.776427 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:43.776595 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:43.776641 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:43.776643 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:43.777282 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:43.777283 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:43.777812 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:43.777814 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:43.778145 (+ 331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:43.778146 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:43.778198 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:43.778607 (+ 409us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:43.778611 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:43.780337 (+ 1726us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.214.190:43133: Server oryx/127.30.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":97,"threads_started":1}
W20260808 14:45:43.780511 12834 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:45:43.776107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.130:57345 (local address 127.30.214.190:43133)
0808 14:45:43.776173 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:43.776175 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:43.776277 (+ 102us) server_negotiation.cc:407] Connection header received
0808 14:45:43.776334 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:43.776335 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:43.776348 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:43.776402 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:43.776717 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:43.777209 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:43.777895 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:43.778085 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:43.778140 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:43.780457 (+ 2317us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.214.130:57345: BlockingRecv error: recv got EOF from 127.30.214.130:57345 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Aug 08 14:45:43 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.131@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:45:43 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.131@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:45:43.916169 12836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:43.911589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:43133 (local address 127.30.214.131:35673)
0808 14:45:43.911735 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:43.911747 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:43.911825 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:43.911957 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:43.911957 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:43.912147 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:43.912198 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:43.912201 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:43.912862 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:43.912863 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:43.913384 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:43.913385 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:43.913721 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:43.913722 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:43.913778 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:43.914229 (+ 451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:43.914233 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:43.916105 (+ 1872us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.214.190:43133: Server oryx/127.30.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":76,"threads_started":1}
W20260808 14:45:43.916258 12834 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:45:43.911675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:35673 (local address 127.30.214.190:43133)
0808 14:45:43.911737 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:43.911739 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:43.911815 (+ 76us) server_negotiation.cc:407] Connection header received
0808 14:45:43.911879 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:43.911880 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:43.911893 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:43.911942 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:43.912276 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:43.912782 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:43.913466 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:43.913659 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:43.913714 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:43.916198 (+ 2484us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.214.131:35673: BlockingRecv error: recv got EOF from 127.30.214.131:35673 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
Aug 08 14:45:44 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.129@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:45:44 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.129@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:45:44.656121 12837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:44.651300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:43133 (local address 127.30.214.129:50637)
0808 14:45:44.651461 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:44.651473 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:44.651536 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:44.651757 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:44.651757 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:44.651929 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:44.652004 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:44.652005 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:44.652843 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:44.652844 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:44.653413 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:44.653415 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:44.653769 (+ 354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:44.653770 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:44.653810 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:44.654254 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:44.654258 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:44.656022 (+ 1764us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.214.190:43133: Server oryx/127.30.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":65,"threads_started":1}
W20260808 14:45:44.656200 12843 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:45:44.651498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.129:50637 (local address 127.30.214.190:43133)
0808 14:45:44.651637 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:44.651639 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:44.651648 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:45:44.651673 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:44.651674 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:44.651684 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:44.651744 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:44.652073 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:44.652770 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:44.653530 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:44.653718 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:44.653765 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:44.656137 (+ 2372us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.214.129:50637: BlockingRecv error: recv got EOF from 127.30.214.129:50637 (error 108)
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":70,"threads_started":1}
Aug 08 14:45:44 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.130@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:45:44 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.130@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:45:44.785683 12844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:44.781009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:43133 (local address 127.30.214.130:53529)
0808 14:45:44.781168 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:44.781179 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:44.781239 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:44.781379 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:44.781379 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:44.781577 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:44.781628 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:44.781630 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:44.782414 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:44.782414 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:44.782998 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:44.783001 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:44.783364 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:44.783365 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:44.783424 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:44.783861 (+ 437us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:44.783865 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:44.785605 (+ 1740us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.214.190:43133: Server oryx/127.30.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":66,"threads_started":1}
W20260808 14:45:44.785758 12843 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:45:44.781094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.130:53529 (local address 127.30.214.190:43133)
0808 14:45:44.781151 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:44.781153 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:44.781235 (+ 82us) server_negotiation.cc:407] Connection header received
0808 14:45:44.781306 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:44.781307 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:44.781318 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:44.781359 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:44.781701 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:44.782343 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:44.783067 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:44.783293 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:44.783353 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:44.785703 (+ 2350us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.214.130:53529: BlockingRecv error: recv got EOF from 127.30.214.130:53529 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
Aug 08 14:45:44 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.131@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:45:44 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.131@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:45:44.921044 12845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:44.916648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:43133 (local address 127.30.214.131:33189)
0808 14:45:44.916782 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:44.916794 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:44.916855 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:44.916989 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:44.916990 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:44.917156 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:44.917206 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:44.917207 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:44.917829 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:44.917830 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:44.918360 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:44.918362 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:44.918744 (+ 382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:44.918744 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:44.918779 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:44.919228 (+ 449us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:44.919232 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:44.920947 (+ 1715us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.214.190:43133: Server oryx/127.30.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":64,"threads_started":1}
W20260808 14:45:44.921121 12843 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:45:44.916730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:33189 (local address 127.30.214.190:43133)
0808 14:45:44.916786 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:44.916788 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:44.916851 (+ 63us) server_negotiation.cc:407] Connection header received
0808 14:45:44.916916 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:44.916917 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:44.916930 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:44.916972 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:44.917258 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:44.917774 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:44.918468 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:44.918678 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:44.918742 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:44.921067 (+ 2325us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.214.131:33189: BlockingRecv error: recv got EOF from 127.30.214.131:33189 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
Aug 08 14:45:45 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.129@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:45:45 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.129@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:45:45.661346 12846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:45.656627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:43133 (local address 127.30.214.129:33457)
0808 14:45:45.656789 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:45.656801 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:45.656868 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:45.656988 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:45.656989 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:45.657155 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:45.657208 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:45.657209 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:45.657892 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:45.657893 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:45.658449 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:45.658452 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:45.658792 (+ 340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:45.658794 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:45.658848 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:45.659279 (+ 431us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:45.659284 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:45.661284 (+ 2000us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.214.190:43133: Server oryx/127.30.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":73,"threads_started":1}
W20260808 14:45:45.661515 12847 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:45:45.656707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.129:33457 (local address 127.30.214.190:43133)
0808 14:45:45.656809 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:45.656811 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:45.656852 (+ 41us) server_negotiation.cc:407] Connection header received
0808 14:45:45.656924 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:45.656925 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:45.656935 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:45.656983 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:45.657260 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:45.657810 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:45.658520 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:45.658708 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:45.658756 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:45.661394 (+ 2638us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.214.129:33457: BlockingRecv error: recv got EOF from 127.30.214.129:33457 (error 108)
Metrics: {"server-negotiator.queue_time_us":82,"thread_start_us":52,"threads_started":1}
Aug 08 14:45:45 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.130@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:45:45 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.130@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:45:45.794929 12848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:45.786209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:43133 (local address 127.30.214.130:36293)
0808 14:45:45.786335 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:45.786345 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:45.786403 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:45.786536 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:45.786537 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:45.786703 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:45.786754 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:45.786755 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:45.787423 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:45.787424 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:45.788035 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:45.788038 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:45.788364 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:45.788364 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:45.788419 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:45.791776 (+ 3357us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:45.791787 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:45.794828 (+ 3041us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.214.190:43133: Server oryx/127.30.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":73,"threads_started":1}
W20260808 14:45:45.795029 12847 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:45:45.786315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.130:36293 (local address 127.30.214.190:43133)
0808 14:45:45.786400 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:45.786402 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:45.786413 (+ 11us) server_negotiation.cc:407] Connection header received
0808 14:45:45.786445 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:45.786446 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:45.786459 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:45.786524 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:45.786812 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:45.787349 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:45.788111 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:45.788307 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:45.788360 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:45.794976 (+ 6616us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.214.130:36293: BlockingRecv error: recv got EOF from 127.30.214.130:36293 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 08 14:45:45 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.131@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:45:45 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.131@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:45:45.926075 12851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:45.921590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:43133 (local address 127.30.214.131:54273)
0808 14:45:45.921726 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:45.921737 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:45.921809 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:45.921951 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:45.921952 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:45.922128 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:45.922183 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:45.922185 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:45.922815 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:45.922816 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:45.923359 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:45.923360 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:45.923650 (+ 290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:45.923650 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:45.923686 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:45.924118 (+ 432us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:45.924122 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:45.925993 (+ 1871us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.214.190:43133: Server oryx/127.30.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":61,"threads_started":1}
W20260808 14:45:45.926218 12847 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:45:45.921676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:54273 (local address 127.30.214.190:43133)
0808 14:45:45.921728 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:45.921730 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:45.921839 (+ 109us) server_negotiation.cc:407] Connection header received
0808 14:45:45.921861 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:45.921862 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:45.921873 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:45.921917 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:45.922240 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:45.922736 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:45.923427 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:45.923600 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:45.923643 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:45.926108 (+ 2465us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.214.131:54273: BlockingRecv error: recv got EOF from 127.30.214.131:54273 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
Aug 08 14:45:46 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.129@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:45:46 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.129@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:45:46.666625 12852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:46.661861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:43133 (local address 127.30.214.129:44821)
0808 14:45:46.661996 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:46.662008 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:46.662065 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:46.662249 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:46.662250 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:46.662419 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:46.662473 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:46.662474 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:46.663164 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:46.663165 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:46.663713 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:46.663715 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:46.664139 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:46.664140 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:46.664213 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:46.664728 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:46.664733 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:46.666557 (+ 1824us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.214.190:43133: Server oryx/127.30.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":80,"threads_started":1}
W20260808 14:45:46.666778 12854 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:45:46.661969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.129:44821 (local address 127.30.214.190:43133)
0808 14:45:46.662108 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:46.662110 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:46.662121 (+ 11us) server_negotiation.cc:407] Connection header received
0808 14:45:46.662149 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:46.662149 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:46.662161 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:46.662237 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:46.662565 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:46.663090 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:46.663812 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:46.664051 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:46.664119 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:46.666703 (+ 2584us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.214.129:44821: BlockingRecv error: recv got EOF from 127.30.214.129:44821 (error 108)
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":75,"threads_started":1}
Aug 08 14:45:46 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.130@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:45:46 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.130@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:45:46.802240 12855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:46.797945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:43133 (local address 127.30.214.130:45095)
0808 14:45:46.798075 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:46.798087 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:46.798134 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:46.798280 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:46.798281 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:46.798452 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:46.798505 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:46.798507 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:46.799148 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:46.799148 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:46.799702 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:46.799704 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:46.800037 (+ 333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:46.800038 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:46.800077 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:46.800501 (+ 424us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:46.800505 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:46.802165 (+ 1660us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.214.190:43133: Server oryx/127.30.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":72,"threads_started":1}
W20260808 14:45:46.802328 12854 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:45:46.798055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.130:45095 (local address 127.30.214.190:43133)
0808 14:45:46.798135 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:46.798136 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:46.798186 (+ 50us) server_negotiation.cc:407] Connection header received
0808 14:45:46.798214 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:46.798214 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:46.798225 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:46.798268 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:46.798574 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:46.799083 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:46.799785 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:46.799979 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:46.800032 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:46.802267 (+ 2235us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.214.130:45095: BlockingRecv error: recv got EOF from 127.30.214.130:45095 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 08 14:45:46 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.131@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:45:46 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.131@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:45:46.930876 12856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:46.926556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:43133 (local address 127.30.214.131:34367)
0808 14:45:46.926703 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:46.926715 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:46.926763 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:46.926870 (+ 107us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:46.926870 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:46.927039 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:46.927091 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:46.927092 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:46.927696 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:46.927697 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:46.928234 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:46.928237 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:46.928592 (+ 355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:46.928593 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:46.928635 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:46.929107 (+ 472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:46.929112 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:46.930815 (+ 1703us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.214.190:43133: Server oryx/127.30.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":59,"threads_started":1}
W20260808 14:45:46.930979 12854 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:45:46.926666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:34367 (local address 127.30.214.190:43133)
0808 14:45:46.926742 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:46.926744 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:46.926782 (+ 38us) server_negotiation.cc:407] Connection header received
0808 14:45:46.926805 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:46.926806 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:46.926817 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:46.926858 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:46.927144 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:46.927637 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:46.928329 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:46.928532 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:46.928584 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:46.930917 (+ 2333us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.214.131:34367: BlockingRecv error: recv got EOF from 127.30.214.131:34367 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 08 14:45:47 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.129@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:45:47 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.129@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:45:47.672181 12858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:47.667159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:43133 (local address 127.30.214.129:37777)
0808 14:45:47.667292 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:47.667303 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:47.667362 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:47.667532 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:47.667533 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:47.667715 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:47.667766 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:47.667767 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:47.668507 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:47.668508 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:47.669076 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:47.669078 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:47.669546 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:47.669547 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:47.669598 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:47.670065 (+ 467us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:47.670069 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:47.672106 (+ 2037us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.214.190:43133: Server oryx/127.30.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":76,"threads_started":1}
W20260808 14:45:47.672367 12859 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:45:47.667238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.129:37777 (local address 127.30.214.190:43133)
0808 14:45:47.667351 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:47.667353 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:47.667364 (+ 11us) server_negotiation.cc:407] Connection header received
0808 14:45:47.667410 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:47.667410 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:47.667421 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:47.667483 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:47.667834 (+ 351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:47.668419 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:47.669208 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:47.669415 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:47.669493 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:47.672294 (+ 2801us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.214.129:37777: BlockingRecv error: recv got EOF from 127.30.214.129:37777 (error 108)
Metrics: {"server-negotiator.queue_time_us":92,"thread_start_us":55,"threads_started":1}
Aug 08 14:45:47 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.130@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:45:47 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.130@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:45:47.807137 12860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:47.802695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:43133 (local address 127.30.214.130:52905)
0808 14:45:47.802840 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:47.802850 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:47.802911 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:47.803023 (+ 112us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:47.803023 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:47.803193 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:47.803243 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:47.803246 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:47.803879 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:47.803880 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:47.804420 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:47.804422 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:47.804729 (+ 307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:47.804730 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:47.804766 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:47.805216 (+ 450us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:47.805220 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:47.807062 (+ 1842us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.214.190:43133: Server oryx/127.30.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":80,"threads_started":1}
W20260808 14:45:47.807245 12859 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:45:47.802755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.130:52905 (local address 127.30.214.190:43133)
0808 14:45:47.802828 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:47.802831 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:47.802921 (+ 90us) server_negotiation.cc:407] Connection header received
0808 14:45:47.802952 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:47.802953 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:47.802965 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:47.803017 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:47.803302 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:47.803812 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:47.804485 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:47.804675 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:47.804725 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:47.807172 (+ 2447us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.214.130:52905: BlockingRecv error: recv got EOF from 127.30.214.130:52905 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 08 14:45:47 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.131@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:45:47 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.131@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:45:47.935756 12865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:47.931356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:43133 (local address 127.30.214.131:60061)
0808 14:45:47.931541 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:47.931553 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:47.931639 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:47.931787 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:47.931788 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:47.932020 (+ 232us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:47.932074 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:47.932076 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:47.932698 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:47.932698 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:47.933232 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:47.933233 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:47.933557 (+ 324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:47.933558 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:47.933622 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:47.934034 (+ 412us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:47.934038 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:47.935683 (+ 1645us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.214.190:43133: Server oryx/127.30.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":115,"threads_started":1}
W20260808 14:45:47.935838 12859 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:45:47.931421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:60061 (local address 127.30.214.190:43133)
0808 14:45:47.931498 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:47.931500 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:47.931635 (+ 135us) server_negotiation.cc:407] Connection header received
0808 14:45:47.931695 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:47.931696 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:47.931711 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:47.931770 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:47.932138 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:47.932637 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:47.933296 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:47.933505 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:47.933552 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:47.935780 (+ 2228us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.214.131:60061: BlockingRecv error: recv got EOF from 127.30.214.131:60061 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 08 14:45:48 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.129@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:45:48 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.129@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:45:48.677322 12866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:48.672774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:43133 (local address 127.30.214.129:43189)
0808 14:45:48.672934 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:48.672947 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:48.673009 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:48.673138 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:48.673139 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:48.673313 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:48.673370 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:48.673371 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:48.674056 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:48.674058 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:48.674602 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:48.674604 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:48.674942 (+ 338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:48.674943 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:48.674988 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:48.675464 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:48.675467 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:48.677240 (+ 1773us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.214.190:43133: Server oryx/127.30.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":86,"threads_started":1}
W20260808 14:45:48.677421 12867 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:45:48.672854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.129:43189 (local address 127.30.214.190:43133)
0808 14:45:48.672992 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:48.672994 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:48.673004 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:45:48.673057 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:48.673057 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:48.673068 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:48.673124 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:48.673426 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:48.673977 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:48.674672 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:48.674876 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:48.674925 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:48.677354 (+ 2429us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.214.129:43189: BlockingRecv error: recv got EOF from 127.30.214.129:43189 (error 108)
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":72,"threads_started":1}
Aug 08 14:45:48 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.130@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:45:48 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.130@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:45:48.812284 12869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:48.807699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:43133 (local address 127.30.214.130:54419)
0808 14:45:48.807836 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:48.807848 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:48.807903 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:48.808053 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:48.808054 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:48.808224 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:48.808273 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:48.808275 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:48.808912 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:48.808913 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:48.809639 (+ 726us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:48.809642 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:48.809990 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:48.809991 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:48.810044 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:48.810456 (+ 412us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:48.810460 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:48.812212 (+ 1752us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.214.190:43133: Server oryx/127.30.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":75,"threads_started":1}
W20260808 14:45:48.812381 12867 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:45:48.807837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.130:54419 (local address 127.30.214.190:43133)
0808 14:45:48.807920 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:48.807921 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:48.807932 (+ 11us) server_negotiation.cc:407] Connection header received
0808 14:45:48.807963 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:48.807964 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:48.807974 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:48.808038 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:48.808334 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:48.808844 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:48.809715 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:48.809927 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:48.809986 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:48.812312 (+ 2326us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.214.130:54419: BlockingRecv error: recv got EOF from 127.30.214.130:54419 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 08 14:45:48 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.131@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:45:48 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.131@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:45:48.941020 12871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:48.936259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:43133 (local address 127.30.214.131:42571)
0808 14:45:48.936427 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:48.936438 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:48.936532 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:48.936672 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:48.936672 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:48.936860 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:48.936908 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:48.936910 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:48.937608 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:48.937610 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:48.938136 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:48.938138 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:48.938479 (+ 341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:48.938480 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:48.938535 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:48.938987 (+ 452us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:48.938992 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:48.940959 (+ 1967us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.214.190:43133: Server oryx/127.30.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":95,"threads_started":1}
W20260808 14:45:48.941174 12867 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:45:48.936388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:42571 (local address 127.30.214.190:43133)
0808 14:45:48.936439 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:48.936441 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:48.936521 (+ 80us) server_negotiation.cc:407] Connection header received
0808 14:45:48.936594 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:48.936595 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:48.936609 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:48.936659 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:48.936986 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:48.937535 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:48.938212 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:48.938410 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:48.938465 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:48.941100 (+ 2635us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.214.131:42571: BlockingRecv error: recv got EOF from 127.30.214.131:42571 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
Aug 08 14:45:49 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.129@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:45:49 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.129@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:45:49.682610 12872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:49.677928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:43133 (local address 127.30.214.129:46607)
0808 14:45:49.678062 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:49.678070 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:49.678117 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:49.678333 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:49.678334 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:49.678588 (+ 254us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:49.678648 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:49.678651 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:49.679323 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:49.679323 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:49.679896 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:49.679898 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:49.680241 (+ 343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:49.680242 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:49.680283 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:49.680703 (+ 420us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:49.680708 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:49.682513 (+ 1805us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.214.190:43133: Server oryx/127.30.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":65,"threads_started":1}
W20260808 14:45:49.682693 12873 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:45:49.678051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.129:46607 (local address 127.30.214.190:43133)
0808 14:45:49.678172 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:49.678174 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:49.678185 (+ 11us) server_negotiation.cc:407] Connection header received
0808 14:45:49.678211 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:49.678212 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:49.678224 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:49.678312 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:49.678732 (+ 420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:49.679254 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:49.679979 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:49.680178 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:49.680234 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:49.682628 (+ 2394us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.214.129:46607: BlockingRecv error: recv got EOF from 127.30.214.129:46607 (error 108)
Metrics: {"server-negotiator.queue_time_us":96,"thread_start_us":65,"threads_started":1}
Aug 08 14:45:49 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.130@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:45:49 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.130@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:45:49.817301 12875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:49.812773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:43133 (local address 127.30.214.130:34483)
0808 14:45:49.812964 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:49.812976 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:49.813065 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:49.813221 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:49.813223 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:49.813399 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:49.813482 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:49.813484 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:49.814121 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:49.814122 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:49.814650 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:49.814652 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:49.814957 (+ 305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:49.814957 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:49.815002 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:49.815435 (+ 433us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:49.815439 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:49.817239 (+ 1800us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.214.190:43133: Server oryx/127.30.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":97,"threads_started":1}
W20260808 14:45:49.817409 12873 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:45:49.812911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.130:34483 (local address 127.30.214.190:43133)
0808 14:45:49.812969 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:49.812971 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:49.813027 (+ 56us) server_negotiation.cc:407] Connection header received
0808 14:45:49.813130 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:49.813131 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:49.813146 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:49.813202 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:49.813560 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:49.814059 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:49.814710 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:49.814889 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:49.814932 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:49.817347 (+ 2415us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.214.130:34483: BlockingRecv error: recv got EOF from 127.30.214.130:34483 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
Aug 08 14:45:49 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.131@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:45:49 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.131@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:45:49.946048 12877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:49.941557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:43133 (local address 127.30.214.131:52539)
0808 14:45:49.941704 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:49.941714 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:49.941774 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:49.941896 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:49.941897 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:49.942073 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:49.942123 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:49.942125 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:49.942757 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:49.942759 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:49.943297 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:49.943299 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:49.943629 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:49.943630 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:49.943666 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:49.944136 (+ 470us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:49.944140 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:49.945963 (+ 1823us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.214.190:43133: Server oryx/127.30.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":72,"threads_started":1}
W20260808 14:45:49.946123 12873 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:45:49.941665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:52539 (local address 127.30.214.190:43133)
0808 14:45:49.941719 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:49.941721 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:49.941761 (+ 40us) server_negotiation.cc:407] Connection header received
0808 14:45:49.941830 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:49.941831 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:49.941844 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:49.941883 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:49.942175 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:49.942669 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:49.943382 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:49.943572 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:49.943625 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:49.946067 (+ 2442us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.214.131:52539: BlockingRecv error: recv got EOF from 127.30.214.131:52539 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
Aug 08 14:45:50 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.129@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:45:50 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.129@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:45:50.687342 12878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:50.683102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:43133 (local address 127.30.214.129:40121)
0808 14:45:50.683262 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:50.683273 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:50.683331 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:50.683449 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:50.683450 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:50.683618 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:50.683668 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:50.683669 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:50.684278 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:50.684279 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:50.684800 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:50.684801 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:50.685093 (+ 292us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:50.685094 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:50.685130 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:50.685589 (+ 459us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:50.685593 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:50.687283 (+ 1690us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.214.190:43133: Server oryx/127.30.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":66,"threads_started":1}
W20260808 14:45:50.687450 12881 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:45:50.683228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.129:40121 (local address 127.30.214.190:43133)
0808 14:45:50.683341 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:50.683343 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:50.683350 (+ 7us) server_negotiation.cc:407] Connection header received
0808 14:45:50.683372 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:50.683372 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:50.683382 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:50.683437 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:50.683719 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:50.684219 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:50.684858 (+ 639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:50.685043 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:50.685087 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:50.687382 (+ 2295us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.214.129:40121: BlockingRecv error: recv got EOF from 127.30.214.129:40121 (error 108)
Metrics: {"server-negotiator.queue_time_us":93,"thread_start_us":49,"threads_started":1}
Aug 08 14:45:50 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.130@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:45:50 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.130@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:45:50.825868 12882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:50.817846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:43133 (local address 127.30.214.130:40091)
0808 14:45:50.818017 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:50.818030 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:50.818109 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:50.818231 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:50.818232 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:50.818402 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:50.818454 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:50.818455 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:50.819159 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:50.819160 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:50.819733 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:50.819735 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:50.820049 (+ 314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:50.820050 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:50.820096 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:50.824004 (+ 3908us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:50.824011 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:50.825806 (+ 1795us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.214.190:43133: Server oryx/127.30.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":83,"threads_started":1}
W20260808 14:45:50.826025 12881 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:45:50.817950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.130:40091 (local address 127.30.214.190:43133)
0808 14:45:50.818016 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:50.818018 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:50.818099 (+ 81us) server_negotiation.cc:407] Connection header received
0808 14:45:50.818159 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:50.818160 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:50.818170 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:50.818219 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:50.818503 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:50.818999 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:50.819806 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:50.819987 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:50.820033 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:50.825961 (+ 5928us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.214.130:40091: BlockingRecv error: recv got EOF from 127.30.214.130:40091 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Aug 08 14:45:50 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.131@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:45:50 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.131@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:45:50.951081 12883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:50.946634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:43133 (local address 127.30.214.131:45559)
0808 14:45:50.946790 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:50.946801 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:50.946860 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:50.946990 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:50.946991 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:50.947160 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:50.947211 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:50.947212 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:50.947827 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:50.947828 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:50.948360 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:50.948361 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:50.948640 (+ 279us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:50.948641 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:50.948676 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:50.949129 (+ 453us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:50.949134 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:50.951008 (+ 1874us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.214.190:43133: Server oryx/127.30.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":72,"threads_started":1}
W20260808 14:45:50.951164 12881 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:45:50.946721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:45559 (local address 127.30.214.190:43133)
0808 14:45:50.946776 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:50.946778 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:50.946848 (+ 70us) server_negotiation.cc:407] Connection header received
0808 14:45:50.946921 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:50.946922 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:50.946934 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:50.946974 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:50.947263 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:50.947770 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:50.948420 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:50.948590 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:50.948634 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:50.951104 (+ 2470us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.214.131:45559: BlockingRecv error: recv got EOF from 127.30.214.131:45559 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
Aug 08 14:45:51 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.129@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:45:51 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.129@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:45:51.692993 12885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:51.687851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:43133 (local address 127.30.214.129:41059)
0808 14:45:51.688015 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:51.688028 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:51.688108 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:51.688411 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:51.688412 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:51.688588 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:51.688647 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:51.688649 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:51.689369 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:51.689369 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:51.689972 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:51.689974 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:51.690311 (+ 337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:51.690312 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:51.690349 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:51.690820 (+ 471us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:51.690826 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:51.692915 (+ 2089us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.214.190:43133: Server oryx/127.30.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":72,"threads_started":1}
W20260808 14:45:51.693130 12886 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:45:51.687951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.129:41059 (local address 127.30.214.190:43133)
0808 14:45:51.688200 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:51.688203 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:51.688223 (+ 20us) server_negotiation.cc:407] Connection header received
0808 14:45:51.688259 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:51.688260 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:51.688277 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:51.688397 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:51.688763 (+ 366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:51.689293 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:51.690055 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:51.690257 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:51.690307 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:51.693053 (+ 2746us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.214.129:41059: BlockingRecv error: recv got EOF from 127.30.214.129:41059 (error 108)
Metrics: {"server-negotiator.queue_time_us":205,"thread_start_us":84,"threads_started":1}
Aug 08 14:45:51 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.130@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:45:51 dist-test-slave-42z9 krb5kdc[11281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.214.130@KRBTEST.COM for oryx/127.30.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:45:51.831537 12887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:51.826581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:43133 (local address 127.30.214.130:32877)
0808 14:45:51.826735 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:51.826748 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:51.826820 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:51.826978 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:51.826979 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:51.827197 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:51.827260 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:51.827262 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:51.827950 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:51.827951 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:51.828533 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:51.828535 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:51.828941 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:51.828942 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:51.829011 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:51.829483 (+ 472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:51.829489 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:51.831455 (+ 1966us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.214.190:43133: Server oryx/127.30.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":90,"threads_started":1}
W20260808 14:45:51.831642 12886 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:45:51.826612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.130:32877 (local address 127.30.214.190:43133)
0808 14:45:51.826672 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:51.826674 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:51.826858 (+ 184us) server_negotiation.cc:407] Connection header received
0808 14:45:51.826885 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:51.826886 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:51.826897 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:51.826961 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:51.827319 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:51.827851 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:51.828643 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:51.828835 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:51.828910 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:51.831578 (+ 2668us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.214.130:32877: BlockingRecv error: recv got EOF from 127.30.214.130:32877 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 14:45:51.880990 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 12143
I20260808 14:45:51.891603 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 12388
I20260808 14:45:51.903275 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 12594
I20260808 14:45:51.912856 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 12040
2026-08-08T14:45:51Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (17601 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-08T14:45:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:45:51Z Disabled control of system clock
I20260808 14:45:51.945266 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200295877777-31578-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200295877777-31578-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200295877777-31578-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:35955
--webserver_interface=127.30.214.190
--webserver_port=0
--builtin_ntp_servers=127.30.214.148:39733
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.214.190:35955
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260808 14:45:52.028174 12895 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:45:52.028419 12895 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:45:52.028440 12895 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:45:52.029755 12895 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:45:52.029805 12895 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:45:52.029817 12895 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:45:52.029829 12895 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:45:52.029839 12895 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:45:52.031292 12895 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:39733
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200295877777-31578-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200295877777-31578-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.214.190:35955
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:35955
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12895
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200295877777-31578-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:45:52.031574 12895 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:45:52.031876 12895 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:45:52.037403 12904 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:52.037396 12895 server_base.cc:1034] running on GCE node
W20260808 14:45:52.037469 12902 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:52.037464 12906 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:52.038105 12895 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:45:52.038502 12895 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:45:52.039705 12895 hybrid_clock.cc:648] HybridClock initialized: now 1786200352039667 us; error 62 us; skew 500 ppm
I20260808 14:45:52.041359 12895 webserver.cc:460] Webserver started at http://127.30.214.190:33189/ using document root <none> and password file <none>
I20260808 14:45:52.041854 12895 fs_manager.cc:359] Metadata directory not provided
I20260808 14:45:52.041937 12895 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:45:52.042105 12895 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:45:52.043260 12895 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200295877777-31578-0/minicluster-data/master-0/data/instance:
uuid: "577f2440e17144919321f5f914d19c9f"
format_stamp: "Formatted at 2026-08-08 14:45:52 on dist-test-slave-42z9"
server_key: "6294c123df5b744b11bcef756f464da9"
server_key_iv: "b371668099c521fb967c4b8b2fe3af12"
server_key_version: "encryptionkey@0"
I20260808 14:45:52.043614 12895 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200295877777-31578-0/minicluster-data/master-0/wal/instance:
uuid: "577f2440e17144919321f5f914d19c9f"
format_stamp: "Formatted at 2026-08-08 14:45:52 on dist-test-slave-42z9"
server_key: "6294c123df5b744b11bcef756f464da9"
server_key_iv: "b371668099c521fb967c4b8b2fe3af12"
server_key_version: "encryptionkey@0"
I20260808 14:45:52.045035 12895 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 14:45:52.045794 12917 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:52.045957 12895 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:52.046047 12895 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200295877777-31578-0/minicluster-data/master-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200295877777-31578-0/minicluster-data/master-0/wal
uuid: "577f2440e17144919321f5f914d19c9f"
format_stamp: "Formatted at 2026-08-08 14:45:52 on dist-test-slave-42z9"
server_key: "6294c123df5b744b11bcef756f464da9"
server_key_iv: "b371668099c521fb967c4b8b2fe3af12"
server_key_version: "encryptionkey@0"
I20260808 14:45:52.046115 12895 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200295877777-31578-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200295877777-31578-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200295877777-31578-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:45:52.056036 12895 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:45:52.056377 12895 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:45:52.056509 12895 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:45:52.060561 12895 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.190:35955
I20260808 14:45:52.060602 12992 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.190:35955 every 8 connection(s)
I20260808 14:45:52.060966 12895 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
I20260808 14:45:52.061818 12993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:45:52.064579 12993 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 577f2440e17144919321f5f914d19c9f: Bootstrap starting.
I20260808 14:45:52.065244 12993 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 577f2440e17144919321f5f914d19c9f: Neither blocks nor log segments found. Creating new log.
I20260808 14:45:52.065584 12993 log.cc:824] T 00000000000000000000000000000000 P 577f2440e17144919321f5f914d19c9f: Log is configured to *not* fsync() on all Append() calls
I20260808 14:45:52.066301 12993 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 577f2440e17144919321f5f914d19c9f: No bootstrap required, opened a new log
I20260808 14:45:52.067929 12993 raft_consensus.cc:348] T 00000000000000000000000000000000 P 577f2440e17144919321f5f914d19c9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "577f2440e17144919321f5f914d19c9f" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 35955 } }
I20260808 14:45:52.068082 12993 raft_consensus.cc:374] T 00000000000000000000000000000000 P 577f2440e17144919321f5f914d19c9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:45:52.068116 12993 raft_consensus.cc:729] T 00000000000000000000000000000000 P 577f2440e17144919321f5f914d19c9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 577f2440e17144919321f5f914d19c9f, State: Initialized, Role: FOLLOWER
I20260808 14:45:52.068266 12993 consensus_queue.cc:260] T 00000000000000000000000000000000 P 577f2440e17144919321f5f914d19c9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "577f2440e17144919321f5f914d19c9f" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 35955 } }
I20260808 14:45:52.068329 12993 raft_consensus.cc:388] T 00000000000000000000000000000000 P 577f2440e17144919321f5f914d19c9f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:45:52.068351 12993 raft_consensus.cc:482] T 00000000000000000000000000000000 P 577f2440e17144919321f5f914d19c9f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:45:52.068397 12993 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 577f2440e17144919321f5f914d19c9f [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:52.068958 12993 raft_consensus.cc:504] T 00000000000000000000000000000000 P 577f2440e17144919321f5f914d19c9f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "577f2440e17144919321f5f914d19c9f" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 35955 } }
I20260808 14:45:52.069056 12993 leader_election.cc:302] T 00000000000000000000000000000000 P 577f2440e17144919321f5f914d19c9f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 577f2440e17144919321f5f914d19c9f; no voters:
I20260808 14:45:52.069231 12993 leader_election.cc:288] T 00000000000000000000000000000000 P 577f2440e17144919321f5f914d19c9f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:45:52.069281 12997 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 577f2440e17144919321f5f914d19c9f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:45:52.069501 12997 raft_consensus.cc:686] T 00000000000000000000000000000000 P 577f2440e17144919321f5f914d19c9f [term 1 LEADER]: Becoming Leader. State: Replica: 577f2440e17144919321f5f914d19c9f, State: Running, Role: LEADER
I20260808 14:45:52.069530 12993 sys_catalog.cc:564] T 00000000000000000000000000000000 P 577f2440e17144919321f5f914d19c9f [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:45:52.069617 12997 consensus_queue.cc:237] T 00000000000000000000000000000000 P 577f2440e17144919321f5f914d19c9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "577f2440e17144919321f5f914d19c9f" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 35955 } }
I20260808 14:45:52.070035 12998 sys_catalog.cc:455] T 00000000000000000000000000000000 P 577f2440e17144919321f5f914d19c9f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "577f2440e17144919321f5f914d19c9f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "577f2440e17144919321f5f914d19c9f" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 35955 } } }
I20260808 14:45:52.070132 12998 sys_catalog.cc:458] T 00000000000000000000000000000000 P 577f2440e17144919321f5f914d19c9f [sys.catalog]: This master's current role is: LEADER
I20260808 14:45:52.070158 12999 sys_catalog.cc:455] T 00000000000000000000000000000000 P 577f2440e17144919321f5f914d19c9f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 577f2440e17144919321f5f914d19c9f. Latest consensus state: current_term: 1 leader_uuid: "577f2440e17144919321f5f914d19c9f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "577f2440e17144919321f5f914d19c9f" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 35955 } } }
I20260808 14:45:52.070230 12999 sys_catalog.cc:458] T 00000000000000000000000000000000 P 577f2440e17144919321f5f914d19c9f [sys.catalog]: This master's current role is: LEADER
I20260808 14:45:52.070344 13010 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:45:52.070640 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 12895
I20260808 14:45:52.070719 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200295877777-31578-0/minicluster-data/master-0/wal/instance
I20260808 14:45:52.070915 31578 external_mini_cluster.cc:1428] Setting key 48beeb09f5715e613b96c55f456c6783
I20260808 14:45:52.071235 13010 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:45:52.076728 13026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:52.071408 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39374 (local address 127.30.214.190:35955)
0808 14:45:52.071627 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:52.071636 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:52.071671 (+ 35us) server_negotiation.cc:407] Connection header received
0808 14:45:52.071793 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:52.071800 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:52.071877 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:52.072030 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:52.072248 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:52.073600 (+ 1352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:52.074552 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:52.075231 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:52.075368 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:52.075984 (+ 616us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:52.075988 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:52.075989 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:45:52.076228 (+ 239us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:52.076272 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:45:52.076289 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:52.076359 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:52.076400 (+ 41us) server_negotiation.cc:299] Negotiation successful
0808 14:45:52.076490 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":90,"threads_started":1}
I20260808 14:45:52.080922 13010 catalog_manager.cc:1347] Generated new cluster ID: ace7f3a295cc4fcca5de408dfc9cf658
I20260808 14:45:52.081032 13010 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:45:52.097785 13010 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:45:52.098448 13010 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:45:52.103140 13010 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 577f2440e17144919321f5f914d19c9f: Generated new TSK 0
I20260808 14:45:52.103343 13010 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:45:52.114182 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.129:0
--local_ip_for_outbound_sockets=127.30.214.129
--webserver_interface=127.30.214.129
--webserver_port=0
--tserver_master_addrs=127.30.214.190:35955
--builtin_ntp_servers=127.30.214.148:39733
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260808 14:45:52.202883 13030 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:45:52.203126 13030 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:45:52.203150 13030 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:45:52.204305 13030 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:45:52.204342 13030 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:45:52.204366 13030 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.129
I20260808 14:45:52.205790 13030 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:39733
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.214.129
--webserver_port=0
--tserver_master_addrs=127.30.214.190:35955
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13030
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.129
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:45:52.206027 13030 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:45:52.206305 13030 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:45:52.211272 13038 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:52.211300 13037 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:52.211300 13042 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:52.211421 13030 server_base.cc:1034] running on GCE node
I20260808 14:45:52.211715 13030 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:45:52.211925 13030 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:45:52.213048 13030 hybrid_clock.cc:648] HybridClock initialized: now 1786200352212993 us; error 66 us; skew 500 ppm
I20260808 14:45:52.214315 13030 webserver.cc:460] Webserver started at http://127.30.214.129:40797/ using document root <none> and password file <none>
I20260808 14:45:52.214533 13030 fs_manager.cc:359] Metadata directory not provided
I20260808 14:45:52.214577 13030 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:45:52.214679 13030 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:45:52.215727 13030 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-0/data/instance:
uuid: "342d2f056ea4403bac88711861466822"
format_stamp: "Formatted at 2026-08-08 14:45:52 on dist-test-slave-42z9"
server_key: "9df7915eee9ffcc25118919cea15a61f"
server_key_iv: "3de7eb7c5b4b660b3bcbba0fc88b8282"
server_key_version: "encryptionkey@0"
I20260808 14:45:52.216053 13030 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-0/wal/instance:
uuid: "342d2f056ea4403bac88711861466822"
format_stamp: "Formatted at 2026-08-08 14:45:52 on dist-test-slave-42z9"
server_key: "9df7915eee9ffcc25118919cea15a61f"
server_key_iv: "3de7eb7c5b4b660b3bcbba0fc88b8282"
server_key_version: "encryptionkey@0"
I20260808 14:45:52.217283 13030 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 14:45:52.218169 13050 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:52.218312 13030 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:52.218400 13030 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-0/wal
uuid: "342d2f056ea4403bac88711861466822"
format_stamp: "Formatted at 2026-08-08 14:45:52 on dist-test-slave-42z9"
server_key: "9df7915eee9ffcc25118919cea15a61f"
server_key_iv: "3de7eb7c5b4b660b3bcbba0fc88b8282"
server_key_version: "encryptionkey@0"
I20260808 14:45:52.218472 13030 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:45:52.232467 13030 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:45:52.232807 13030 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:45:52.232940 13030 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:45:52.233174 13030 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:45:52.233556 13030 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:45:52.233596 13030 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:52.233626 13030 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:45:52.233649 13030 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:52.239424 13030 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.129:44535
I20260808 14:45:52.239470 13217 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.129:44535 every 8 connection(s)
I20260808 14:45:52.239811 13030 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
I20260808 14:45:52.240739 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 13030
I20260808 14:45:52.240824 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-0/wal/instance
I20260808 14:45:52.240990 31578 external_mini_cluster.cc:1428] Setting key b7ddbb74c4b5d6e87b32bbb6c03f8c35
I20260808 14:45:52.241961 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.130:0
--local_ip_for_outbound_sockets=127.30.214.130
--webserver_interface=127.30.214.130
--webserver_port=0
--tserver_master_addrs=127.30.214.190:35955
--builtin_ntp_servers=127.30.214.148:39733
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260808 14:45:52.245898 13026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:52.240525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.129:32951 (local address 127.30.214.190:35955)
0808 14:45:52.240599 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:52.240601 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:52.240837 (+ 236us) server_negotiation.cc:407] Connection header received
0808 14:45:52.241407 (+ 570us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:52.241408 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:52.241422 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:52.241544 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:52.242374 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:52.243057 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:52.244347 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:52.244549 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:52.244604 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:52.245566 (+ 962us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:52.245568 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:52.245568 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:45:52.245575 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:52.245590 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:45:52.245594 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:52.245639 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:52.245798 (+ 159us) server_negotiation.cc:299] Negotiation successful
0808 14:45:52.245833 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 14:45:52.246090 13221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:52.240507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:35955 (local address 127.30.214.129:32951)
0808 14:45:52.240702 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:52.240745 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:52.241306 (+ 561us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:52.241683 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:52.241688 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:52.241699 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:52.242275 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:52.242282 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:52.243150 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:52.243151 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:52.244256 (+ 1105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:52.244259 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:52.244635 (+ 376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:52.244636 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:52.244795 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:52.245382 (+ 587us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:45:52.245382 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:52.245423 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:45:52.245479 (+ 56us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:52.245649 (+ 170us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:52.245654 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:52.245658 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:45:52.245726 (+ 68us) client_negotiation.cc:240] Negotiation successful
0808 14:45:52.245843 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":85,"threads_started":1}
I20260808 14:45:52.246668 13218 heartbeater.cc:347] Connected to a master server at 127.30.214.190:35955
I20260808 14:45:52.246771 13218 heartbeater.cc:464] Registering TS with master...
I20260808 14:45:52.246964 13218 heartbeater.cc:511] Master 127.30.214.190:35955 requested a full tablet report, sending...
I20260808 14:45:52.247530 12940 ts_manager.cc:194] Registered new tserver with Master: 342d2f056ea4403bac88711861466822 (127.30.214.129:44535)
I20260808 14:45:52.248438 12940 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.30.214.129:32951
W20260808 14:45:52.325932 13223 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:45:52.326157 13223 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:45:52.326179 13223 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:45:52.327325 13223 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:45:52.327363 13223 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:45:52.327389 13223 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.130
I20260808 14:45:52.328733 13223 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:39733
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.214.130
--webserver_port=0
--tserver_master_addrs=127.30.214.190:35955
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13223
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.130
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:45:52.328941 13223 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:45:52.329210 13223 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:45:52.334199 13229 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:52.334195 13232 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:52.334197 13234 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:52.334407 13223 server_base.cc:1034] running on GCE node
I20260808 14:45:52.334748 13223 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:45:52.335023 13223 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:45:52.336185 13223 hybrid_clock.cc:648] HybridClock initialized: now 1786200352336170 us; error 30 us; skew 500 ppm
I20260808 14:45:52.337523 13223 webserver.cc:460] Webserver started at http://127.30.214.130:32803/ using document root <none> and password file <none>
I20260808 14:45:52.337764 13223 fs_manager.cc:359] Metadata directory not provided
I20260808 14:45:52.337826 13223 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:45:52.337978 13223 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:45:52.339067 13223 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-1/data/instance:
uuid: "55e6238a31414e4daab43d2f3cf3ba9e"
format_stamp: "Formatted at 2026-08-08 14:45:52 on dist-test-slave-42z9"
server_key: "3c0f06797dafd622e41b0bbe827b5e35"
server_key_iv: "cbb7864769b0a74a8950e5db3d327948"
server_key_version: "encryptionkey@0"
I20260808 14:45:52.339423 13223 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-1/wal/instance:
uuid: "55e6238a31414e4daab43d2f3cf3ba9e"
format_stamp: "Formatted at 2026-08-08 14:45:52 on dist-test-slave-42z9"
server_key: "3c0f06797dafd622e41b0bbe827b5e35"
server_key_iv: "cbb7864769b0a74a8950e5db3d327948"
server_key_version: "encryptionkey@0"
I20260808 14:45:52.340737 13223 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 14:45:52.341487 13242 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:52.341646 13223 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:45:52.341732 13223 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-1/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-1/wal
uuid: "55e6238a31414e4daab43d2f3cf3ba9e"
format_stamp: "Formatted at 2026-08-08 14:45:52 on dist-test-slave-42z9"
server_key: "3c0f06797dafd622e41b0bbe827b5e35"
server_key_iv: "cbb7864769b0a74a8950e5db3d327948"
server_key_version: "encryptionkey@0"
I20260808 14:45:52.341806 13223 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:45:52.349908 13223 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:45:52.350270 13223 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:45:52.350401 13223 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:45:52.350611 13223 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:45:52.350953 13223 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:45:52.350989 13223 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:52.351019 13223 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:45:52.351042 13223 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:52.356777 13223 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.130:33415
I20260808 14:45:52.356842 13428 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.130:33415 every 8 connection(s)
I20260808 14:45:52.357170 13223 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
I20260808 14:45:52.358253 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 13223
I20260808 14:45:52.358350 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-1/wal/instance
I20260808 14:45:52.358536 31578 external_mini_cluster.cc:1428] Setting key 16252c535785fc08ce312194a851741f
I20260808 14:45:52.359548 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.131:0
--local_ip_for_outbound_sockets=127.30.214.131
--webserver_interface=127.30.214.131
--webserver_port=0
--tserver_master_addrs=127.30.214.190:35955
--builtin_ntp_servers=127.30.214.148:39733
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260808 14:45:52.363265 13026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:52.357966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.130:44447 (local address 127.30.214.190:35955)
0808 14:45:52.358039 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:52.358041 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:52.358315 (+ 274us) server_negotiation.cc:407] Connection header received
0808 14:45:52.358982 (+ 667us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:52.358983 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:52.358994 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:52.359054 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:52.359955 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:52.360437 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:52.361761 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:52.362043 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:52.362119 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:52.363008 (+ 889us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:52.363010 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:52.363010 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:45:52.363015 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:52.363033 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:45:52.363038 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:52.363092 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:52.363153 (+ 61us) server_negotiation.cc:299] Negotiation successful
0808 14:45:52.363184 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 14:45:52.363453 13431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:52.357911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:35955 (local address 127.30.214.130:44447)
0808 14:45:52.358172 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:52.358223 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:52.358878 (+ 655us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:52.359124 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:52.359129 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:52.359140 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:52.359853 (+ 713us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:52.359861 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:52.360527 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:52.360528 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:52.361675 (+ 1147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:52.361678 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:52.362122 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:52.362122 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:52.362229 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:52.362840 (+ 611us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:45:52.362841 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:52.362873 (+ 32us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:45:52.362899 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:52.363103 (+ 204us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:52.363106 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:52.363108 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 14:45:52.363153 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 14:45:52.363243 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":85,"threads_started":1}
I20260808 14:45:52.363888 13429 heartbeater.cc:347] Connected to a master server at 127.30.214.190:35955
I20260808 14:45:52.363993 13429 heartbeater.cc:464] Registering TS with master...
I20260808 14:45:52.364177 13429 heartbeater.cc:511] Master 127.30.214.190:35955 requested a full tablet report, sending...
I20260808 14:45:52.364565 12940 ts_manager.cc:194] Registered new tserver with Master: 55e6238a31414e4daab43d2f3cf3ba9e (127.30.214.130:33415)
I20260808 14:45:52.365070 12940 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.30.214.130:44447
W20260808 14:45:52.443207 13432 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:45:52.443434 13432 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:45:52.443456 13432 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:45:52.444600 13432 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:45:52.444643 13432 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:45:52.444667 13432 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.131
I20260808 14:45:52.446139 13432 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:39733
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.214.131
--webserver_port=0
--tserver_master_addrs=127.30.214.190:35955
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13432
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.131
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:45:52.446362 13432 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:45:52.446653 13432 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:45:52.451565 13443 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:52.451573 13437 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:52.451591 13441 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:52.451691 13432 server_base.cc:1034] running on GCE node
I20260808 14:45:52.451896 13432 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:45:52.452121 13432 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:45:52.453263 13432 hybrid_clock.cc:648] HybridClock initialized: now 1786200352453248 us; error 39 us; skew 500 ppm
I20260808 14:45:52.454599 13432 webserver.cc:460] Webserver started at http://127.30.214.131:33821/ using document root <none> and password file <none>
I20260808 14:45:52.454846 13432 fs_manager.cc:359] Metadata directory not provided
I20260808 14:45:52.454892 13432 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:45:52.455030 13432 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:45:52.456156 13432 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-2/data/instance:
uuid: "444cf41d7c124b8d897f1bb7fd42f804"
format_stamp: "Formatted at 2026-08-08 14:45:52 on dist-test-slave-42z9"
server_key: "28ef0ef40e609204e3fd0b2269f542b5"
server_key_iv: "f961d790987aab289d95cbbd994b6487"
server_key_version: "encryptionkey@0"
I20260808 14:45:52.456480 13432 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-2/wal/instance:
uuid: "444cf41d7c124b8d897f1bb7fd42f804"
format_stamp: "Formatted at 2026-08-08 14:45:52 on dist-test-slave-42z9"
server_key: "28ef0ef40e609204e3fd0b2269f542b5"
server_key_iv: "f961d790987aab289d95cbbd994b6487"
server_key_version: "encryptionkey@0"
I20260808 14:45:52.457844 13432 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260808 14:45:52.458563 13453 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:52.458709 13432 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:45:52.458791 13432 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-2/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-2/wal
uuid: "444cf41d7c124b8d897f1bb7fd42f804"
format_stamp: "Formatted at 2026-08-08 14:45:52 on dist-test-slave-42z9"
server_key: "28ef0ef40e609204e3fd0b2269f542b5"
server_key_iv: "f961d790987aab289d95cbbd994b6487"
server_key_version: "encryptionkey@0"
I20260808 14:45:52.458866 13432 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:45:52.478545 13432 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:45:52.478845 13432 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:45:52.478951 13432 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:45:52.479132 13432 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:45:52.479472 13432 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:45:52.479507 13432 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:52.479538 13432 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:45:52.479562 13432 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:52.485208 13432 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.131:44677
I20260808 14:45:52.485288 13626 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.131:44677 every 8 connection(s)
I20260808 14:45:52.485630 13432 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
I20260808 14:45:52.486076 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 13432
I20260808 14:45:52.486162 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-2/wal/instance
I20260808 14:45:52.486317 31578 external_mini_cluster.cc:1428] Setting key 02c524de244ab82ec9d7210843df689f
I20260808 14:45:52.492027 13026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:52.486918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:49193 (local address 127.30.214.190:35955)
0808 14:45:52.487196 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:52.487198 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:52.487262 (+ 64us) server_negotiation.cc:407] Connection header received
0808 14:45:52.487813 (+ 551us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:52.487814 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:52.487824 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:52.487869 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:52.488523 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:52.489023 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:52.490548 (+ 1525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:52.490754 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:52.490821 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:52.491793 (+ 972us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:52.491795 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:52.491795 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:45:52.491799 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:52.491815 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:45:52.491819 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:52.491872 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:52.491931 (+ 59us) server_negotiation.cc:299] Negotiation successful
0808 14:45:52.491962 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":252}
I20260808 14:45:52.492249 13631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:52.486950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:35955 (local address 127.30.214.131:49193)
0808 14:45:52.487155 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:52.487191 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:52.487726 (+ 535us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:52.487925 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:52.487929 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:52.487937 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:52.488460 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:52.488464 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:52.489244 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:52.489246 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:52.490413 (+ 1167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:52.490418 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:52.490892 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:52.490894 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:52.491078 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:52.491642 (+ 564us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:45:52.491643 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:52.491675 (+ 32us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:45:52.491701 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:52.491876 (+ 175us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:52.491879 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:52.491881 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 14:45:52.491927 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 14:45:52.492035 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":99,"threads_started":1}
I20260808 14:45:52.492725 13627 heartbeater.cc:347] Connected to a master server at 127.30.214.190:35955
I20260808 14:45:52.492816 13627 heartbeater.cc:464] Registering TS with master...
I20260808 14:45:52.493007 13627 heartbeater.cc:511] Master 127.30.214.190:35955 requested a full tablet report, sending...
I20260808 14:45:52.493373 12940 ts_manager.cc:194] Registered new tserver with Master: 444cf41d7c124b8d897f1bb7fd42f804 (127.30.214.131:44677)
I20260808 14:45:52.493754 12940 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.30.214.131:49193
I20260808 14:45:52.498073 31578 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 14:45:52.499917 13026 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:45:52.499391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39388 (local address 127.30.214.190:35955)
0808 14:45:52.499446 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:52.499448 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:52.499573 (+ 125us) server_negotiation.cc:407] Connection header received
0808 14:45:52.499641 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:52.499642 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:52.499655 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:52.499706 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:52.499847 (+ 141us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39388: BlockingRecv error: recv got EOF from 127.0.0.1:39388 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 14:45:52.499979 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 13030
I20260808 14:45:52.520629 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 13223
I20260808 14:45:52.534955 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 13432
I20260808 14:45:52.549165 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 12895
2026-08-08T14:45:52Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (635 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-08T14:45:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:45:52Z Disabled control of system clock
I20260808 14:45:52.581795 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200295877777-31578-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200295877777-31578-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200295877777-31578-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:40593
--webserver_interface=127.30.214.190
--webserver_port=0
--builtin_ntp_servers=127.30.214.148:33895
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.214.190:40593
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 14:45:52.664108 13652 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:45:52.664340 13652 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:45:52.664361 13652 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:45:52.665606 13652 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:45:52.665648 13652 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:45:52.665659 13652 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:45:52.665681 13652 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:45:52.665704 13652 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:45:52.667176 13652 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:33895
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200295877777-31578-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200295877777-31578-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.214.190:40593
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:40593
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13652
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200295877777-31578-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:45:52.667532 13652 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:45:52.667858 13652 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:45:52.672741 13662 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:52.672739 13663 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:52.672770 13652 server_base.cc:1034] running on GCE node
W20260808 14:45:52.672734 13665 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:52.673166 13652 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:45:52.673460 13652 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:45:52.674600 13652 hybrid_clock.cc:648] HybridClock initialized: now 1786200352674585 us; error 33 us; skew 500 ppm
I20260808 14:45:52.675830 13652 webserver.cc:460] Webserver started at http://127.30.214.190:40061/ using document root <none> and password file <none>
I20260808 14:45:52.676054 13652 fs_manager.cc:359] Metadata directory not provided
I20260808 14:45:52.676102 13652 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:45:52.676231 13652 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:45:52.677309 13652 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200295877777-31578-0/minicluster-data/master-0/data/instance:
uuid: "68944349bc1b4b569ddc4e6c99d79780"
format_stamp: "Formatted at 2026-08-08 14:45:52 on dist-test-slave-42z9"
server_key: "183424542d66fbd866a7df0539c15750"
server_key_iv: "d3e66aeb44fccd444dd685286e0cf365"
server_key_version: "encryptionkey@0"
I20260808 14:45:52.677709 13652 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200295877777-31578-0/minicluster-data/master-0/wal/instance:
uuid: "68944349bc1b4b569ddc4e6c99d79780"
format_stamp: "Formatted at 2026-08-08 14:45:52 on dist-test-slave-42z9"
server_key: "183424542d66fbd866a7df0539c15750"
server_key_iv: "d3e66aeb44fccd444dd685286e0cf365"
server_key_version: "encryptionkey@0"
I20260808 14:45:52.678939 13652 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:45:52.679629 13680 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:52.679773 13652 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:45:52.679857 13652 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200295877777-31578-0/minicluster-data/master-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200295877777-31578-0/minicluster-data/master-0/wal
uuid: "68944349bc1b4b569ddc4e6c99d79780"
format_stamp: "Formatted at 2026-08-08 14:45:52 on dist-test-slave-42z9"
server_key: "183424542d66fbd866a7df0539c15750"
server_key_iv: "d3e66aeb44fccd444dd685286e0cf365"
server_key_version: "encryptionkey@0"
I20260808 14:45:52.679929 13652 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200295877777-31578-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200295877777-31578-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200295877777-31578-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:45:52.683341 13652 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:45:52.683626 13652 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:45:52.683744 13652 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:45:52.687574 13652 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.190:40593
I20260808 14:45:52.687602 13764 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.190:40593 every 8 connection(s)
I20260808 14:45:52.687914 13652 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
I20260808 14:45:52.688547 13765 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:45:52.691354 13765 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 68944349bc1b4b569ddc4e6c99d79780: Bootstrap starting.
I20260808 14:45:52.691947 13765 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 68944349bc1b4b569ddc4e6c99d79780: Neither blocks nor log segments found. Creating new log.
I20260808 14:45:52.692229 13765 log.cc:824] T 00000000000000000000000000000000 P 68944349bc1b4b569ddc4e6c99d79780: Log is configured to *not* fsync() on all Append() calls
I20260808 14:45:52.692879 13765 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 68944349bc1b4b569ddc4e6c99d79780: No bootstrap required, opened a new log
I20260808 14:45:52.694556 13765 raft_consensus.cc:348] T 00000000000000000000000000000000 P 68944349bc1b4b569ddc4e6c99d79780 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68944349bc1b4b569ddc4e6c99d79780" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 40593 } }
I20260808 14:45:52.694701 13765 raft_consensus.cc:374] T 00000000000000000000000000000000 P 68944349bc1b4b569ddc4e6c99d79780 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:45:52.694733 13765 raft_consensus.cc:729] T 00000000000000000000000000000000 P 68944349bc1b4b569ddc4e6c99d79780 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68944349bc1b4b569ddc4e6c99d79780, State: Initialized, Role: FOLLOWER
I20260808 14:45:52.694872 13765 consensus_queue.cc:260] T 00000000000000000000000000000000 P 68944349bc1b4b569ddc4e6c99d79780 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68944349bc1b4b569ddc4e6c99d79780" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 40593 } }
I20260808 14:45:52.694933 13765 raft_consensus.cc:388] T 00000000000000000000000000000000 P 68944349bc1b4b569ddc4e6c99d79780 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:45:52.694963 13765 raft_consensus.cc:482] T 00000000000000000000000000000000 P 68944349bc1b4b569ddc4e6c99d79780 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:45:52.695008 13765 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 68944349bc1b4b569ddc4e6c99d79780 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:52.695569 13765 raft_consensus.cc:504] T 00000000000000000000000000000000 P 68944349bc1b4b569ddc4e6c99d79780 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68944349bc1b4b569ddc4e6c99d79780" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 40593 } }
I20260808 14:45:52.695667 13765 leader_election.cc:302] T 00000000000000000000000000000000 P 68944349bc1b4b569ddc4e6c99d79780 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 68944349bc1b4b569ddc4e6c99d79780; no voters:
I20260808 14:45:52.695823 13765 leader_election.cc:288] T 00000000000000000000000000000000 P 68944349bc1b4b569ddc4e6c99d79780 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:45:52.695888 13769 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 68944349bc1b4b569ddc4e6c99d79780 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:45:52.696051 13769 raft_consensus.cc:686] T 00000000000000000000000000000000 P 68944349bc1b4b569ddc4e6c99d79780 [term 1 LEADER]: Becoming Leader. State: Replica: 68944349bc1b4b569ddc4e6c99d79780, State: Running, Role: LEADER
I20260808 14:45:52.696074 13765 sys_catalog.cc:564] T 00000000000000000000000000000000 P 68944349bc1b4b569ddc4e6c99d79780 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:45:52.696216 13769 consensus_queue.cc:237] T 00000000000000000000000000000000 P 68944349bc1b4b569ddc4e6c99d79780 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68944349bc1b4b569ddc4e6c99d79780" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 40593 } }
I20260808 14:45:52.696484 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 13652
I20260808 14:45:52.696586 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200295877777-31578-0/minicluster-data/master-0/wal/instance
I20260808 14:45:52.696653 13770 sys_catalog.cc:455] T 00000000000000000000000000000000 P 68944349bc1b4b569ddc4e6c99d79780 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "68944349bc1b4b569ddc4e6c99d79780" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68944349bc1b4b569ddc4e6c99d79780" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 40593 } } }
I20260808 14:45:52.696760 13770 sys_catalog.cc:458] T 00000000000000000000000000000000 P 68944349bc1b4b569ddc4e6c99d79780 [sys.catalog]: This master's current role is: LEADER
I20260808 14:45:52.696784 31578 external_mini_cluster.cc:1428] Setting key 321e0e7e074cd1f24c8df52f13eb7d7a
I20260808 14:45:52.696954 13774 sys_catalog.cc:455] T 00000000000000000000000000000000 P 68944349bc1b4b569ddc4e6c99d79780 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 68944349bc1b4b569ddc4e6c99d79780. Latest consensus state: current_term: 1 leader_uuid: "68944349bc1b4b569ddc4e6c99d79780" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68944349bc1b4b569ddc4e6c99d79780" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 40593 } } }
I20260808 14:45:52.697026 13774 sys_catalog.cc:458] T 00000000000000000000000000000000 P 68944349bc1b4b569ddc4e6c99d79780 [sys.catalog]: This master's current role is: LEADER
W20260808 14:45:52.698536 13797 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 68944349bc1b4b569ddc4e6c99d79780: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:45:52.698601 13797 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:45:52.698655 13777 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:45:52.698870 13777 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:45:52.699313 13788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:52.697587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46502 (local address 127.30.214.190:40593)
0808 14:45:52.697789 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:52.697798 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:52.697835 (+ 37us) server_negotiation.cc:407] Connection header received
0808 14:45:52.697959 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:52.697966 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:52.698023 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:52.698169 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:52.698839 (+ 670us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:52.698842 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:52.698842 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:45:52.698847 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:52.698894 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:45:52.698909 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:52.699006 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:52.699082 (+ 76us) server_negotiation.cc:299] Negotiation successful
0808 14:45:52.699139 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":79,"threads_started":1}
I20260808 14:45:52.700608 13777 catalog_manager.cc:1347] Generated new cluster ID: 1951fd624d714207bdbd172f8ab56963
I20260808 14:45:52.700666 13777 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:45:52.725849 13777 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:45:52.726059 13777 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:45:52.738565 13777 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 68944349bc1b4b569ddc4e6c99d79780: Generated new TSK 0
I20260808 14:45:52.738826 13777 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:45:52.748064 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.129:0
--local_ip_for_outbound_sockets=127.30.214.129
--webserver_interface=127.30.214.129
--webserver_port=0
--tserver_master_addrs=127.30.214.190:40593
--builtin_ntp_servers=127.30.214.148:33895
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 14:45:52.834033 13802 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:45:52.834246 13802 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:45:52.834272 13802 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:45:52.835496 13802 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:45:52.835543 13802 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:45:52.835569 13802 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.129
I20260808 14:45:52.836948 13802 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:33895
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.214.129
--webserver_port=0
--tserver_master_addrs=127.30.214.190:40593
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13802
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.129
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:45:52.837216 13802 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:45:52.837545 13802 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:45:52.842561 13815 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:52.842568 13811 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:52.842675 13810 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:52.842778 13802 server_base.cc:1034] running on GCE node
I20260808 14:45:52.842989 13802 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:45:52.843240 13802 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:45:52.844399 13802 hybrid_clock.cc:648] HybridClock initialized: now 1786200352844385 us; error 30 us; skew 500 ppm
I20260808 14:45:52.845674 13802 webserver.cc:460] Webserver started at http://127.30.214.129:33897/ using document root <none> and password file <none>
I20260808 14:45:52.845870 13802 fs_manager.cc:359] Metadata directory not provided
I20260808 14:45:52.845912 13802 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:45:52.846006 13802 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:45:52.847038 13802 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-0/data/instance:
uuid: "e1e2040fd565431e8874b5f817c7b362"
format_stamp: "Formatted at 2026-08-08 14:45:52 on dist-test-slave-42z9"
server_key: "9029e6a3ad0d9f2244588bacc0b9e6ac"
server_key_iv: "24d0f540f108ff2052795b20e0f95610"
server_key_version: "encryptionkey@0"
I20260808 14:45:52.847332 13802 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-0/wal/instance:
uuid: "e1e2040fd565431e8874b5f817c7b362"
format_stamp: "Formatted at 2026-08-08 14:45:52 on dist-test-slave-42z9"
server_key: "9029e6a3ad0d9f2244588bacc0b9e6ac"
server_key_iv: "24d0f540f108ff2052795b20e0f95610"
server_key_version: "encryptionkey@0"
I20260808 14:45:52.848515 13802 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:45:52.849151 13823 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:52.849313 13802 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:45:52.849403 13802 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-0/wal
uuid: "e1e2040fd565431e8874b5f817c7b362"
format_stamp: "Formatted at 2026-08-08 14:45:52 on dist-test-slave-42z9"
server_key: "9029e6a3ad0d9f2244588bacc0b9e6ac"
server_key_iv: "24d0f540f108ff2052795b20e0f95610"
server_key_version: "encryptionkey@0"
I20260808 14:45:52.849493 13802 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:45:52.852926 13802 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:45:52.853168 13802 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:45:52.853264 13802 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:45:52.853466 13802 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:45:52.853776 13802 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:45:52.853808 13802 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:52.853828 13802 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:45:52.853844 13802 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:52.859189 13802 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.129:40991
I20260808 14:45:52.859262 13997 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.129:40991 every 8 connection(s)
I20260808 14:45:52.859539 13802 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
I20260808 14:45:52.862476 13788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:52.860258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.129:33101 (local address 127.30.214.190:40593)
0808 14:45:52.860318 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:52.860319 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:52.860560 (+ 241us) server_negotiation.cc:407] Connection header received
0808 14:45:52.861044 (+ 484us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:52.861045 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:52.861054 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:52.861108 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:52.862236 (+ 1128us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:52.862237 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:52.862238 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:45:52.862242 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:52.862260 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:45:52.862264 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:52.862317 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:52.862386 (+ 69us) server_negotiation.cc:299] Negotiation successful
0808 14:45:52.862404 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 14:45:52.862671 14002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:52.860229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:40593 (local address 127.30.214.129:33101)
0808 14:45:52.860439 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:52.860473 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:52.860945 (+ 472us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:52.861187 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:52.861190 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:52.861198 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:52.862091 (+ 893us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:45:52.862092 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:52.862122 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:45:52.862150 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:52.862318 (+ 168us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:52.862323 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:52.862326 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:45:52.862406 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 14:45:52.862471 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":92,"threads_started":1}
I20260808 14:45:52.863164 14000 heartbeater.cc:347] Connected to a master server at 127.30.214.190:40593
I20260808 14:45:52.863263 14000 heartbeater.cc:464] Registering TS with master...
I20260808 14:45:52.863415 14000 heartbeater.cc:511] Master 127.30.214.190:40593 requested a full tablet report, sending...
I20260808 14:45:52.863729 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 13802
I20260808 14:45:52.863824 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-0/wal/instance
I20260808 14:45:52.864010 31578 external_mini_cluster.cc:1428] Setting key ba03cc898727b5086e72a186ea93cc86
I20260808 14:45:52.864012 13711 ts_manager.cc:194] Registered new tserver with Master: e1e2040fd565431e8874b5f817c7b362 (127.30.214.129:40991)
I20260808 14:45:52.864897 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.130:0
--local_ip_for_outbound_sockets=127.30.214.130
--webserver_interface=127.30.214.130
--webserver_port=0
--tserver_master_addrs=127.30.214.190:40593
--builtin_ntp_servers=127.30.214.148:33895
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 14:45:52.949028 14004 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:45:52.949254 14004 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:45:52.949277 14004 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:45:52.950519 14004 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:45:52.950574 14004 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:45:52.950605 14004 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.130
I20260808 14:45:52.952104 14004 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:33895
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.214.130
--webserver_port=0
--tserver_master_addrs=127.30.214.190:40593
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14004
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.130
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:45:52.952363 14004 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:45:52.952682 14004 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:45:52.957620 14014 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:52.957612 14018 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:52.957614 14013 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:52.957901 14004 server_base.cc:1034] running on GCE node
I20260808 14:45:52.958124 14004 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:45:52.958392 14004 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:45:52.959570 14004 hybrid_clock.cc:648] HybridClock initialized: now 1786200352959558 us; error 32 us; skew 500 ppm
I20260808 14:45:52.960871 14004 webserver.cc:460] Webserver started at http://127.30.214.130:32977/ using document root <none> and password file <none>
I20260808 14:45:52.961098 14004 fs_manager.cc:359] Metadata directory not provided
I20260808 14:45:52.961146 14004 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:45:52.961282 14004 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:45:52.962405 14004 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-1/data/instance:
uuid: "ec5ba220a8294fa692ec179d66a52c3b"
format_stamp: "Formatted at 2026-08-08 14:45:52 on dist-test-slave-42z9"
server_key: "2cf85dafd9ad068840a949ec49818d28"
server_key_iv: "e67fe217b555c8d08dabf75127a4f552"
server_key_version: "encryptionkey@0"
I20260808 14:45:52.962751 14004 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-1/wal/instance:
uuid: "ec5ba220a8294fa692ec179d66a52c3b"
format_stamp: "Formatted at 2026-08-08 14:45:52 on dist-test-slave-42z9"
server_key: "2cf85dafd9ad068840a949ec49818d28"
server_key_iv: "e67fe217b555c8d08dabf75127a4f552"
server_key_version: "encryptionkey@0"
I20260808 14:45:52.964012 14004 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:45:52.964695 14031 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:52.964864 14004 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:45:52.964948 14004 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-1/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-1/wal
uuid: "ec5ba220a8294fa692ec179d66a52c3b"
format_stamp: "Formatted at 2026-08-08 14:45:52 on dist-test-slave-42z9"
server_key: "2cf85dafd9ad068840a949ec49818d28"
server_key_iv: "e67fe217b555c8d08dabf75127a4f552"
server_key_version: "encryptionkey@0"
I20260808 14:45:52.965021 14004 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:45:52.968447 14004 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:45:52.968727 14004 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:45:52.968849 14004 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:45:52.969039 14004 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:45:52.969350 14004 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:45:52.969383 14004 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:52.969410 14004 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:45:52.969434 14004 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:52.975118 14004 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.130:36239
I20260808 14:45:52.975169 14209 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.130:36239 every 8 connection(s)
I20260808 14:45:52.975495 14004 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
I20260808 14:45:52.978500 13788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:52.976236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.130:32933 (local address 127.30.214.190:40593)
0808 14:45:52.976290 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:52.976293 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:52.976534 (+ 241us) server_negotiation.cc:407] Connection header received
0808 14:45:52.977021 (+ 487us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:52.977022 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:52.977028 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:52.977069 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:52.978305 (+ 1236us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:52.978307 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:52.978307 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:45:52.978311 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:52.978329 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:45:52.978333 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:52.978383 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:52.978433 (+ 50us) server_negotiation.cc:299] Negotiation successful
0808 14:45:52.978445 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 14:45:52.978700 14213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:52.976223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:40593 (local address 127.30.214.130:32933)
0808 14:45:52.976415 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:52.976450 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:52.976924 (+ 474us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:52.977125 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:52.977128 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:52.977136 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:52.978144 (+ 1008us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:45:52.978145 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:52.978175 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:45:52.978206 (+ 31us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:52.978381 (+ 175us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:52.978384 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:52.978386 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 14:45:52.978436 (+ 50us) client_negotiation.cc:240] Negotiation successful
0808 14:45:52.978485 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":87,"threads_started":1}
I20260808 14:45:52.979151 14210 heartbeater.cc:347] Connected to a master server at 127.30.214.190:40593
I20260808 14:45:52.979243 14210 heartbeater.cc:464] Registering TS with master...
I20260808 14:45:52.979410 14210 heartbeater.cc:511] Master 127.30.214.190:40593 requested a full tablet report, sending...
I20260808 14:45:52.979763 13711 ts_manager.cc:194] Registered new tserver with Master: ec5ba220a8294fa692ec179d66a52c3b (127.30.214.130:36239)
I20260808 14:45:52.980578 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 14004
I20260808 14:45:52.980683 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-1/wal/instance
I20260808 14:45:52.980857 31578 external_mini_cluster.cc:1428] Setting key 06d27785f3872ca26a8363c663aba702
I20260808 14:45:52.981703 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.131:0
--local_ip_for_outbound_sockets=127.30.214.131
--webserver_interface=127.30.214.131
--webserver_port=0
--tserver_master_addrs=127.30.214.190:40593
--builtin_ntp_servers=127.30.214.148:33895
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 14:45:53.064862 14216 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:45:53.065088 14216 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:45:53.065112 14216 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:45:53.066448 14216 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:45:53.066506 14216 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:45:53.066547 14216 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.131
I20260808 14:45:53.068147 14216 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:33895
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.214.131
--webserver_port=0
--tserver_master_addrs=127.30.214.190:40593
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14216
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.131
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:45:53.068409 14216 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:45:53.068722 14216 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:45:53.073764 14228 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:53.073764 14224 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:53.073770 14225 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:53.073953 14216 server_base.cc:1034] running on GCE node
I20260808 14:45:53.074159 14216 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:45:53.074363 14216 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:45:53.075506 14216 hybrid_clock.cc:648] HybridClock initialized: now 1786200353075490 us; error 31 us; skew 500 ppm
I20260808 14:45:53.076749 14216 webserver.cc:460] Webserver started at http://127.30.214.131:44511/ using document root <none> and password file <none>
I20260808 14:45:53.076984 14216 fs_manager.cc:359] Metadata directory not provided
I20260808 14:45:53.077034 14216 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:45:53.077169 14216 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:45:53.078266 14216 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-2/data/instance:
uuid: "53636172bf2c4078827d08d1130e538e"
format_stamp: "Formatted at 2026-08-08 14:45:53 on dist-test-slave-42z9"
server_key: "d7bc29e87927a3843cb5298684c6dace"
server_key_iv: "1427814885d5e304f351f1df8fc1b7ce"
server_key_version: "encryptionkey@0"
I20260808 14:45:53.078599 14216 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-2/wal/instance:
uuid: "53636172bf2c4078827d08d1130e538e"
format_stamp: "Formatted at 2026-08-08 14:45:53 on dist-test-slave-42z9"
server_key: "d7bc29e87927a3843cb5298684c6dace"
server_key_iv: "1427814885d5e304f351f1df8fc1b7ce"
server_key_version: "encryptionkey@0"
I20260808 14:45:53.079854 14216 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 14:45:53.080524 14238 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:53.080696 14216 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:45:53.080780 14216 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-2/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-2/wal
uuid: "53636172bf2c4078827d08d1130e538e"
format_stamp: "Formatted at 2026-08-08 14:45:53 on dist-test-slave-42z9"
server_key: "d7bc29e87927a3843cb5298684c6dace"
server_key_iv: "1427814885d5e304f351f1df8fc1b7ce"
server_key_version: "encryptionkey@0"
I20260808 14:45:53.080842 14216 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:45:53.084347 14216 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:45:53.084620 14216 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:45:53.084740 14216 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:45:53.084921 14216 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:45:53.085216 14216 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:45:53.085248 14216 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:53.085275 14216 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:45:53.085299 14216 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:53.091089 14216 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.131:38953
I20260808 14:45:53.091140 14406 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.131:38953 every 8 connection(s)
I20260808 14:45:53.091449 14216 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
I20260808 14:45:53.094369 13788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:53.092137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:48177 (local address 127.30.214.190:40593)
0808 14:45:53.092192 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:53.092193 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:53.092416 (+ 223us) server_negotiation.cc:407] Connection header received
0808 14:45:53.092912 (+ 496us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:53.092913 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:53.092921 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:53.092973 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:53.094126 (+ 1153us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:53.094128 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:53.094128 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:45:53.094132 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:53.094148 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:45:53.094153 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:53.094206 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:53.094282 (+ 76us) server_negotiation.cc:299] Negotiation successful
0808 14:45:53.094297 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 14:45:53.094547 14414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:53.092115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:40593 (local address 127.30.214.131:48177)
0808 14:45:53.092306 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:53.092339 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:53.092814 (+ 475us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:53.093042 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:53.093047 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:53.093057 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:53.093976 (+ 919us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:45:53.093977 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:53.094005 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:45:53.094034 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:53.094210 (+ 176us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:53.094216 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:53.094219 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:45:53.094288 (+ 69us) client_negotiation.cc:240] Negotiation successful
0808 14:45:53.094352 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":88,"threads_started":1}
I20260808 14:45:53.095014 14407 heartbeater.cc:347] Connected to a master server at 127.30.214.190:40593
I20260808 14:45:53.095113 14407 heartbeater.cc:464] Registering TS with master...
I20260808 14:45:53.095264 14407 heartbeater.cc:511] Master 127.30.214.190:40593 requested a full tablet report, sending...
I20260808 14:45:53.095624 13711 ts_manager.cc:194] Registered new tserver with Master: 53636172bf2c4078827d08d1130e538e (127.30.214.131:38953)
I20260808 14:45:53.097167 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 14216
I20260808 14:45:53.097247 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786200295877777-31578-0/minicluster-data/ts-2/wal/instance
I20260808 14:45:53.097473 31578 external_mini_cluster.cc:1428] Setting key fd9603c2530d89ae169f03acaeecf0e4
I20260808 14:45:53.098255 31578 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 14:45:53.100108 13788 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:45:53.099666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46512 (local address 127.30.214.190:40593)
0808 14:45:53.099710 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:53.099712 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:53.099817 (+ 105us) server_negotiation.cc:407] Connection header received
0808 14:45:53.099863 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:53.099864 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:53.099869 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:53.099913 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:53.100040 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46512: BlockingRecv error: recv got EOF from 127.0.0.1:46512 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 14:45:53.100152 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 13802
I20260808 14:45:53.127475 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 14004
I20260808 14:45:53.139096 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 14216
I20260808 14:45:53.150820 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 13652
2026-08-08T14:45:53Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (602 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:45:53 dist-test-slave-42z9 krb5kdc[14424](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:45:53 dist-test-slave-42z9 krb5kdc[14424](info): set up 2 sockets
Aug 08 14:45:53 dist-test-slave-42z9 krb5kdc[14424](info): commencing operation
krb5kdc: starting...
W20260808 14:45:54.287562 31578 mini_kdc.cc:121] Time spent starting KDC: real 1.112s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Aug 08 14:45:54 dist-test-slave-42z9 krb5kdc[14424](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200354, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:45:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:45:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.214.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab.
Entry for principal kudu/127.30.214.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab.
I20260808 14:45:54.408363 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:43287
--webserver_interface=127.30.214.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab
--principal=kudu/127.30.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:39559
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.214.190:43287
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:45:54.490808 14447 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:45:54.491027 14447 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:45:54.491067 14447 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:45:54.492223 14447 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:45:54.492265 14447 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:45:54.492283 14447 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:45:54.492300 14447 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:45:54.492314 14447 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:45:54.493834 14447 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:39559
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.214.190:43287
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab
--principal=kudu/127.30.214.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:43287
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14447
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:45:54.494102 14447 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:45:54.494321 14447 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:45:54.499094 14455 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:54.499140 14447 server_base.cc:1034] running on GCE node
W20260808 14:45:54.499114 14454 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:54.499114 14460 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:54.499576 14447 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:45:54.499861 14447 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:45:54.501032 14447 hybrid_clock.cc:648] HybridClock initialized: now 1786200354501016 us; error 30 us; skew 500 ppm
Aug 08 14:45:54 dist-test-slave-42z9 krb5kdc[14424](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200354, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:45:54.503379 14447 init.cc:377] Logged in from keytab as kudu/127.30.214.190@KRBTEST.COM (short username kudu)
I20260808 14:45:54.503829 14447 webserver.cc:460] Webserver started at http://127.30.214.190:39069/ using document root <none> and password file <none>
I20260808 14:45:54.504040 14447 fs_manager.cc:359] Metadata directory not provided
I20260808 14:45:54.504088 14447 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:45:54.504217 14447 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:45:54.505285 14447 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/minicluster-data/master-0/data/instance:
uuid: "38aa04195c1b4f36a848fbc6edfb597d"
format_stamp: "Formatted at 2026-08-08 14:45:54 on dist-test-slave-42z9"
server_key: "fe8d20c660a459981081fa22bf18c1d0"
server_key_iv: "0f570a5e5b8df9e5271c530949e925bc"
server_key_version: "encryptionkey@0"
I20260808 14:45:54.505650 14447 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/minicluster-data/master-0/wal/instance:
uuid: "38aa04195c1b4f36a848fbc6edfb597d"
format_stamp: "Formatted at 2026-08-08 14:45:54 on dist-test-slave-42z9"
server_key: "fe8d20c660a459981081fa22bf18c1d0"
server_key_iv: "0f570a5e5b8df9e5271c530949e925bc"
server_key_version: "encryptionkey@0"
I20260808 14:45:54.506910 14447 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:45:54.507565 14471 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:54.507709 14447 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:45:54.507792 14447 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/minicluster-data/master-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/minicluster-data/master-0/wal
uuid: "38aa04195c1b4f36a848fbc6edfb597d"
format_stamp: "Formatted at 2026-08-08 14:45:54 on dist-test-slave-42z9"
server_key: "fe8d20c660a459981081fa22bf18c1d0"
server_key_iv: "0f570a5e5b8df9e5271c530949e925bc"
server_key_version: "encryptionkey@0"
I20260808 14:45:54.507853 14447 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:45:54.521415 14447 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:45:54.523353 14447 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:45:54.523499 14447 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:45:54.527456 14447 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.190:43287
I20260808 14:45:54.527565 14545 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.190:43287 every 8 connection(s)
I20260808 14:45:54.527853 14447 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
I20260808 14:45:54.528846 14546 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:45:54.531183 14546 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 38aa04195c1b4f36a848fbc6edfb597d: Bootstrap starting.
I20260808 14:45:54.531809 14546 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 38aa04195c1b4f36a848fbc6edfb597d: Neither blocks nor log segments found. Creating new log.
I20260808 14:45:54.532085 14546 log.cc:824] T 00000000000000000000000000000000 P 38aa04195c1b4f36a848fbc6edfb597d: Log is configured to *not* fsync() on all Append() calls
I20260808 14:45:54.532785 14546 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 38aa04195c1b4f36a848fbc6edfb597d: No bootstrap required, opened a new log
I20260808 14:45:54.533977 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 14447
I20260808 14:45:54.534073 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/minicluster-data/master-0/wal/instance
I20260808 14:45:54.534241 31578 external_mini_cluster.cc:1428] Setting key d4a70aec4a8e73b23aabd0089532ebfa
I20260808 14:45:54.534679 14546 raft_consensus.cc:348] T 00000000000000000000000000000000 P 38aa04195c1b4f36a848fbc6edfb597d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38aa04195c1b4f36a848fbc6edfb597d" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 43287 } }
I20260808 14:45:54.534873 14546 raft_consensus.cc:374] T 00000000000000000000000000000000 P 38aa04195c1b4f36a848fbc6edfb597d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:45:54.534953 14546 raft_consensus.cc:729] T 00000000000000000000000000000000 P 38aa04195c1b4f36a848fbc6edfb597d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38aa04195c1b4f36a848fbc6edfb597d, State: Initialized, Role: FOLLOWER
I20260808 14:45:54.535095 14546 consensus_queue.cc:260] T 00000000000000000000000000000000 P 38aa04195c1b4f36a848fbc6edfb597d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38aa04195c1b4f36a848fbc6edfb597d" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 43287 } }
I20260808 14:45:54.535174 14546 raft_consensus.cc:388] T 00000000000000000000000000000000 P 38aa04195c1b4f36a848fbc6edfb597d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:45:54.535207 14546 raft_consensus.cc:482] T 00000000000000000000000000000000 P 38aa04195c1b4f36a848fbc6edfb597d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:45:54.535254 14546 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 38aa04195c1b4f36a848fbc6edfb597d [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:54.536130 14546 raft_consensus.cc:504] T 00000000000000000000000000000000 P 38aa04195c1b4f36a848fbc6edfb597d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38aa04195c1b4f36a848fbc6edfb597d" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 43287 } }
I20260808 14:45:54.536237 14546 leader_election.cc:302] T 00000000000000000000000000000000 P 38aa04195c1b4f36a848fbc6edfb597d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 38aa04195c1b4f36a848fbc6edfb597d; no voters:
I20260808 14:45:54.536399 14546 leader_election.cc:288] T 00000000000000000000000000000000 P 38aa04195c1b4f36a848fbc6edfb597d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:45:54.536443 14557 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 38aa04195c1b4f36a848fbc6edfb597d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:45:54.536592 14557 raft_consensus.cc:686] T 00000000000000000000000000000000 P 38aa04195c1b4f36a848fbc6edfb597d [term 1 LEADER]: Becoming Leader. State: Replica: 38aa04195c1b4f36a848fbc6edfb597d, State: Running, Role: LEADER
I20260808 14:45:54.536670 14546 sys_catalog.cc:564] T 00000000000000000000000000000000 P 38aa04195c1b4f36a848fbc6edfb597d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:45:54.536782 14557 consensus_queue.cc:237] T 00000000000000000000000000000000 P 38aa04195c1b4f36a848fbc6edfb597d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38aa04195c1b4f36a848fbc6edfb597d" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 43287 } }
I20260808 14:45:54.537546 14560 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38aa04195c1b4f36a848fbc6edfb597d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 38aa04195c1b4f36a848fbc6edfb597d. Latest consensus state: current_term: 1 leader_uuid: "38aa04195c1b4f36a848fbc6edfb597d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38aa04195c1b4f36a848fbc6edfb597d" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 43287 } } }
I20260808 14:45:54.537623 14560 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38aa04195c1b4f36a848fbc6edfb597d [sys.catalog]: This master's current role is: LEADER
I20260808 14:45:54.537791 14561 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38aa04195c1b4f36a848fbc6edfb597d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "38aa04195c1b4f36a848fbc6edfb597d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38aa04195c1b4f36a848fbc6edfb597d" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 43287 } } }
I20260808 14:45:54.537936 14561 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38aa04195c1b4f36a848fbc6edfb597d [sys.catalog]: This master's current role is: LEADER
I20260808 14:45:54.538067 14574 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:45:54.538797 14574 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:45:54.540577 14574 catalog_manager.cc:1347] Generated new cluster ID: 2ecacf24775544fdaacd9221fbec15fa
I20260808 14:45:54.540634 14574 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 14:45:54 dist-test-slave-42z9 krb5kdc[14424](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200354, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:45:54.545336 14555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:54.534809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37954 (local address 127.30.214.190:43287)
0808 14:45:54.535002 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:54.535012 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:54.535045 (+ 33us) server_negotiation.cc:407] Connection header received
0808 14:45:54.535155 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:54.535161 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:54.535208 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:54.535351 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:54.535962 (+ 611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:54.537191 (+ 1229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:54.538251 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:54.538840 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:54.538955 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:54.541633 (+ 2678us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:54.541637 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:54.541638 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:54.541649 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:54.543492 (+ 1843us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:54.543842 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:54.543845 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:54.543845 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:54.543977 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:54.544145 (+ 168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:54.544146 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:54.544146 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:54.544422 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:54.544564 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:54.544980 (+ 416us) server_negotiation.cc:299] Negotiation successful
0808 14:45:54.545119 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":84,"threads_started":1}
I20260808 14:45:54.555950 14574 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:45:54.556483 14574 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:45:54.559928 14574 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 38aa04195c1b4f36a848fbc6edfb597d: Generated new TSK 0
I20260808 14:45:54.560102 14574 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.214.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab.
Entry for principal kudu/127.30.214.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab.
I20260808 14:45:54.592549 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.129:0
--local_ip_for_outbound_sockets=127.30.214.129
--webserver_interface=127.30.214.129
--webserver_port=0
--tserver_master_addrs=127.30.214.190:43287
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab
--principal=kudu/127.30.214.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:39559
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:45:54.674657 14588 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:45:54.674870 14588 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:45:54.674903 14588 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:45:54.676067 14588 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:45:54.676110 14588 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:45:54.676136 14588 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.129
I20260808 14:45:54.677659 14588 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:39559
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab
--principal=kudu/127.30.214.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.214.129
--webserver_port=0
--tserver_master_addrs=127.30.214.190:43287
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14588
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.129
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:45:54.677855 14588 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:45:54.678051 14588 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:45:54.682919 14599 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:54.682914 14602 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:54.682964 14588 server_base.cc:1034] running on GCE node
W20260808 14:45:54.682930 14598 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:54.683369 14588 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:45:54.683601 14588 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:45:54.684747 14588 hybrid_clock.cc:648] HybridClock initialized: now 1786200354684733 us; error 29 us; skew 500 ppm
Aug 08 14:45:54 dist-test-slave-42z9 krb5kdc[14424](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200354, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:45:54.687207 14588 init.cc:377] Logged in from keytab as kudu/127.30.214.129@KRBTEST.COM (short username kudu)
I20260808 14:45:54.687685 14588 webserver.cc:460] Webserver started at http://127.30.214.129:44665/ using document root <none> and password file <none>
I20260808 14:45:54.687898 14588 fs_manager.cc:359] Metadata directory not provided
I20260808 14:45:54.687937 14588 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:45:54.688043 14588 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:45:54.689069 14588 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/minicluster-data/ts-0/data/instance:
uuid: "d31b5bc8328340c9a537831a79acb414"
format_stamp: "Formatted at 2026-08-08 14:45:54 on dist-test-slave-42z9"
server_key: "46041f72c7f4311d1733056bcac737a4"
server_key_iv: "4a84ebf8e39c24e108f0535bcbeb84f3"
server_key_version: "encryptionkey@0"
I20260808 14:45:54.689376 14588 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/minicluster-data/ts-0/wal/instance:
uuid: "d31b5bc8328340c9a537831a79acb414"
format_stamp: "Formatted at 2026-08-08 14:45:54 on dist-test-slave-42z9"
server_key: "46041f72c7f4311d1733056bcac737a4"
server_key_iv: "4a84ebf8e39c24e108f0535bcbeb84f3"
server_key_version: "encryptionkey@0"
I20260808 14:45:54.690742 14588 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:45:54.691486 14609 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:54.691661 14588 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:45:54.691741 14588 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/minicluster-data/ts-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/minicluster-data/ts-0/wal
uuid: "d31b5bc8328340c9a537831a79acb414"
format_stamp: "Formatted at 2026-08-08 14:45:54 on dist-test-slave-42z9"
server_key: "46041f72c7f4311d1733056bcac737a4"
server_key_iv: "4a84ebf8e39c24e108f0535bcbeb84f3"
server_key_version: "encryptionkey@0"
I20260808 14:45:54.691802 14588 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:45:54.705777 14588 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:45:54.707697 14588 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:45:54.707846 14588 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:45:54.708065 14588 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:45:54.708344 14588 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:45:54.708382 14588 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:54.708408 14588 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:45:54.708423 14588 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:54.714141 14588 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.129:46769
I20260808 14:45:54.714217 14785 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.129:46769 every 8 connection(s)
I20260808 14:45:54.714537 14588 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
I20260808 14:45:54.718050 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 14588
I20260808 14:45:54.718135 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/minicluster-data/ts-0/wal/instance
I20260808 14:45:54.718297 31578 external_mini_cluster.cc:1428] Setting key 6c2e3558edde1b373d192f41e0ed1d8e
Aug 08 14:45:54 dist-test-slave-42z9 krb5kdc[14424](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200354, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.129@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:45:54.724362 14555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:54.715284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.129:37379 (local address 127.30.214.190:43287)
0808 14:45:54.715334 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:54.715337 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:54.715556 (+ 219us) server_negotiation.cc:407] Connection header received
0808 14:45:54.716098 (+ 542us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:54.716100 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:54.716116 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:54.716170 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:54.717161 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:54.717720 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:54.718968 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:54.719209 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:54.719284 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:54.721577 (+ 2293us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:54.721578 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:54.721578 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:54.721586 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:54.722933 (+ 1347us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:54.723396 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:54.723397 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:54.723398 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:54.723456 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:54.723703 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:54.723704 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:54.723704 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:54.723824 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:54.723883 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:54.724169 (+ 286us) server_negotiation.cc:299] Negotiation successful
0808 14:45:54.724269 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 14:45:54.724541 14790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:54.715244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:43287 (local address 127.30.214.129:37379)
0808 14:45:54.715426 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:54.715466 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:54.715990 (+ 524us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:54.716246 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:54.716250 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:54.716840 (+ 590us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:54.717055 (+ 215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:54.717060 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:54.717814 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:54.717815 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:54.718893 (+ 1078us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:54.718897 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:54.719307 (+ 410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:54.719308 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:54.719445 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:54.719983 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:54.719992 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:54.721479 (+ 1487us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:54.723016 (+ 1537us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:54.723029 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:54.723031 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:54.723320 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:54.723521 (+ 201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:54.723522 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:54.723522 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:54.723644 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:54.723882 (+ 238us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:54.723890 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:54.724044 (+ 154us) client_negotiation.cc:769] Sending connection context
0808 14:45:54.724137 (+ 93us) client_negotiation.cc:240] Negotiation successful
0808 14:45:54.724311 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":92,"threads_started":1}
I20260808 14:45:54.725081 14788 heartbeater.cc:347] Connected to a master server at 127.30.214.190:43287
I20260808 14:45:54.725175 14788 heartbeater.cc:464] Registering TS with master...
I20260808 14:45:54.725360 14788 heartbeater.cc:511] Master 127.30.214.190:43287 requested a full tablet report, sending...
I20260808 14:45:54.725975 14496 ts_manager.cc:194] Registered new tserver with Master: d31b5bc8328340c9a537831a79acb414 (127.30.214.129:46769)
I20260808 14:45:54.726600 14496 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.214.129@KRBTEST.COM'} at 127.30.214.129:37379
WARNING: no policy specified for kudu/127.30.214.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab.
Entry for principal kudu/127.30.214.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab.
I20260808 14:45:54.746461 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.130:0
--local_ip_for_outbound_sockets=127.30.214.130
--webserver_interface=127.30.214.130
--webserver_port=0
--tserver_master_addrs=127.30.214.190:43287
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab
--principal=kudu/127.30.214.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:39559
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:45:54.829941 14797 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:45:54.830173 14797 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:45:54.830209 14797 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:45:54.831439 14797 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:45:54.831490 14797 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:45:54.831526 14797 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.130
I20260808 14:45:54.833092 14797 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:39559
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab
--principal=kudu/127.30.214.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.214.130
--webserver_port=0
--tserver_master_addrs=127.30.214.190:43287
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14797
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.130
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:45:54.833351 14797 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:45:54.833621 14797 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:45:54.839145 14808 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:54.839145 14804 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:54.839362 14806 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:54.839321 14797 server_base.cc:1034] running on GCE node
I20260808 14:45:54.839723 14797 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:45:54.840011 14797 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:45:54.841183 14797 hybrid_clock.cc:648] HybridClock initialized: now 1786200354841169 us; error 30 us; skew 500 ppm
Aug 08 14:45:54 dist-test-slave-42z9 krb5kdc[14424](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200354, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:45:54.844055 14797 init.cc:377] Logged in from keytab as kudu/127.30.214.130@KRBTEST.COM (short username kudu)
I20260808 14:45:54.844578 14797 webserver.cc:460] Webserver started at http://127.30.214.130:43071/ using document root <none> and password file <none>
I20260808 14:45:54.844817 14797 fs_manager.cc:359] Metadata directory not provided
I20260808 14:45:54.844867 14797 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:45:54.845008 14797 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:45:54.846129 14797 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/minicluster-data/ts-1/data/instance:
uuid: "7ea8f731673b44219ee8c081f70994b3"
format_stamp: "Formatted at 2026-08-08 14:45:54 on dist-test-slave-42z9"
server_key: "bc32c20cecd94c3bd9c695ad8ce9359a"
server_key_iv: "a6c0def088562af08e73114ace7ef0e0"
server_key_version: "encryptionkey@0"
I20260808 14:45:54.846460 14797 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/minicluster-data/ts-1/wal/instance:
uuid: "7ea8f731673b44219ee8c081f70994b3"
format_stamp: "Formatted at 2026-08-08 14:45:54 on dist-test-slave-42z9"
server_key: "bc32c20cecd94c3bd9c695ad8ce9359a"
server_key_iv: "a6c0def088562af08e73114ace7ef0e0"
server_key_version: "encryptionkey@0"
I20260808 14:45:54.847728 14797 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260808 14:45:54.848413 14823 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:54.848567 14797 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:54.848652 14797 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/minicluster-data/ts-1/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/minicluster-data/ts-1/wal
uuid: "7ea8f731673b44219ee8c081f70994b3"
format_stamp: "Formatted at 2026-08-08 14:45:54 on dist-test-slave-42z9"
server_key: "bc32c20cecd94c3bd9c695ad8ce9359a"
server_key_iv: "a6c0def088562af08e73114ace7ef0e0"
server_key_version: "encryptionkey@0"
I20260808 14:45:54.848716 14797 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:45:54.861593 14797 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:45:54.863523 14797 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:45:54.863670 14797 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:45:54.863893 14797 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:45:54.864213 14797 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:45:54.864248 14797 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:54.864279 14797 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:45:54.864295 14797 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:54.870277 14797 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.130:39097
I20260808 14:45:54.870324 14990 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.130:39097 every 8 connection(s)
I20260808 14:45:54.870644 14797 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
I20260808 14:45:54.872716 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 14797
I20260808 14:45:54.872809 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/minicluster-data/ts-1/wal/instance
I20260808 14:45:54.872982 31578 external_mini_cluster.cc:1428] Setting key 9618e826c6f36611f3ecbf87a6c31fb0
Aug 08 14:45:54 dist-test-slave-42z9 krb5kdc[14424](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200354, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.130@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:45:54.881639 14555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:54.871403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.130:52629 (local address 127.30.214.190:43287)
0808 14:45:54.871459 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:54.871461 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:54.871644 (+ 183us) server_negotiation.cc:407] Connection header received
0808 14:45:54.872140 (+ 496us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:54.872141 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:54.872151 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:54.872210 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:54.873265 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:54.873943 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:54.875547 (+ 1604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:54.875799 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:54.875875 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:54.878760 (+ 2885us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:54.878762 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:54.878762 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:54.878772 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:54.880096 (+ 1324us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:54.880620 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:54.880620 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:54.880621 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:54.880670 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:54.880940 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:54.880940 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:54.880941 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:54.881050 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:54.881097 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:54.881471 (+ 374us) server_negotiation.cc:299] Negotiation successful
0808 14:45:54.881568 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 14:45:54.881927 14994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:54.871357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:43287 (local address 127.30.214.130:52629)
0808 14:45:54.871516 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:54.871563 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:54.872059 (+ 496us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:54.872268 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:54.872271 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:54.872897 (+ 626us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:54.873150 (+ 253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:54.873157 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:54.874154 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:54.874156 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:54.875399 (+ 1243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:54.875405 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:54.875900 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:54.875901 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:54.876071 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:54.876759 (+ 688us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:54.876771 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:54.878625 (+ 1854us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:54.880194 (+ 1569us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:54.880206 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:54.880209 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:54.880543 (+ 334us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:54.880728 (+ 185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:54.880729 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:54.880730 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:54.880880 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:54.881106 (+ 226us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:54.881112 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:54.881306 (+ 194us) client_negotiation.cc:769] Sending connection context
0808 14:45:54.881434 (+ 128us) client_negotiation.cc:240] Negotiation successful
0808 14:45:54.881671 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":84,"threads_started":1}
WARNING: no policy specified for kudu/127.30.214.131@KRBTEST.COM; defaulting to no policy
I20260808 14:45:54.882624 14992 heartbeater.cc:347] Connected to a master server at 127.30.214.190:43287
I20260808 14:45:54.882732 14992 heartbeater.cc:464] Registering TS with master...
I20260808 14:45:54.882900 14992 heartbeater.cc:511] Master 127.30.214.190:43287 requested a full tablet report, sending...
I20260808 14:45:54.883256 14496 ts_manager.cc:194] Registered new tserver with Master: 7ea8f731673b44219ee8c081f70994b3 (127.30.214.130:39097)
I20260808 14:45:54.883646 14496 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.214.130@KRBTEST.COM'} at 127.30.214.130:52629
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab.
Entry for principal kudu/127.30.214.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab.
I20260808 14:45:54.900914 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.131:0
--local_ip_for_outbound_sockets=127.30.214.131
--webserver_interface=127.30.214.131
--webserver_port=0
--tserver_master_addrs=127.30.214.190:43287
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab
--principal=kudu/127.30.214.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:39559
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:45:54.984176 15003 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:45:54.984457 15003 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:45:54.984495 15003 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:45:54.985821 15003 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:45:54.985872 15003 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:45:54.985911 15003 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.131
I20260808 14:45:54.987573 15003 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:39559
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab
--principal=kudu/127.30.214.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.214.131
--webserver_port=0
--tserver_master_addrs=127.30.214.190:43287
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15003
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.131
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:45:54.987845 15003 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:45:54.988076 15003 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:45:54.993145 15010 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:54.993156 15011 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:45:54.993145 15015 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:45:54.993410 15003 server_base.cc:1034] running on GCE node
I20260808 14:45:54.993639 15003 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:45:54.993904 15003 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:45:54.995041 15003 hybrid_clock.cc:648] HybridClock initialized: now 1786200354995023 us; error 34 us; skew 500 ppm
Aug 08 14:45:54 dist-test-slave-42z9 krb5kdc[14424](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200354, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:45:54.997619 15003 init.cc:377] Logged in from keytab as kudu/127.30.214.131@KRBTEST.COM (short username kudu)
I20260808 14:45:54.998066 15003 webserver.cc:460] Webserver started at http://127.30.214.131:45039/ using document root <none> and password file <none>
I20260808 14:45:54.998296 15003 fs_manager.cc:359] Metadata directory not provided
I20260808 14:45:54.998345 15003 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:45:54.998481 15003 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:45:54.999539 15003 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/minicluster-data/ts-2/data/instance:
uuid: "a21f5c9558df4cc39e628263632936d9"
format_stamp: "Formatted at 2026-08-08 14:45:54 on dist-test-slave-42z9"
server_key: "e789f01be594550878174f534e3dcad5"
server_key_iv: "28995b81a320c627dde9b1f22cfda6a4"
server_key_version: "encryptionkey@0"
I20260808 14:45:54.999877 15003 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/minicluster-data/ts-2/wal/instance:
uuid: "a21f5c9558df4cc39e628263632936d9"
format_stamp: "Formatted at 2026-08-08 14:45:54 on dist-test-slave-42z9"
server_key: "e789f01be594550878174f534e3dcad5"
server_key_iv: "28995b81a320c627dde9b1f22cfda6a4"
server_key_version: "encryptionkey@0"
I20260808 14:45:55.001397 15003 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 14:45:55.002292 15029 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:55.002449 15003 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 14:45:55.002537 15003 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/minicluster-data/ts-2/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/minicluster-data/ts-2/wal
uuid: "a21f5c9558df4cc39e628263632936d9"
format_stamp: "Formatted at 2026-08-08 14:45:54 on dist-test-slave-42z9"
server_key: "e789f01be594550878174f534e3dcad5"
server_key_iv: "28995b81a320c627dde9b1f22cfda6a4"
server_key_version: "encryptionkey@0"
I20260808 14:45:55.002609 15003 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:45:55.017004 15003 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:45:55.019006 15003 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:45:55.019146 15003 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:45:55.019379 15003 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:45:55.019706 15003 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:45:55.019740 15003 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:55.019770 15003 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:45:55.019793 15003 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:45:55.025619 15003 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.131:38005
I20260808 14:45:55.025673 15199 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.131:38005 every 8 connection(s)
I20260808 14:45:55.025996 15003 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
I20260808 14:45:55.027273 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 15003
I20260808 14:45:55.027364 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/minicluster-data/ts-2/wal/instance
I20260808 14:45:55.027523 31578 external_mini_cluster.cc:1428] Setting key cda3da31cfbe7f22523d65796417e0ff
Aug 08 14:45:55 dist-test-slave-42z9 krb5kdc[14424](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200354, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.131@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:45:55.036149 14555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:55.026717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:46869 (local address 127.30.214.190:43287)
0808 14:45:55.026770 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:55.026772 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:55.026960 (+ 188us) server_negotiation.cc:407] Connection header received
0808 14:45:55.027528 (+ 568us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:55.027529 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:55.027542 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:55.027587 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:55.028715 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:55.029301 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:55.030532 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:55.030730 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:55.030790 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:55.033322 (+ 2532us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:55.033324 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:55.033324 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:55.033332 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:55.034898 (+ 1566us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:55.035379 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:55.035380 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:55.035380 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:55.035430 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:55.035632 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:55.035633 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:55.035633 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:55.035735 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:55.035780 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:55.036004 (+ 224us) server_negotiation.cc:299] Negotiation successful
0808 14:45:55.036080 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 14:45:55.036347 15205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:55.026682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:43287 (local address 127.30.214.131:46869)
0808 14:45:55.026832 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:55.026870 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:55.027383 (+ 513us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:55.027662 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:55.027667 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:55.028368 (+ 701us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:45:55.028628 (+ 260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:55.028634 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:55.029401 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:55.029402 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:55.030442 (+ 1040us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:55.030446 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:55.030802 (+ 356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:55.030802 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:55.030905 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:55.031458 (+ 553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:45:55.031467 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:45:55.033196 (+ 1729us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:45:55.034991 (+ 1795us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:55.034998 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:55.035000 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:55.035320 (+ 320us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:55.035484 (+ 164us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:45:55.035485 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:45:55.035485 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:45:55.035590 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:45:55.035777 (+ 187us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:45:55.035780 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:45:55.035901 (+ 121us) client_negotiation.cc:769] Sending connection context
0808 14:45:55.035983 (+ 82us) client_negotiation.cc:240] Negotiation successful
0808 14:45:55.036123 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":76,"threads_started":1}
I20260808 14:45:55.036911 15201 heartbeater.cc:347] Connected to a master server at 127.30.214.190:43287
I20260808 14:45:55.037022 15201 heartbeater.cc:464] Registering TS with master...
I20260808 14:45:55.037211 15201 heartbeater.cc:511] Master 127.30.214.190:43287 requested a full tablet report, sending...
I20260808 14:45:55.037621 14496 ts_manager.cc:194] Registered new tserver with Master: a21f5c9558df4cc39e628263632936d9 (127.30.214.131:38005)
I20260808 14:45:55.038026 14496 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.214.131@KRBTEST.COM'} at 127.30.214.131:46869
I20260808 14:45:55.039121 31578 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:45:55.046378 14555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:55.040403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37970 (local address 127.30.214.190:43287)
0808 14:45:55.040449 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:55.040451 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:55.040553 (+ 102us) server_negotiation.cc:407] Connection header received
0808 14:45:55.040604 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:55.040604 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:55.040613 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:55.040656 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:45:55.041154 (+ 498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:55.041684 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:55.042693 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:55.042894 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:55.042964 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:55.044200 (+ 1236us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:45:55.044202 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:45:55.044202 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:45:55.044209 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:45:55.045436 (+ 1227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:55.045779 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:55.045780 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:55.045780 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:55.045830 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:45:55.045953 (+ 123us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:45:55.045953 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:45:55.045954 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:45:55.046098 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:45:55.046168 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:55.046249 (+ 81us) server_negotiation.cc:299] Negotiation successful
0808 14:45:55.046311 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 14:45:55.047802 14496 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37970:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:45:55.049342 14496 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:45:55.055629 15221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:55.051539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.129:46769 (local address 127.0.0.1:56310)
0808 14:45:55.052128 (+ 589us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:55.052138 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:55.052184 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:55.052442 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:55.052442 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:55.052444 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:45:55.052482 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:55.052484 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:55.053374 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:55.053375 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:55.054375 (+ 1000us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:55.054378 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:55.055285 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:55.055286 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:55.055384 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:55.055399 (+ 15us) client_negotiation.cc:769] Sending connection context
0808 14:45:55.055477 (+ 78us) client_negotiation.cc:240] Negotiation successful
0808 14:45:55.055528 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":555,"mutex_wait_us":1,"thread_start_us":51,"threads_started":1}
I20260808 14:45:55.055636 15222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:55.051666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56310 (local address 127.30.214.129:46769)
0808 14:45:55.051847 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:55.051852 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:55.052240 (+ 388us) server_negotiation.cc:407] Connection header received
0808 14:45:55.052284 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:55.052286 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:55.052301 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:55.052367 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:45:55.052552 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:55.053269 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:55.054446 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:55.055192 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:55.055277 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:55.055341 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:55.055502 (+ 161us) server_negotiation.cc:299] Negotiation successful
0808 14:45:55.055547 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":83,"threads_started":1}
I20260808 14:45:55.055708 15218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:55.051470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38126 (local address 127.30.214.130:39097)
0808 14:45:55.051880 (+ 410us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:55.051884 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:55.051892 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:45:55.051925 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:55.051926 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:55.051939 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:55.052007 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:45:55.052183 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:55.053084 (+ 901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:55.054561 (+ 1477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:55.055228 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:55.055288 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:55.055341 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:55.055590 (+ 249us) server_negotiation.cc:299] Negotiation successful
0808 14:45:55.055634 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":373,"thread_start_us":108,"threads_started":1}
I20260808 14:45:55.056155 15216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:55.051327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.130:39097 (local address 127.0.0.1:38126)
0808 14:45:55.051660 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:55.051700 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:55.051758 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:55.052019 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:55.052022 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:55.052025 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:45:55.052102 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:55.052104 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:55.053179 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:55.053180 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:55.054464 (+ 1284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:55.054468 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:55.055377 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:55.055378 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:55.055439 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:55.055442 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:45:55.055487 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 14:45:55.055534 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":302,"thread_start_us":78,"threads_started":1}
I20260808 14:45:55.056773 15214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:55.051327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.131:38005 (local address 127.0.0.1:45558)
0808 14:45:55.051660 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:55.051699 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:55.051756 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:55.053628 (+ 1872us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:55.053629 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:55.053631 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:45:55.053679 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:55.053681 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:55.054791 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:55.054792 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:55.055643 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:55.055645 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:55.056538 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:55.056539 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:55.056602 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:55.056606 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:45:55.056661 (+ 55us) client_negotiation.cc:240] Negotiation successful
0808 14:45:55.056702 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":316,"mutex_wait_us":5,"thread_start_us":64,"threads_started":1}
I20260808 14:45:55.056816 15219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:55.051464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45558 (local address 127.30.214.131:38005)
0808 14:45:55.053472 (+ 2008us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:55.053477 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:55.053487 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:45:55.053524 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:55.053526 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:55.053542 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:55.053619 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:45:55.053742 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:55.054704 (+ 962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:55.055739 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:55.056455 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:55.056535 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:55.056592 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:55.056685 (+ 93us) server_negotiation.cc:299] Negotiation successful
0808 14:45:55.056738 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1944,"thread_start_us":113,"threads_started":1}
I20260808 14:45:55.057062 14899 tablet_service.cc:1467] Processing CreateTablet for tablet 9d03ba94e04e45d68b5f71809692247d (DEFAULT_TABLE table=test-table [id=3f01d7d3fe6446bea04abb5304fb2188]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:45:55.057065 14687 tablet_service.cc:1467] Processing CreateTablet for tablet 9d03ba94e04e45d68b5f71809692247d (DEFAULT_TABLE table=test-table [id=3f01d7d3fe6446bea04abb5304fb2188]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:45:55.057469 14899 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d03ba94e04e45d68b5f71809692247d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:45:55.057478 14687 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d03ba94e04e45d68b5f71809692247d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:45:55.057736 15103 tablet_service.cc:1467] Processing CreateTablet for tablet 9d03ba94e04e45d68b5f71809692247d (DEFAULT_TABLE table=test-table [id=3f01d7d3fe6446bea04abb5304fb2188]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:45:55.058027 15103 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d03ba94e04e45d68b5f71809692247d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:45:55.060170 15223 tablet_bootstrap.cc:492] T 9d03ba94e04e45d68b5f71809692247d P 7ea8f731673b44219ee8c081f70994b3: Bootstrap starting.
I20260808 14:45:55.060972 15223 tablet_bootstrap.cc:654] T 9d03ba94e04e45d68b5f71809692247d P 7ea8f731673b44219ee8c081f70994b3: Neither blocks nor log segments found. Creating new log.
I20260808 14:45:55.061390 15225 tablet_bootstrap.cc:492] T 9d03ba94e04e45d68b5f71809692247d P d31b5bc8328340c9a537831a79acb414: Bootstrap starting.
I20260808 14:45:55.061466 15224 tablet_bootstrap.cc:492] T 9d03ba94e04e45d68b5f71809692247d P a21f5c9558df4cc39e628263632936d9: Bootstrap starting.
I20260808 14:45:55.061609 15223 log.cc:824] T 9d03ba94e04e45d68b5f71809692247d P 7ea8f731673b44219ee8c081f70994b3: Log is configured to *not* fsync() on all Append() calls
I20260808 14:45:55.062093 15225 tablet_bootstrap.cc:654] T 9d03ba94e04e45d68b5f71809692247d P d31b5bc8328340c9a537831a79acb414: Neither blocks nor log segments found. Creating new log.
I20260808 14:45:55.062125 15224 tablet_bootstrap.cc:654] T 9d03ba94e04e45d68b5f71809692247d P a21f5c9558df4cc39e628263632936d9: Neither blocks nor log segments found. Creating new log.
I20260808 14:45:55.062455 15223 tablet_bootstrap.cc:492] T 9d03ba94e04e45d68b5f71809692247d P 7ea8f731673b44219ee8c081f70994b3: No bootstrap required, opened a new log
I20260808 14:45:55.062530 15223 ts_tablet_manager.cc:1397] T 9d03ba94e04e45d68b5f71809692247d P 7ea8f731673b44219ee8c081f70994b3: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:45:55.062615 15224 log.cc:824] T 9d03ba94e04e45d68b5f71809692247d P a21f5c9558df4cc39e628263632936d9: Log is configured to *not* fsync() on all Append() calls
I20260808 14:45:55.062633 15225 log.cc:824] T 9d03ba94e04e45d68b5f71809692247d P d31b5bc8328340c9a537831a79acb414: Log is configured to *not* fsync() on all Append() calls
I20260808 14:45:55.063249 15224 tablet_bootstrap.cc:492] T 9d03ba94e04e45d68b5f71809692247d P a21f5c9558df4cc39e628263632936d9: No bootstrap required, opened a new log
I20260808 14:45:55.063309 15224 ts_tablet_manager.cc:1397] T 9d03ba94e04e45d68b5f71809692247d P a21f5c9558df4cc39e628263632936d9: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:45:55.063359 15225 tablet_bootstrap.cc:492] T 9d03ba94e04e45d68b5f71809692247d P d31b5bc8328340c9a537831a79acb414: No bootstrap required, opened a new log
I20260808 14:45:55.063424 15225 ts_tablet_manager.cc:1397] T 9d03ba94e04e45d68b5f71809692247d P d31b5bc8328340c9a537831a79acb414: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:45:55.064535 15223 raft_consensus.cc:348] T 9d03ba94e04e45d68b5f71809692247d P 7ea8f731673b44219ee8c081f70994b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a21f5c9558df4cc39e628263632936d9" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 38005 } } peers { permanent_uuid: "7ea8f731673b44219ee8c081f70994b3" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 39097 } } peers { permanent_uuid: "d31b5bc8328340c9a537831a79acb414" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 46769 } }
I20260808 14:45:55.064702 15223 raft_consensus.cc:374] T 9d03ba94e04e45d68b5f71809692247d P 7ea8f731673b44219ee8c081f70994b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:45:55.064735 15223 raft_consensus.cc:729] T 9d03ba94e04e45d68b5f71809692247d P 7ea8f731673b44219ee8c081f70994b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ea8f731673b44219ee8c081f70994b3, State: Initialized, Role: FOLLOWER
I20260808 14:45:55.064673 15224 raft_consensus.cc:348] T 9d03ba94e04e45d68b5f71809692247d P a21f5c9558df4cc39e628263632936d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a21f5c9558df4cc39e628263632936d9" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 38005 } } peers { permanent_uuid: "7ea8f731673b44219ee8c081f70994b3" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 39097 } } peers { permanent_uuid: "d31b5bc8328340c9a537831a79acb414" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 46769 } }
I20260808 14:45:55.064783 15224 raft_consensus.cc:374] T 9d03ba94e04e45d68b5f71809692247d P a21f5c9558df4cc39e628263632936d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:45:55.064802 15224 raft_consensus.cc:729] T 9d03ba94e04e45d68b5f71809692247d P a21f5c9558df4cc39e628263632936d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a21f5c9558df4cc39e628263632936d9, State: Initialized, Role: FOLLOWER
I20260808 14:45:55.064850 15223 consensus_queue.cc:260] T 9d03ba94e04e45d68b5f71809692247d P 7ea8f731673b44219ee8c081f70994b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a21f5c9558df4cc39e628263632936d9" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 38005 } } peers { permanent_uuid: "7ea8f731673b44219ee8c081f70994b3" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 39097 } } peers { permanent_uuid: "d31b5bc8328340c9a537831a79acb414" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 46769 } }
I20260808 14:45:55.064918 15224 consensus_queue.cc:260] T 9d03ba94e04e45d68b5f71809692247d P a21f5c9558df4cc39e628263632936d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a21f5c9558df4cc39e628263632936d9" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 38005 } } peers { permanent_uuid: "7ea8f731673b44219ee8c081f70994b3" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 39097 } } peers { permanent_uuid: "d31b5bc8328340c9a537831a79acb414" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 46769 } }
I20260808 14:45:55.065145 15223 ts_tablet_manager.cc:1428] T 9d03ba94e04e45d68b5f71809692247d P 7ea8f731673b44219ee8c081f70994b3: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260808 14:45:55.065166 15224 ts_tablet_manager.cc:1428] T 9d03ba94e04e45d68b5f71809692247d P a21f5c9558df4cc39e628263632936d9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:45:55.065178 14992 heartbeater.cc:503] Master 127.30.214.190:43287 was elected leader, sending a full tablet report...
I20260808 14:45:55.065265 15201 heartbeater.cc:503] Master 127.30.214.190:43287 was elected leader, sending a full tablet report...
I20260808 14:45:55.065308 15225 raft_consensus.cc:348] T 9d03ba94e04e45d68b5f71809692247d P d31b5bc8328340c9a537831a79acb414 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a21f5c9558df4cc39e628263632936d9" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 38005 } } peers { permanent_uuid: "7ea8f731673b44219ee8c081f70994b3" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 39097 } } peers { permanent_uuid: "d31b5bc8328340c9a537831a79acb414" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 46769 } }
I20260808 14:45:55.065485 15225 raft_consensus.cc:374] T 9d03ba94e04e45d68b5f71809692247d P d31b5bc8328340c9a537831a79acb414 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:45:55.065528 15225 raft_consensus.cc:729] T 9d03ba94e04e45d68b5f71809692247d P d31b5bc8328340c9a537831a79acb414 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d31b5bc8328340c9a537831a79acb414, State: Initialized, Role: FOLLOWER
I20260808 14:45:55.065627 15225 consensus_queue.cc:260] T 9d03ba94e04e45d68b5f71809692247d P d31b5bc8328340c9a537831a79acb414 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a21f5c9558df4cc39e628263632936d9" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 38005 } } peers { permanent_uuid: "7ea8f731673b44219ee8c081f70994b3" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 39097 } } peers { permanent_uuid: "d31b5bc8328340c9a537831a79acb414" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 46769 } }
I20260808 14:45:55.065884 15225 ts_tablet_manager.cc:1428] T 9d03ba94e04e45d68b5f71809692247d P d31b5bc8328340c9a537831a79acb414: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260808 14:45:55.065914 14788 heartbeater.cc:503] Master 127.30.214.190:43287 was elected leader, sending a full tablet report...
W20260808 14:45:55.121212 14993 tablet.cc:2369] T 9d03ba94e04e45d68b5f71809692247d P 7ea8f731673b44219ee8c081f70994b3: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:45:55.215320 14789 tablet.cc:2369] T 9d03ba94e04e45d68b5f71809692247d P d31b5bc8328340c9a537831a79acb414: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:45:55.256655 15235 raft_consensus.cc:482] T 9d03ba94e04e45d68b5f71809692247d P d31b5bc8328340c9a537831a79acb414 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:45:55.256803 15235 raft_consensus.cc:504] T 9d03ba94e04e45d68b5f71809692247d P d31b5bc8328340c9a537831a79acb414 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a21f5c9558df4cc39e628263632936d9" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 38005 } } peers { permanent_uuid: "7ea8f731673b44219ee8c081f70994b3" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 39097 } } peers { permanent_uuid: "d31b5bc8328340c9a537831a79acb414" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 46769 } }
I20260808 14:45:55.257149 15235 leader_election.cc:288] T 9d03ba94e04e45d68b5f71809692247d P d31b5bc8328340c9a537831a79acb414 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a21f5c9558df4cc39e628263632936d9 (127.30.214.131:38005), 7ea8f731673b44219ee8c081f70994b3 (127.30.214.130:39097)
I20260808 14:45:55.260111 15218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:55.257480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.129:53979 (local address 127.30.214.130:39097)
0808 14:45:55.257556 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:55.257558 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:55.257675 (+ 117us) server_negotiation.cc:407] Connection header received
0808 14:45:55.257737 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:55.257738 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:55.257748 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:55.257789 (+ 41us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:45:55.257942 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:55.258414 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:55.259396 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:55.259793 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:55.259857 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:55.259873 (+ 16us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:55.260000 (+ 127us) server_negotiation.cc:299] Negotiation successful
0808 14:45:55.260040 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 14:45:55.260133 15237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:55.257362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.130:39097 (local address 127.30.214.129:53979)
0808 14:45:55.257599 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:55.257608 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:55.257673 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:55.257802 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:55.257803 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:55.257805 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:45:55.257883 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:55.257885 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:55.258487 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:55.258489 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:55.259302 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:55.259304 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:55.259872 (+ 568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:55.259873 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:55.259939 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:55.259943 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:45:55.259989 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 14:45:55.260034 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":222,"mutex_wait_us":3,"thread_start_us":183,"threads_started":1}
I20260808 14:45:55.260126 15219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:55.257421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.129:52879 (local address 127.30.214.131:38005)
0808 14:45:55.257513 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:55.257516 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:55.257609 (+ 93us) server_negotiation.cc:407] Connection header received
0808 14:45:55.257694 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:55.257695 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:55.257705 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:55.257749 (+ 44us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:45:55.257897 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:55.258379 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:55.259410 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:55.259793 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:55.259857 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:55.259867 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:55.260016 (+ 149us) server_negotiation.cc:299] Negotiation successful
0808 14:45:55.260060 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 14:45:55.260149 15236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:55.257330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.131:38005 (local address 127.30.214.129:52879)
0808 14:45:55.257514 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:55.257543 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0808 14:45:55.257622 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:45:55.257759 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:45:55.257760 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:45:55.257762 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:45:55.257838 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:55.257839 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:55.258455 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:55.258456 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:55.259301 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:45:55.259304 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:45:55.259869 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:45:55.259871 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:45:55.259949 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:55.259953 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:45:55.259998 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 14:45:55.260046 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164,"mutex_wait_us":19,"thread_start_us":93,"threads_started":1}
I20260808 14:45:55.260602 15130 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d03ba94e04e45d68b5f71809692247d" candidate_uuid: "d31b5bc8328340c9a537831a79acb414" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a21f5c9558df4cc39e628263632936d9" is_pre_election: true
I20260808 14:45:55.260609 14928 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d03ba94e04e45d68b5f71809692247d" candidate_uuid: "d31b5bc8328340c9a537831a79acb414" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ea8f731673b44219ee8c081f70994b3" is_pre_election: true
I20260808 14:45:55.260767 14928 raft_consensus.cc:2454] T 9d03ba94e04e45d68b5f71809692247d P 7ea8f731673b44219ee8c081f70994b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d31b5bc8328340c9a537831a79acb414 in term 0.
I20260808 14:45:55.260767 15130 raft_consensus.cc:2454] T 9d03ba94e04e45d68b5f71809692247d P a21f5c9558df4cc39e628263632936d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d31b5bc8328340c9a537831a79acb414 in term 0.
I20260808 14:45:55.261008 14617 leader_election.cc:302] T 9d03ba94e04e45d68b5f71809692247d P d31b5bc8328340c9a537831a79acb414 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a21f5c9558df4cc39e628263632936d9, d31b5bc8328340c9a537831a79acb414; no voters:
I20260808 14:45:55.261196 15235 raft_consensus.cc:2781] T 9d03ba94e04e45d68b5f71809692247d P d31b5bc8328340c9a537831a79acb414 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:45:55.261245 15235 raft_consensus.cc:482] T 9d03ba94e04e45d68b5f71809692247d P d31b5bc8328340c9a537831a79acb414 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:45:55.261260 15235 raft_consensus.cc:3037] T 9d03ba94e04e45d68b5f71809692247d P d31b5bc8328340c9a537831a79acb414 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:55.262056 15235 raft_consensus.cc:504] T 9d03ba94e04e45d68b5f71809692247d P d31b5bc8328340c9a537831a79acb414 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a21f5c9558df4cc39e628263632936d9" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 38005 } } peers { permanent_uuid: "7ea8f731673b44219ee8c081f70994b3" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 39097 } } peers { permanent_uuid: "d31b5bc8328340c9a537831a79acb414" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 46769 } }
I20260808 14:45:55.262198 15235 leader_election.cc:288] T 9d03ba94e04e45d68b5f71809692247d P d31b5bc8328340c9a537831a79acb414 [CANDIDATE]: Term 1 election: Requested vote from peers a21f5c9558df4cc39e628263632936d9 (127.30.214.131:38005), 7ea8f731673b44219ee8c081f70994b3 (127.30.214.130:39097)
I20260808 14:45:55.262387 15130 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d03ba94e04e45d68b5f71809692247d" candidate_uuid: "d31b5bc8328340c9a537831a79acb414" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a21f5c9558df4cc39e628263632936d9"
I20260808 14:45:55.262482 15130 raft_consensus.cc:3037] T 9d03ba94e04e45d68b5f71809692247d P a21f5c9558df4cc39e628263632936d9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:55.262589 14928 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d03ba94e04e45d68b5f71809692247d" candidate_uuid: "d31b5bc8328340c9a537831a79acb414" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ea8f731673b44219ee8c081f70994b3"
I20260808 14:45:55.262748 14928 raft_consensus.cc:3037] T 9d03ba94e04e45d68b5f71809692247d P 7ea8f731673b44219ee8c081f70994b3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:45:55.263303 15130 raft_consensus.cc:2454] T 9d03ba94e04e45d68b5f71809692247d P a21f5c9558df4cc39e628263632936d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d31b5bc8328340c9a537831a79acb414 in term 1.
I20260808 14:45:55.263475 14617 leader_election.cc:302] T 9d03ba94e04e45d68b5f71809692247d P d31b5bc8328340c9a537831a79acb414 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a21f5c9558df4cc39e628263632936d9, d31b5bc8328340c9a537831a79acb414; no voters:
I20260808 14:45:55.263578 15235 raft_consensus.cc:2781] T 9d03ba94e04e45d68b5f71809692247d P d31b5bc8328340c9a537831a79acb414 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:45:55.263733 15235 raft_consensus.cc:686] T 9d03ba94e04e45d68b5f71809692247d P d31b5bc8328340c9a537831a79acb414 [term 1 LEADER]: Becoming Leader. State: Replica: d31b5bc8328340c9a537831a79acb414, State: Running, Role: LEADER
I20260808 14:45:55.263839 15235 consensus_queue.cc:237] T 9d03ba94e04e45d68b5f71809692247d P d31b5bc8328340c9a537831a79acb414 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a21f5c9558df4cc39e628263632936d9" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 38005 } } peers { permanent_uuid: "7ea8f731673b44219ee8c081f70994b3" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 39097 } } peers { permanent_uuid: "d31b5bc8328340c9a537831a79acb414" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 46769 } }
I20260808 14:45:55.263859 14928 raft_consensus.cc:2454] T 9d03ba94e04e45d68b5f71809692247d P 7ea8f731673b44219ee8c081f70994b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d31b5bc8328340c9a537831a79acb414 in term 1.
I20260808 14:45:55.264827 14495 catalog_manager.cc:5495] T 9d03ba94e04e45d68b5f71809692247d P d31b5bc8328340c9a537831a79acb414 reported cstate change: term changed from 0 to 1, leader changed from <none> to d31b5bc8328340c9a537831a79acb414 (127.30.214.129). New cstate: current_term: 1 leader_uuid: "d31b5bc8328340c9a537831a79acb414" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a21f5c9558df4cc39e628263632936d9" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 38005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ea8f731673b44219ee8c081f70994b3" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 39097 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d31b5bc8328340c9a537831a79acb414" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 46769 } health_report { overall_health: HEALTHY } } }
W20260808 14:45:55.276564 15204 tablet.cc:2369] T 9d03ba94e04e45d68b5f71809692247d P a21f5c9558df4cc39e628263632936d9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:45:55.288277 15222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:55.286006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56324 (local address 127.30.214.129:46769)
0808 14:45:55.286068 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 14:45:55.286070 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:45:55.286077 (+ 7us) server_negotiation.cc:407] Connection header received
0808 14:45:55.286119 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:45:55.286120 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:45:55.286140 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:45:55.286201 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:45:55.286340 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:55.286819 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:55.287560 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:45:55.287764 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:45:55.287819 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:45:55.287961 (+ 142us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:45:55.288080 (+ 119us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:45:55.288154 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 14:45:55.288174 (+ 20us) server_negotiation.cc:299] Negotiation successful
0808 14:45:55.288197 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 14:45:55.290817 14928 raft_consensus.cc:1261] T 9d03ba94e04e45d68b5f71809692247d P 7ea8f731673b44219ee8c081f70994b3 [term 1 FOLLOWER]: Refusing update from remote peer d31b5bc8328340c9a537831a79acb414: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:45:55.291232 15130 raft_consensus.cc:1261] T 9d03ba94e04e45d68b5f71809692247d P a21f5c9558df4cc39e628263632936d9 [term 1 FOLLOWER]: Refusing update from remote peer d31b5bc8328340c9a537831a79acb414: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:45:55.291327 15239 consensus_queue.cc:1035] T 9d03ba94e04e45d68b5f71809692247d P d31b5bc8328340c9a537831a79acb414 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ea8f731673b44219ee8c081f70994b3" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 39097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:45:55.291622 15235 consensus_queue.cc:1035] T 9d03ba94e04e45d68b5f71809692247d P d31b5bc8328340c9a537831a79acb414 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a21f5c9558df4cc39e628263632936d9" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 38005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:45:55.294425 15244 mvcc.cc:205] Tried to move back new op lower bound from 7316276655266959360 to 7316276655161331712. Current Snapshot: MvccSnapshot[applied={T|T < 7316276655266959360}]
I20260808 14:45:55.296459 14495 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37970:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:45:55.296546 14495 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37970:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:45:55.297262 14495 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 38aa04195c1b4f36a848fbc6edfb597d: Sending DeleteTablet for 3 replicas of tablet 9d03ba94e04e45d68b5f71809692247d
I20260808 14:45:55.297605 15103 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d03ba94e04e45d68b5f71809692247d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:45:55 UTC) from {username='kudu', principal='kudu/127.30.214.190@KRBTEST.COM'} at 127.0.0.1:45558
I20260808 14:45:55.297633 14687 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d03ba94e04e45d68b5f71809692247d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:45:55 UTC) from {username='kudu', principal='kudu/127.30.214.190@KRBTEST.COM'} at 127.0.0.1:56310
I20260808 14:45:55.297665 14899 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d03ba94e04e45d68b5f71809692247d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:45:55 UTC) from {username='kudu', principal='kudu/127.30.214.190@KRBTEST.COM'} at 127.0.0.1:38126
I20260808 14:45:55.297900 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 14588
I20260808 14:45:55.304661 15255 tablet_replica.cc:330] T 9d03ba94e04e45d68b5f71809692247d P a21f5c9558df4cc39e628263632936d9: stopping tablet replica
I20260808 14:45:55.304924 15255 raft_consensus.cc:2229] T 9d03ba94e04e45d68b5f71809692247d P a21f5c9558df4cc39e628263632936d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:45:55.305078 15255 raft_consensus.cc:2258] T 9d03ba94e04e45d68b5f71809692247d P a21f5c9558df4cc39e628263632936d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:45:55.305634 15255 ts_tablet_manager.cc:1905] T 9d03ba94e04e45d68b5f71809692247d P a21f5c9558df4cc39e628263632936d9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:45:55.307051 15256 tablet_replica.cc:330] T 9d03ba94e04e45d68b5f71809692247d P 7ea8f731673b44219ee8c081f70994b3: stopping tablet replica
I20260808 14:45:55.307197 15256 raft_consensus.cc:2229] T 9d03ba94e04e45d68b5f71809692247d P 7ea8f731673b44219ee8c081f70994b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:45:55.307220 15255 ts_tablet_manager.cc:1918] T 9d03ba94e04e45d68b5f71809692247d P a21f5c9558df4cc39e628263632936d9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:45:55.307327 15255 log.cc:1196] T 9d03ba94e04e45d68b5f71809692247d P a21f5c9558df4cc39e628263632936d9: Deleting WAL directory at /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/minicluster-data/ts-2/wal/wals/9d03ba94e04e45d68b5f71809692247d
I20260808 14:45:55.307331 15256 raft_consensus.cc:2258] T 9d03ba94e04e45d68b5f71809692247d P 7ea8f731673b44219ee8c081f70994b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:45:55.307694 15255 ts_tablet_manager.cc:1939] T 9d03ba94e04e45d68b5f71809692247d P a21f5c9558df4cc39e628263632936d9: Deleting consensus metadata
I20260808 14:45:55.308543 14478 catalog_manager.cc:4841] TS a21f5c9558df4cc39e628263632936d9 (127.30.214.131:38005): tablet 9d03ba94e04e45d68b5f71809692247d (table test-table [id=3f01d7d3fe6446bea04abb5304fb2188]) successfully deleted
I20260808 14:45:55.308710 15256 ts_tablet_manager.cc:1905] T 9d03ba94e04e45d68b5f71809692247d P 7ea8f731673b44219ee8c081f70994b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:45:55.310017 15256 ts_tablet_manager.cc:1918] T 9d03ba94e04e45d68b5f71809692247d P 7ea8f731673b44219ee8c081f70994b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:45:55.310088 15256 log.cc:1196] T 9d03ba94e04e45d68b5f71809692247d P 7ea8f731673b44219ee8c081f70994b3: Deleting WAL directory at /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786200295877777-31578-0/minicluster-data/ts-1/wal/wals/9d03ba94e04e45d68b5f71809692247d
I20260808 14:45:55.310318 15256 ts_tablet_manager.cc:1939] T 9d03ba94e04e45d68b5f71809692247d P 7ea8f731673b44219ee8c081f70994b3: Deleting consensus metadata
I20260808 14:45:55.310796 14476 catalog_manager.cc:4841] TS 7ea8f731673b44219ee8c081f70994b3 (127.30.214.130:39097): tablet 9d03ba94e04e45d68b5f71809692247d (table test-table [id=3f01d7d3fe6446bea04abb5304fb2188]) successfully deleted
W20260808 14:45:55.312894 14476 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.30.214.129:46769 (error 108)
I20260808 14:45:55.313118 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 14797
I20260808 14:45:55.320116 15214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:45:55.313229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.129:46769 (local address 127.0.0.1:56338)
0808 14:45:55.319995 (+ 6766us) negotiation.cc:107] Waiting for socket to connect
0808 14:45:55.320072 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.129:46769: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":6729}
W20260808 14:45:55.320305 14476 catalog_manager.cc:4584] TS d31b5bc8328340c9a537831a79acb414 (127.30.214.129:46769): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9d03ba94e04e45d68b5f71809692247d: Network error: Client connection negotiation failed: client connection to 127.30.214.129:46769: connect: Connection refused (error 111)
I20260808 14:45:55.334098 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 15003
I20260808 14:45:55.352768 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 14447
2026-08-08T14:45:55Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2205 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:45:55 dist-test-slave-42z9 krb5kdc[15265](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:45:55 dist-test-slave-42z9 krb5kdc[15265](info): set up 2 sockets
Aug 08 14:45:55 dist-test-slave-42z9 krb5kdc[15265](info): commencing operation
krb5kdc: starting...
W20260808 14:45:56.492475 31578 mini_kdc.cc:121] Time spent starting KDC: real 1.112s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Aug 08 14:45:56 dist-test-slave-42z9 krb5kdc[15265](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200356, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:45:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:45:56Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.30.214.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.30.214.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.30.214.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/krb5kdc/rangeradmin_127.30.214.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.30.214.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/krb5kdc/rangeradmin_127.30.214.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.30.214.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.30.214.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.30.214.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/krb5kdc/rangerlookup_127.30.214.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.30.214.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/krb5kdc/rangerlookup_127.30.214.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.30.214.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.30.214.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.30.214.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/krb5kdc/HTTP_127.30.214.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.30.214.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/krb5kdc/HTTP_127.30.214.148@KRBTEST.COM.keytab.
I20260808 14:45:56.662297 31578 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskT6IgCE/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/postgres -l logfile start
2026-08-08 14:45:58.988 UTC [15315] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-08 14:45:58.989 UTC [15315] LOG: listening on IPv4 address "127.30.214.148", port 60043
2026-08-08 14:45:58.991 UTC [15315] LOG: listening on Unix socket "/tmp/.s.PGSQL.60043"
2026-08-08 14:45:59.012 UTC [15318] LOG: database system was shut down at 2026-08-08 14:45:57 UTC
2026-08-08 14:45:59.015 UTC [15315] LOG: database system is ready to accept connections
I20260808 14:46:00.074517 31578 mini_postgres.cc:96] Postgres bound to 60043
2026-08-08 14:46:00.081 UTC [15338] FATAL: database "slave" does not exist
127.30.214.148:60043 - accepting connections
I20260808 14:46:00.082206 31578 mini_ranger.cc:161] Starting Ranger...
I20260808 14:46:00.097945 31578 mini_ranger.cc:84] Created miniranger Postgres user
I20260808 14:46:00.566836 31578 mini_ranger.cc:87] Created ranger Postgres database
I20260808 14:46:00.566911 31578 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/ranger-admin
2026-08-08 14:46:00,876 [I] DB FLAVOR :POSTGRES
2026-08-08 14:46:00,876 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 14:46:00,876 [I] Checking connection..
2026-08-08 14:46:00,877 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskT6IgCE/build/release/bin/postgresql.jar:/tmp/dist-test-taskT6IgCE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.214.148:60043/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-08 14:46:01,153 [I] Checking connection passed.
2026-08-08 14:46:01,154 [I] --------- Verifying version history table ---------
2026-08-08 14:46:01,154 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskT6IgCE/build/release/bin/postgresql.jar:/tmp/dist-test-taskT6IgCE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.214.148:60043/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 14:46:01,403 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 14:46:01,404 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskT6IgCE/build/release/bin/postgresql.jar:/tmp/dist-test-taskT6IgCE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.214.148:60043/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 14:46:01,671 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 14:46:01,671 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-08 14:46:01,672 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskT6IgCE/build/release/bin/postgresql.jar:/tmp/dist-test-taskT6IgCE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.214.148:60043/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskT6IgCE/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-08 14:46:01.938 UTC [15433] WARNING: there is no transaction in progress
2026-08-08 14:46:01,948 [I] create_dbversion_catalog.sql file imported successfully
2026-08-08 14:46:01,949 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskT6IgCE/build/release/bin/postgresql.jar:/tmp/dist-test-taskT6IgCE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.214.148:60043/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 14:46:02,195 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-08 14:46:02,195 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 14:46:02,196 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskT6IgCE/build/release/bin/postgresql.jar:/tmp/dist-test-taskT6IgCE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.214.148:60043/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-08 14:46:02,459 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskT6IgCE/build/release/bin/postgresql.jar:/tmp/dist-test-taskT6IgCE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.214.148:60043/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-08 14:46:02,729 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskT6IgCE/build/release/bin/postgresql.jar:/tmp/dist-test-taskT6IgCE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.214.148:60043/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-42z9.c.gcp-upstream.internal','N') ;"
2026-08-08 14:46:02,973 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskT6IgCE/build/release/bin/postgresql.jar:/tmp/dist-test-taskT6IgCE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.214.148:60043/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 14:46:03,248 [I] Table x_portal_user does not exist in database ranger
2026-08-08 14:46:03,248 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskT6IgCE/build/release/bin/postgresql.jar:/tmp/dist-test-taskT6IgCE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.214.148:60043/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 14:46:03,521 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-08 14:46:03,521 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskT6IgCE/build/release/bin/postgresql.jar:/tmp/dist-test-taskT6IgCE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.214.148:60043/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 14:46:03,792 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskT6IgCE/build/release/bin/postgresql.jar:/tmp/dist-test-taskT6IgCE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.214.148:60043/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 14:46:04,061 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-08 14:46:04,061 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskT6IgCE/build/release/bin/postgresql.jar:/tmp/dist-test-taskT6IgCE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.214.148:60043/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskT6IgCE/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-08 14:46:05.041 UTC [15600] WARNING: there is no transaction in progress
2026-08-08 14:46:05.057 UTC [15600] WARNING: there is no transaction in progress
2026-08-08 14:46:05.075 UTC [15600] WARNING: there is no transaction in progress
2026-08-08 14:46:05.093 UTC [15600] WARNING: there is no transaction in progress
2026-08-08 14:46:05.111 UTC [15600] WARNING: there is no transaction in progress
2026-08-08 14:46:05.130 UTC [15600] WARNING: there is no transaction in progress
2026-08-08 14:46:05.196 UTC [15600] WARNING: there is no transaction in progress
2026-08-08 14:46:05.204 UTC [15600] WARNING: there is no transaction in progress
2026-08-08 14:46:05.221 UTC [15600] WARNING: there is no transaction in progress
2026-08-08 14:46:05.234 UTC [15600] WARNING: there is no transaction in progress
2026-08-08 14:46:05.246 UTC [15600] WARNING: there is no transaction in progress
2026-08-08 14:46:05.260 UTC [15600] WARNING: there is no transaction in progress
2026-08-08 14:46:05.271 UTC [15600] WARNING: there is no transaction in progress
2026-08-08 14:46:05.279 UTC [15600] WARNING: there is no transaction in progress
2026-08-08 14:46:05.287 UTC [15600] WARNING: there is no transaction in progress
2026-08-08 14:46:05.295 UTC [15600] WARNING: there is no transaction in progress
2026-08-08 14:46:05,977 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-08 14:46:05,978 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskT6IgCE/build/release/bin/postgresql.jar:/tmp/dist-test-taskT6IgCE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.214.148:60043/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-08 14:46:06,231 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-08 14:46:06,231 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskT6IgCE/build/release/bin/postgresql.jar:/tmp/dist-test-taskT6IgCE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.214.148:60043/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 14:46:06,482 [I] Table x_portal_user already exists in database 'ranger'
2026-08-08 14:46:06,482 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskT6IgCE/build/release/bin/postgresql.jar:/tmp/dist-test-taskT6IgCE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.214.148:60043/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 14:46:06,738 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-08 14:46:06,738 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskT6IgCE/build/release/bin/postgresql.jar:/tmp/dist-test-taskT6IgCE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.214.148:60043/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 14:46:06,983 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskT6IgCE/build/release/bin/postgresql.jar:/tmp/dist-test-taskT6IgCE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.214.148:60043/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 14:46:07,242 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskT6IgCE/build/release/bin/postgresql.jar:/tmp/dist-test-taskT6IgCE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.214.148:60043/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-42z9.c.gcp-upstream.internal';"
2026-08-08 14:46:07,505 [I] CORE_DB_SCHEMA import status has been updated
2026-08-08 14:46:07,505 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskT6IgCE/build/release/bin/postgresql.jar:/tmp/dist-test-taskT6IgCE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.214.148:60043/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-08 14:46:07,756 [I] DB_PATCHES have already been applied
I20260808 14:46:07.762091 31578 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/ranger-admin:/tmp/dist-test-taskT6IgCE/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskT6IgCE/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskT6IgCE/build/release/bin/postgresql.jar:/tmp/dist-test-taskT6IgCE/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260808 14:46:07.762166 31578 mini_ranger.cc:193] Using host: 127.30.214.148
I20260808 14:46:07.766062 31578 mini_ranger.cc:227] Ranger admin URL: http://127.30.214.148:58563
Aug 08, 2026 2:46:08 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 2:46:08 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 2:46:08 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/ranger-admin/ews/webapp
Aug 08, 2026 2:46:08 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 08, 2026 2:46:08 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 08, 2026 2:46:08 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/ranger-admin/ews/webapp].
Aug 08, 2026 2:46:08 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260808 14:46:08.975564 31578 mini_ranger.cc:160] Time spent starting Ranger: real 8.893s user 0.004s sys 0.008s
Aug 08, 2026 2:46:28 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 08, 2026 2:46:28 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 08, 2026 2:46:28 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 08, 2026 2:46:28 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 08, 2026 2:46:28 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 08, 2026 2:46:28 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 08, 2026 2:46:28 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 08, 2026 2:46:28 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 08, 2026 2:46:28 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 08, 2026 2:46:28 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 08, 2026 2:46:28 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 08, 2026 2:46:28 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 08, 2026 2:46:28 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 08, 2026 2:46:28 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 08, 2026 2:46:28 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 08, 2026 2:46:28 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 08, 2026 2:46:28 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 08, 2026 2:46:29 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260808 14:46:29.605773 31578 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.30.214.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.30.214.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.30.214.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/krb5kdc/rangerkms_127.30.214.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.30.214.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/krb5kdc/rangerkms_127.30.214.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.30.214.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.30.214.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.30.214.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/krb5kdc/HTTP_127.30.214.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.30.214.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/krb5kdc/HTTP_127.30.214.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 08 14:46:29 dist-test-slave-42z9 krb5kdc[15265](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200389, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260808 14:46:29.707753 31578 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260808 14:46:29.718729 31578 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260808 14:46:30.519133 31578 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260808 14:46:30.519371 31578 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/ranger-kms
I20260808 14:46:30.519390 31578 mini_ranger_kms.cc:227] Using postgres at 127.30.214.148:60043
2026-08-08 14:46:30,738 [I] DB FLAVOR :POSTGRES
2026-08-08 14:46:30,739 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 14:46:30,739 [I] Checking connection
2026-08-08 14:46:30,739 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskT6IgCE/build/release/bin/postgresql.jar:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.214.148:60043/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-08 14:46:30,992 [I] connection success
2026-08-08 14:46:30,993 [I] --------- Verifying Ranger DB tables ---------
2026-08-08 14:46:30,993 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-08 14:46:30,993 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskT6IgCE/build/release/bin/postgresql.jar:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.214.148:60043/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-08 14:46:31,245 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-08 14:46:31,245 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 14:46:31,245 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-08 14:46:31,245 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskT6IgCE/build/release/bin/postgresql.jar:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.214.148:60043/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-08 14:46:31,512 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260808 14:46:31.977610 31578 mini_ranger_kms.cc:310] Created kms service
I20260808 14:46:32.162245 31578 mini_ranger_kms.cc:326] Created kudu user
I20260808 14:46:32.210111 31578 mini_ranger_kms.cc:343] Created rangerkms user
Aug 08 14:46:32 dist-test-slave-42z9 krb5kdc[15265](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200389, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.30.214.148@KRBTEST.COM
I20260808 14:46:32.648015 31578 mini_ranger_kms.cc:384] Added ranger policy
I20260808 14:46:32.648140 31578 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/ranger-kms:/tmp/dist-test-taskT6IgCE/build/release/bin/postgresql.jar:/tmp/dist-test-taskT6IgCE/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskT6IgCE/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260808 14:46:32.648164 31578 mini_ranger_kms.cc:240] Using host: 127.30.214.148
I20260808 14:46:32.652484 31578 mini_ranger_kms.cc:276] Ranger KMS PID: 15892
I20260808 14:46:32.652635 31578 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.30.214.148:42475
Aug 08, 2026 2:46:33 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 2:46:33 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 2:46:33 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 08, 2026 2:46:33 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 08, 2026 2:46:34 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/ranger-kms/ews/webapp].
Aug 08, 2026 2:46:34 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 08 14:46:34 dist-test-slave-42z9 krb5kdc[15265](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786200394, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.30.214.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:46:35.057631 31578 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.350s user 0.009s sys 0.196s
I20260808 14:46:35.057739 31578 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260808 14:46:35.057825 31578 mini_ranger_kms.cc:401] 127.30.214.148:42475/kms/v1/keys
Aug 08 14:46:35 dist-test-slave-42z9 krb5kdc[15265](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200394, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.30.214.148@KRBTEST.COM for HTTP/127.30.214.148@KRBTEST.COM
Aug 08 14:46:35 dist-test-slave-42z9 krb5kdc[15265](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200394, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.30.214.148@KRBTEST.COM for HTTP/127.30.214.148@KRBTEST.COM
Aug 08 14:46:37 dist-test-slave-42z9 krb5kdc[15265](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200397, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.30.214.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab.
Entry for principal kudu/127.30.214.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab.
I20260808 14:46:38.033771 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:33245
--webserver_interface=127.30.214.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab
--principal=kudu/127.30.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:35341
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.214.190:33245
--ranger_config_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.30.214.148:42475/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:46:38.128219 15975 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:46:38.128444 15975 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:46:38.128466 15975 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:46:38.129678 15975 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:46:38.129724 15975 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:46:38.129736 15975 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:46:38.129748 15975 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:46:38.129758 15975 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:46:38.131497 15975 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:35341
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/master-0/wal
--ranger_kms_url=127.30.214.148:42475/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.30.214.190:33245
--ranger_config_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab
--principal=kudu/127.30.214.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:33245
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15975
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:46:38.131754 15975 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:46:38.131996 15975 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:46:38.137058 15985 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:46:38.137151 15988 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:46:38.137174 15975 server_base.cc:1034] running on GCE node
W20260808 14:46:38.137095 15981 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:46:38.137530 15975 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:46:38.137841 15975 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:46:38.138988 15975 hybrid_clock.cc:648] HybridClock initialized: now 1786200398138973 us; error 30 us; skew 500 ppm
Aug 08 14:46:38 dist-test-slave-42z9 krb5kdc[15265](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200398, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:46:38.144351 15975 init.cc:377] Logged in from keytab as kudu/127.30.214.190@KRBTEST.COM (short username kudu)
I20260808 14:46:38.144807 15975 webserver.cc:460] Webserver started at http://127.30.214.190:38749/ using document root <none> and password file <none>
I20260808 14:46:38.145001 15975 fs_manager.cc:359] Metadata directory not provided
I20260808 14:46:38.145043 15975 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:46:38.145172 15975 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 14:46:38 dist-test-slave-42z9 krb5kdc[15265](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200398, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.190@KRBTEST.COM for HTTP/127.30.214.148@KRBTEST.COM
I20260808 14:46:38.191334 15975 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/master-0/data/instance:
uuid: "4f67219f3ca64874b87cf73eb6486897"
format_stamp: "Formatted at 2026-08-08 14:46:38 on dist-test-slave-42z9"
server_key: "f3f5d65cb42fc422d5d889ebd5e0a2a4"
server_key_iv: "03bfbd97e22115b119e122ea06c7e347"
server_key_version: "kuduclusterkey@0"
I20260808 14:46:38.191732 15975 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/master-0/wal/instance:
uuid: "4f67219f3ca64874b87cf73eb6486897"
format_stamp: "Formatted at 2026-08-08 14:46:38 on dist-test-slave-42z9"
server_key: "f3f5d65cb42fc422d5d889ebd5e0a2a4"
server_key_iv: "03bfbd97e22115b119e122ea06c7e347"
server_key_version: "kuduclusterkey@0"
I20260808 14:46:38.193221 15975 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260808 14:46:38.209996 16000 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:46:38.210175 15975 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 14:46:38.210265 15975 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/master-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/master-0/wal
uuid: "4f67219f3ca64874b87cf73eb6486897"
format_stamp: "Formatted at 2026-08-08 14:46:38 on dist-test-slave-42z9"
server_key: "f3f5d65cb42fc422d5d889ebd5e0a2a4"
server_key_iv: "03bfbd97e22115b119e122ea06c7e347"
server_key_version: "kuduclusterkey@0"
I20260808 14:46:38.210364 15975 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:46:38.228196 15975 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:46:38.230307 15975 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:46:38.230476 15975 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:46:38.235100 15975 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.190:33245
I20260808 14:46:38.235121 16085 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.190:33245 every 8 connection(s)
I20260808 14:46:38.235601 15975 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
I20260808 14:46:38.236478 16086 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:46:38.239801 16086 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4f67219f3ca64874b87cf73eb6486897: Bootstrap starting.
I20260808 14:46:38.240568 16086 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4f67219f3ca64874b87cf73eb6486897: Neither blocks nor log segments found. Creating new log.
I20260808 14:46:38.240912 16086 log.cc:824] T 00000000000000000000000000000000 P 4f67219f3ca64874b87cf73eb6486897: Log is configured to *not* fsync() on all Append() calls
I20260808 14:46:38.241175 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 15975
I20260808 14:46:38.241281 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/master-0/wal/instance
I20260808 14:46:38.241494 31578 external_mini_cluster.cc:1428] Setting key d9dffc769e05ee08fff2a3c1ffca888e
I20260808 14:46:38.241833 16086 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4f67219f3ca64874b87cf73eb6486897: No bootstrap required, opened a new log
I20260808 14:46:38.244477 16086 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4f67219f3ca64874b87cf73eb6486897 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f67219f3ca64874b87cf73eb6486897" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 33245 } }
I20260808 14:46:38.244626 16086 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4f67219f3ca64874b87cf73eb6486897 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:46:38.244649 16086 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4f67219f3ca64874b87cf73eb6486897 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f67219f3ca64874b87cf73eb6486897, State: Initialized, Role: FOLLOWER
I20260808 14:46:38.244763 16086 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4f67219f3ca64874b87cf73eb6486897 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f67219f3ca64874b87cf73eb6486897" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 33245 } }
I20260808 14:46:38.244835 16086 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4f67219f3ca64874b87cf73eb6486897 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:46:38.244863 16086 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4f67219f3ca64874b87cf73eb6486897 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:46:38.244908 16086 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4f67219f3ca64874b87cf73eb6486897 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:46:38.245524 16086 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4f67219f3ca64874b87cf73eb6486897 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f67219f3ca64874b87cf73eb6486897" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 33245 } }
I20260808 14:46:38.245627 16086 leader_election.cc:302] T 00000000000000000000000000000000 P 4f67219f3ca64874b87cf73eb6486897 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4f67219f3ca64874b87cf73eb6486897; no voters:
I20260808 14:46:38.245798 16086 leader_election.cc:288] T 00000000000000000000000000000000 P 4f67219f3ca64874b87cf73eb6486897 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:46:38.245846 16093 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4f67219f3ca64874b87cf73eb6486897 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:46:38.246003 16093 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4f67219f3ca64874b87cf73eb6486897 [term 1 LEADER]: Becoming Leader. State: Replica: 4f67219f3ca64874b87cf73eb6486897, State: Running, Role: LEADER
I20260808 14:46:38.246089 16093 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4f67219f3ca64874b87cf73eb6486897 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f67219f3ca64874b87cf73eb6486897" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 33245 } }
I20260808 14:46:38.246126 16086 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4f67219f3ca64874b87cf73eb6486897 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:46:38.246447 16093 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f67219f3ca64874b87cf73eb6486897 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4f67219f3ca64874b87cf73eb6486897" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f67219f3ca64874b87cf73eb6486897" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 33245 } } }
I20260808 14:46:38.246629 16093 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f67219f3ca64874b87cf73eb6486897 [sys.catalog]: This master's current role is: LEADER
I20260808 14:46:38.246814 16093 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f67219f3ca64874b87cf73eb6486897 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4f67219f3ca64874b87cf73eb6486897. Latest consensus state: current_term: 1 leader_uuid: "4f67219f3ca64874b87cf73eb6486897" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f67219f3ca64874b87cf73eb6486897" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 33245 } } }
I20260808 14:46:38.246906 16093 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f67219f3ca64874b87cf73eb6486897 [sys.catalog]: This master's current role is: LEADER
I20260808 14:46:38.247234 16108 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:46:38.247774 16108 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:46:38.248409 16086 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
Aug 08 14:46:38 dist-test-slave-42z9 krb5kdc[15265](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200397, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:46:38.250586 16108 catalog_manager.cc:1347] Generated new cluster ID: a46f1812fe2547b5b16b8823564ee7cf
I20260808 14:46:38.250651 16108 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:46:38.252848 16092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:46:38.242025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59326 (local address 127.30.214.190:33245)
0808 14:46:38.242220 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0808 14:46:38.242230 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:46:38.242257 (+ 27us) server_negotiation.cc:407] Connection header received
0808 14:46:38.243263 (+ 1006us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:46:38.243271 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:46:38.243353 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:46:38.243489 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:46:38.244095 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:46:38.245161 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:46:38.246015 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:46:38.246582 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:46:38.247025 (+ 443us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:46:38.249413 (+ 2388us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:46:38.249417 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:46:38.249418 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:46:38.249431 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:46:38.251129 (+ 1698us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:46:38.251489 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:46:38.251492 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:46:38.251492 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:46:38.251593 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:46:38.251770 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:46:38.251770 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:46:38.251771 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:46:38.252010 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:46:38.252162 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0808 14:46:38.252258 (+ 96us) server_negotiation.cc:299] Negotiation successful
0808 14:46:38.252370 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":87,"threads_started":1}
I20260808 14:46:38.258701 16108 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:46:38.259469 16108 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:46:38.274051 16108 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4f67219f3ca64874b87cf73eb6486897: Generated new TSK 0
I20260808 14:46:38.274250 16108 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.214.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab.
Entry for principal kudu/127.30.214.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab.
I20260808 14:46:39.012405 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.30.214.148:42475/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.129:0
--local_ip_for_outbound_sockets=127.30.214.129
--webserver_interface=127.30.214.129
--webserver_port=0
--tserver_master_addrs=127.30.214.190:33245
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab
--principal=kudu/127.30.214.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:35341
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:46:39.126269 16158 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:46:39.126554 16158 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:46:39.126591 16158 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:46:39.128298 16158 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:46:39.128362 16158 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:46:39.128401 16158 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.129
I20260808 14:46:39.130677 16158 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:35341
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.30.214.148:42475/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab
--principal=kudu/127.30.214.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.214.129
--webserver_port=0
--tserver_master_addrs=127.30.214.190:33245
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16158
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.129
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:46:39.131083 16158 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:46:39.131381 16158 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:46:39.137763 16168 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:46:39.137719 16172 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:46:39.138304 16158 server_base.cc:1034] running on GCE node
W20260808 14:46:39.138423 16169 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:46:39.138667 16158 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:46:39.138947 16158 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:46:39.140132 16158 hybrid_clock.cc:648] HybridClock initialized: now 1786200399140113 us; error 39 us; skew 500 ppm
Aug 08 14:46:39 dist-test-slave-42z9 krb5kdc[15265](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200399, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:46:39.142900 16158 init.cc:377] Logged in from keytab as kudu/127.30.214.129@KRBTEST.COM (short username kudu)
I20260808 14:46:39.143319 16158 webserver.cc:460] Webserver started at http://127.30.214.129:43477/ using document root <none> and password file <none>
I20260808 14:46:39.143558 16158 fs_manager.cc:359] Metadata directory not provided
I20260808 14:46:39.143610 16158 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:46:39.143762 16158 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 14:46:39 dist-test-slave-42z9 krb5kdc[15265](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200399, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.129@KRBTEST.COM for HTTP/127.30.214.148@KRBTEST.COM
I20260808 14:46:39.170789 16158 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/ts-0/data/instance:
uuid: "1b7196cab33c42d983ecee895ab0f699"
format_stamp: "Formatted at 2026-08-08 14:46:39 on dist-test-slave-42z9"
server_key: "3068b09f0a59aca8adf2eaf5ed8e1fe0"
server_key_iv: "827699b9d996e13de22170406ef7d43e"
server_key_version: "kuduclusterkey@0"
I20260808 14:46:39.171296 16158 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/ts-0/wal/instance:
uuid: "1b7196cab33c42d983ecee895ab0f699"
format_stamp: "Formatted at 2026-08-08 14:46:39 on dist-test-slave-42z9"
server_key: "3068b09f0a59aca8adf2eaf5ed8e1fe0"
server_key_iv: "827699b9d996e13de22170406ef7d43e"
server_key_version: "kuduclusterkey@0"
I20260808 14:46:39.174263 16158 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.003s
I20260808 14:46:39.191809 16182 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:46:39.193586 16158 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 14:46:39.193737 16158 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/ts-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/ts-0/wal
uuid: "1b7196cab33c42d983ecee895ab0f699"
format_stamp: "Formatted at 2026-08-08 14:46:39 on dist-test-slave-42z9"
server_key: "3068b09f0a59aca8adf2eaf5ed8e1fe0"
server_key_iv: "827699b9d996e13de22170406ef7d43e"
server_key_version: "kuduclusterkey@0"
I20260808 14:46:39.193867 16158 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:46:39.228463 16158 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:46:39.231032 16158 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:46:39.231262 16158 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:46:39.231575 16158 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:46:39.231989 16158 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:46:39.232089 16158 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:46:39.232196 16158 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:46:39.232271 16158 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:46:39.243883 16369 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.129:38053 every 8 connection(s)
I20260808 14:46:39.244107 16158 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.129:38053
I20260808 14:46:39.244642 16158 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
I20260808 14:46:39.250833 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 16158
I20260808 14:46:39.250948 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/ts-0/wal/instance
I20260808 14:46:39.251132 31578 external_mini_cluster.cc:1428] Setting key 1a429ab52073868287d8c0dfc7a435ca
Aug 08 14:46:39 dist-test-slave-42z9 krb5kdc[15265](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200399, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.129@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:46:39.259622 16373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:46:39.245924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:33245 (local address 127.30.214.129:34779)
0808 14:46:39.246160 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0808 14:46:39.246212 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 14:46:39.246881 (+ 669us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:46:39.249915 (+ 3034us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:46:39.249921 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:46:39.250176 (+ 255us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:46:39.250473 (+ 297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:46:39.250478 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:46:39.251807 (+ 1329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:46:39.251809 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:46:39.253095 (+ 1286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:46:39.253098 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:46:39.253647 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:46:39.253648 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:46:39.253789 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:46:39.254315 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:46:39.254324 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:46:39.255838 (+ 1514us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:46:39.257866 (+ 2028us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:46:39.257874 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:46:39.257877 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:46:39.258187 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:46:39.258413 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:46:39.258414 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:46:39.258414 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:46:39.258555 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:46:39.258878 (+ 323us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:46:39.258885 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:46:39.259065 (+ 180us) client_negotiation.cc:769] Sending connection context
0808 14:46:39.259179 (+ 114us) client_negotiation.cc:240] Negotiation successful
0808 14:46:39.259367 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":89,"threads_started":1}
I20260808 14:46:39.260399 16374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:46:39.246200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.129:34779 (local address 127.30.214.190:33245)
0808 14:46:39.249639 (+ 3439us) server_negotiation.cc:206] Beginning negotiation
0808 14:46:39.249641 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:46:39.249654 (+ 13us) server_negotiation.cc:407] Connection header received
0808 14:46:39.249683 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:46:39.249684 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:46:39.249699 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:46:39.250581 (+ 882us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:46:39.250649 (+ 68us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:46:39.251640 (+ 991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:46:39.253204 (+ 1564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:46:39.253553 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:46:39.253618 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:46:39.255936 (+ 2318us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:46:39.255938 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:46:39.255938 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:46:39.255946 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:46:39.257763 (+ 1817us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:46:39.258278 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:46:39.258280 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:46:39.258280 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:46:39.258345 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:46:39.258642 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:46:39.258643 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:46:39.258644 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:46:39.258788 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:46:39.258842 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 14:46:39.260207 (+ 1365us) server_negotiation.cc:299] Negotiation successful
0808 14:46:39.260302 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3402,"thread_start_us":85,"threads_started":1}
I20260808 14:46:39.261003 16371 heartbeater.cc:347] Connected to a master server at 127.30.214.190:33245
I20260808 14:46:39.261106 16371 heartbeater.cc:464] Registering TS with master...
I20260808 14:46:39.261314 16371 heartbeater.cc:511] Master 127.30.214.190:33245 requested a full tablet report, sending...
I20260808 14:46:39.261934 16027 ts_manager.cc:194] Registered new tserver with Master: 1b7196cab33c42d983ecee895ab0f699 (127.30.214.129:38053)
WARNING: no policy specified for kudu/127.30.214.130@KRBTEST.COM; defaulting to no policy
I20260808 14:46:39.262651 16027 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.214.129@KRBTEST.COM'} at 127.30.214.129:34779
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab.
Entry for principal kudu/127.30.214.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab.
I20260808 14:46:39.284124 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.30.214.148:42475/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.130:0
--local_ip_for_outbound_sockets=127.30.214.130
--webserver_interface=127.30.214.130
--webserver_port=0
--tserver_master_addrs=127.30.214.190:33245
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab
--principal=kudu/127.30.214.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:35341
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 14:46:39 dist-test-slave-42z9 krb5kdc[15265](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786200399, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260808 14:46:39.428293 16382 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:46:39.428686 16382 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:46:39.428774 16382 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:46:39.430608 16382 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:46:39.430740 16382 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:46:39.430826 16382 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.130
I20260808 14:46:39.433120 16382 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:35341
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.30.214.148:42475/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab
--principal=kudu/127.30.214.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.214.130
--webserver_port=0
--tserver_master_addrs=127.30.214.190:33245
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16382
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.130
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:46:39.433638 16382 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:46:39.434006 16382 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:46:39.440899 16392 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:46:39.441310 16391 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:46:39.441641 16394 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:46:39.442299 16382 server_base.cc:1034] running on GCE node
I20260808 14:46:39.442634 16382 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:46:39.442911 16382 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:46:39.444072 16382 hybrid_clock.cc:648] HybridClock initialized: now 1786200399444050 us; error 35 us; skew 500 ppm
Aug 08 14:46:39 dist-test-slave-42z9 krb5kdc[15265](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200399, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:46:39.447497 16382 init.cc:377] Logged in from keytab as kudu/127.30.214.130@KRBTEST.COM (short username kudu)
I20260808 14:46:39.448050 16382 webserver.cc:460] Webserver started at http://127.30.214.130:39643/ using document root <none> and password file <none>
I20260808 14:46:39.448295 16382 fs_manager.cc:359] Metadata directory not provided
I20260808 14:46:39.448343 16382 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:46:39.448470 16382 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 14:46:39 dist-test-slave-42z9 krb5kdc[15265](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200399, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.130@KRBTEST.COM for HTTP/127.30.214.148@KRBTEST.COM
I20260808 14:46:39.466761 16382 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/ts-1/data/instance:
uuid: "8458d543d91d419986c2165ee5ebe948"
format_stamp: "Formatted at 2026-08-08 14:46:39 on dist-test-slave-42z9"
server_key: "3eefda1b2731542fcdb1432fca44a2be"
server_key_iv: "9a853d9e6cce054d0ee49edf0a87607b"
server_key_version: "kuduclusterkey@0"
I20260808 14:46:39.467262 16382 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/ts-1/wal/instance:
uuid: "8458d543d91d419986c2165ee5ebe948"
format_stamp: "Formatted at 2026-08-08 14:46:39 on dist-test-slave-42z9"
server_key: "3eefda1b2731542fcdb1432fca44a2be"
server_key_iv: "9a853d9e6cce054d0ee49edf0a87607b"
server_key_version: "kuduclusterkey@0"
I20260808 14:46:39.471956 16382 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.001s
I20260808 14:46:39.487031 16408 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:46:39.487310 16382 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.000s
I20260808 14:46:39.487413 16382 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/ts-1/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/ts-1/wal
uuid: "8458d543d91d419986c2165ee5ebe948"
format_stamp: "Formatted at 2026-08-08 14:46:39 on dist-test-slave-42z9"
server_key: "3eefda1b2731542fcdb1432fca44a2be"
server_key_iv: "9a853d9e6cce054d0ee49edf0a87607b"
server_key_version: "kuduclusterkey@0"
I20260808 14:46:39.487517 16382 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:46:39.501786 16382 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:46:39.503698 16382 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:46:39.503896 16382 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:46:39.504146 16382 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:46:39.504498 16382 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:46:39.504535 16382 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:46:39.504565 16382 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:46:39.504583 16382 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:46:39.511353 16382 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.130:46373
I20260808 14:46:39.511905 16382 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
I20260808 14:46:39.512888 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 16382
I20260808 14:46:39.512989 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/ts-1/wal/instance
I20260808 14:46:39.513167 31578 external_mini_cluster.cc:1428] Setting key 14c5f0310d1b7e05e79b6905e06e8894
I20260808 14:46:39.516393 16586 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.130:46373 every 8 connection(s)
WARNING: no policy specified for kudu/127.30.214.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.131@KRBTEST.COM" created.
Aug 08 14:46:39 dist-test-slave-42z9 krb5kdc[15265](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200399, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.130@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:46:39.538060 16374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:46:39.521814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.130:40877 (local address 127.30.214.190:33245)
0808 14:46:39.521861 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 14:46:39.521863 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:46:39.524958 (+ 3095us) server_negotiation.cc:407] Connection header received
0808 14:46:39.525717 (+ 759us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:46:39.525719 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:46:39.525736 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:46:39.525808 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:46:39.526708 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:46:39.527535 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:46:39.531545 (+ 4010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:46:39.531859 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:46:39.531904 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:46:39.534750 (+ 2846us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:46:39.534752 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:46:39.534752 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:46:39.534760 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:46:39.536372 (+ 1612us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:46:39.536911 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:46:39.536912 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:46:39.536912 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:46:39.536973 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:46:39.537252 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:46:39.537253 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:46:39.537253 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:46:39.537408 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:46:39.537492 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 14:46:39.537865 (+ 373us) server_negotiation.cc:299] Negotiation successful
0808 14:46:39.537963 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 14:46:39.538858 16590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:46:39.521495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:33245 (local address 127.30.214.130:40877)
0808 14:46:39.524773 (+ 3278us) negotiation.cc:107] Waiting for socket to connect
0808 14:46:39.524831 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0808 14:46:39.525596 (+ 765us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:46:39.525953 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:46:39.525958 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:46:39.526264 (+ 306us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:46:39.526563 (+ 299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:46:39.526569 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:46:39.530067 (+ 3498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:46:39.530069 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:46:39.531426 (+ 1357us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:46:39.531430 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:46:39.532004 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:46:39.532005 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:46:39.532155 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:46:39.532786 (+ 631us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:46:39.532797 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:46:39.534507 (+ 1710us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:46:39.536492 (+ 1985us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:46:39.536500 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:46:39.536503 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:46:39.536815 (+ 312us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:46:39.537037 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:46:39.537038 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:46:39.537038 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:46:39.537178 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:46:39.537526 (+ 348us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:46:39.537533 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:46:39.537707 (+ 174us) client_negotiation.cc:769] Sending connection context
0808 14:46:39.538448 (+ 741us) client_negotiation.cc:240] Negotiation successful
0808 14:46:39.538624 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3220,"thread_start_us":109,"threads_started":1}
I20260808 14:46:39.539800 16587 heartbeater.cc:347] Connected to a master server at 127.30.214.190:33245
I20260808 14:46:39.539901 16587 heartbeater.cc:464] Registering TS with master...
I20260808 14:46:39.540097 16587 heartbeater.cc:511] Master 127.30.214.190:33245 requested a full tablet report, sending...
I20260808 14:46:39.540602 16027 ts_manager.cc:194] Registered new tserver with Master: 8458d543d91d419986c2165ee5ebe948 (127.30.214.130:46373)
I20260808 14:46:39.541097 16027 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.214.130@KRBTEST.COM'} at 127.30.214.130:40877
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab.
Entry for principal kudu/127.30.214.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab.
I20260808 14:46:39.558848 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.30.214.148:42475/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.131:0
--local_ip_for_outbound_sockets=127.30.214.131
--webserver_interface=127.30.214.131
--webserver_port=0
--tserver_master_addrs=127.30.214.190:33245
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab
--principal=kudu/127.30.214.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:35341
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:46:39.664875 16594 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:46:39.665096 16594 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:46:39.665120 16594 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:46:39.666345 16594 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:46:39.666399 16594 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:46:39.666426 16594 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.131
I20260808 14:46:39.667951 16594 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:35341
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.30.214.148:42475/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab
--principal=kudu/127.30.214.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.214.131
--webserver_port=0
--tserver_master_addrs=127.30.214.190:33245
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16594
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.131
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:46:39.668171 16594 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:46:39.668409 16594 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:46:39.684289 16611 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:46:39.684290 16605 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:46:39.684854 16607 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:46:39.690454 16594 server_base.cc:1034] running on GCE node
I20260808 14:46:39.690740 16594 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:46:39.691066 16594 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:46:39.692286 16594 hybrid_clock.cc:648] HybridClock initialized: now 1786200399692251 us; error 47 us; skew 500 ppm
Aug 08 14:46:39 dist-test-slave-42z9 krb5kdc[15265](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200399, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:46:39.700353 16594 init.cc:377] Logged in from keytab as kudu/127.30.214.131@KRBTEST.COM (short username kudu)
I20260808 14:46:39.701013 16594 webserver.cc:460] Webserver started at http://127.30.214.131:33363/ using document root <none> and password file <none>
I20260808 14:46:39.701325 16594 fs_manager.cc:359] Metadata directory not provided
I20260808 14:46:39.701483 16594 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:46:39.701696 16594 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 14:46:39 dist-test-slave-42z9 krb5kdc[15265](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200399, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.131@KRBTEST.COM for HTTP/127.30.214.148@KRBTEST.COM
I20260808 14:46:39.720947 16594 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/ts-2/data/instance:
uuid: "234c3248b7b848718a93f7a846301807"
format_stamp: "Formatted at 2026-08-08 14:46:39 on dist-test-slave-42z9"
server_key: "95421f47d5cd1db9836b46971fc4219c"
server_key_iv: "f851bbbc50b0b64a12b9ed9b77fcb6bd"
server_key_version: "kuduclusterkey@0"
I20260808 14:46:39.721486 16594 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/ts-2/wal/instance:
uuid: "234c3248b7b848718a93f7a846301807"
format_stamp: "Formatted at 2026-08-08 14:46:39 on dist-test-slave-42z9"
server_key: "95421f47d5cd1db9836b46971fc4219c"
server_key_iv: "f851bbbc50b0b64a12b9ed9b77fcb6bd"
server_key_version: "kuduclusterkey@0"
I20260808 14:46:39.723325 16594 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260808 14:46:39.741302 16622 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:46:39.741611 16594 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:46:39.741716 16594 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/ts-2/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/ts-2/wal
uuid: "234c3248b7b848718a93f7a846301807"
format_stamp: "Formatted at 2026-08-08 14:46:39 on dist-test-slave-42z9"
server_key: "95421f47d5cd1db9836b46971fc4219c"
server_key_iv: "f851bbbc50b0b64a12b9ed9b77fcb6bd"
server_key_version: "kuduclusterkey@0"
I20260808 14:46:39.741811 16594 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:46:39.753237 16594 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:46:39.755978 16594 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:46:39.756213 16594 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:46:39.756603 16594 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:46:39.757052 16594 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:46:39.757141 16594 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:46:39.757213 16594 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:46:39.757270 16594 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:46:39.765028 16594 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.131:44861
I20260808 14:46:39.765594 16594 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
I20260808 14:46:39.766717 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 16594
I20260808 14:46:39.766821 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/ts-2/wal/instance
I20260808 14:46:39.767002 31578 external_mini_cluster.cc:1428] Setting key bf68356dffe73793a9416cbd35ee0bb6
I20260808 14:46:39.768013 16812 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.131:44861 every 8 connection(s)
Aug 08 14:46:39 dist-test-slave-42z9 krb5kdc[15265](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200399, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.131@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:46:39.779644 16374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:46:39.769137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:51473 (local address 127.30.214.190:33245)
0808 14:46:39.769187 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 14:46:39.769189 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:46:39.769200 (+ 11us) server_negotiation.cc:407] Connection header received
0808 14:46:39.769856 (+ 656us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:46:39.769857 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:46:39.769868 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:46:39.769919 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:46:39.770660 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:46:39.771460 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:46:39.773083 (+ 1623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:46:39.773372 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:46:39.773432 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:46:39.776164 (+ 2732us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:46:39.776166 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:46:39.776166 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:46:39.776173 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:46:39.777888 (+ 1715us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:46:39.778448 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:46:39.778449 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:46:39.778450 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:46:39.778522 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:46:39.778826 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:46:39.778827 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:46:39.778828 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:46:39.778967 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:46:39.779014 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 14:46:39.779454 (+ 440us) server_negotiation.cc:299] Negotiation successful
0808 14:46:39.779548 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260808 14:46:39.779831 16815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:46:39.768828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:33245 (local address 127.30.214.131:51473)
0808 14:46:39.769032 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0808 14:46:39.769092 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0808 14:46:39.769743 (+ 651us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:46:39.770001 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:46:39.770006 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:46:39.770269 (+ 263us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:46:39.770555 (+ 286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:46:39.770560 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:46:39.771571 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:46:39.771572 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:46:39.772977 (+ 1405us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:46:39.772981 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:46:39.773564 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:46:39.773565 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:46:39.773712 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:46:39.774320 (+ 608us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:46:39.774331 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:46:39.776041 (+ 1710us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:46:39.777977 (+ 1936us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:46:39.777984 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:46:39.777987 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:46:39.778330 (+ 343us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:46:39.778603 (+ 273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:46:39.778604 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:46:39.778604 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:46:39.778753 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:46:39.779069 (+ 316us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:46:39.779077 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:46:39.779257 (+ 180us) client_negotiation.cc:769] Sending connection context
0808 14:46:39.779391 (+ 134us) client_negotiation.cc:240] Negotiation successful
0808 14:46:39.779579 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":100,"threads_started":1}
I20260808 14:46:39.780444 16813 heartbeater.cc:347] Connected to a master server at 127.30.214.190:33245
I20260808 14:46:39.780557 16813 heartbeater.cc:464] Registering TS with master...
I20260808 14:46:39.780771 16813 heartbeater.cc:511] Master 127.30.214.190:33245 requested a full tablet report, sending...
I20260808 14:46:39.781210 16027 ts_manager.cc:194] Registered new tserver with Master: 234c3248b7b848718a93f7a846301807 (127.30.214.131:44861)
I20260808 14:46:39.781634 16027 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.214.131@KRBTEST.COM'} at 127.30.214.131:51473
I20260808 14:46:39.789855 31578 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:46:39.799523 16374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:46:39.791684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36790 (local address 127.30.214.190:33245)
0808 14:46:39.791727 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 14:46:39.791728 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:46:39.791903 (+ 175us) server_negotiation.cc:407] Connection header received
0808 14:46:39.791961 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:46:39.791961 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:46:39.791972 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:46:39.792058 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:46:39.792805 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:46:39.793608 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:46:39.794629 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:46:39.794923 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:46:39.794983 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:46:39.796595 (+ 1612us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:46:39.796596 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:46:39.796596 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:46:39.796604 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:46:39.798176 (+ 1572us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:46:39.798595 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:46:39.798596 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:46:39.798597 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:46:39.798659 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:46:39.798876 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:46:39.798876 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:46:39.798877 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:46:39.799014 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:46:39.799093 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 14:46:39.799318 (+ 225us) server_negotiation.cc:299] Negotiation successful
0808 14:46:39.799417 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 14:46:39.801573 16027 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36790:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:46:39.803943 16027 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:46:39.812144 16831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:46:39.807045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.130:46373 (local address 127.0.0.1:55416)
0808 14:46:39.807752 (+ 707us) negotiation.cc:107] Waiting for socket to connect
0808 14:46:39.807760 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 14:46:39.807799 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:46:39.808056 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:46:39.808059 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:46:39.808061 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:46:39.808131 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:46:39.808133 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:46:39.809377 (+ 1244us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:46:39.809378 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:46:39.810686 (+ 1308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:46:39.810690 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:46:39.811810 (+ 1120us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:46:39.811811 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:46:39.811893 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:46:39.811908 (+ 15us) client_negotiation.cc:769] Sending connection context
0808 14:46:39.812000 (+ 92us) client_negotiation.cc:240] Negotiation successful
0808 14:46:39.812059 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":694,"thread_start_us":75,"threads_started":1}
I20260808 14:46:39.812394 16837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:46:39.807269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55416 (local address 127.30.214.130:46373)
0808 14:46:39.807709 (+ 440us) server_negotiation.cc:206] Beginning negotiation
0808 14:46:39.807714 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:46:39.807841 (+ 127us) server_negotiation.cc:407] Connection header received
0808 14:46:39.807882 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:46:39.807884 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:46:39.807900 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:46:39.807962 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:46:39.808204 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:46:39.809276 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:46:39.810827 (+ 1551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:46:39.811616 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:46:39.811711 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:46:39.811772 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 14:46:39.812271 (+ 499us) server_negotiation.cc:299] Negotiation successful
0808 14:46:39.812315 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":408,"thread_start_us":76,"threads_started":1}
I20260808 14:46:39.813303 16459 tablet_service.cc:1467] Processing CreateTablet for tablet b8f39699643f4147ac9e4c93e5011518 (DEFAULT_TABLE table=test-table [id=f09b4d546793459c8c9c06f2604fba99]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:46:39.813764 16459 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8f39699643f4147ac9e4c93e5011518. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:46:39.814325 16834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:46:39.806802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.131:44861 (local address 127.0.0.1:34958)
0808 14:46:39.807470 (+ 668us) negotiation.cc:107] Waiting for socket to connect
0808 14:46:39.807513 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 14:46:39.807578 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:46:39.809645 (+ 2067us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:46:39.809647 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:46:39.809649 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:46:39.809696 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:46:39.809698 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:46:39.811017 (+ 1319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:46:39.811018 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:46:39.812148 (+ 1130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:46:39.812151 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:46:39.814104 (+ 1953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:46:39.814105 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:46:39.814173 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:46:39.814177 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:46:39.814206 (+ 29us) client_negotiation.cc:240] Negotiation successful
0808 14:46:39.814247 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":653,"thread_start_us":96,"threads_started":1}
I20260808 14:46:39.814924 16836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:46:39.807250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34958 (local address 127.30.214.131:44861)
0808 14:46:39.809477 (+ 2227us) server_negotiation.cc:206] Beginning negotiation
0808 14:46:39.809482 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:46:39.809492 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:46:39.809530 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:46:39.809532 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:46:39.809548 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:46:39.809762 (+ 214us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:46:39.809840 (+ 78us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:46:39.810916 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:46:39.813005 (+ 2089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:46:39.814014 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:46:39.814713 (+ 699us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:46:39.814780 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 14:46:39.814808 (+ 28us) server_negotiation.cc:299] Negotiation successful
0808 14:46:39.814846 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2165,"thread_start_us":76,"threads_started":1}
I20260808 14:46:39.815778 16707 tablet_service.cc:1467] Processing CreateTablet for tablet b8f39699643f4147ac9e4c93e5011518 (DEFAULT_TABLE table=test-table [id=f09b4d546793459c8c9c06f2604fba99]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:46:39.816141 16707 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8f39699643f4147ac9e4c93e5011518. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:46:39.820063 16839 tablet_bootstrap.cc:492] T b8f39699643f4147ac9e4c93e5011518 P 234c3248b7b848718a93f7a846301807: Bootstrap starting.
I20260808 14:46:39.821202 16839 tablet_bootstrap.cc:654] T b8f39699643f4147ac9e4c93e5011518 P 234c3248b7b848718a93f7a846301807: Neither blocks nor log segments found. Creating new log.
I20260808 14:46:39.821641 16839 log.cc:824] T b8f39699643f4147ac9e4c93e5011518 P 234c3248b7b848718a93f7a846301807: Log is configured to *not* fsync() on all Append() calls
I20260808 14:46:39.821887 16838 tablet_bootstrap.cc:492] T b8f39699643f4147ac9e4c93e5011518 P 8458d543d91d419986c2165ee5ebe948: Bootstrap starting.
I20260808 14:46:39.823109 16838 tablet_bootstrap.cc:654] T b8f39699643f4147ac9e4c93e5011518 P 8458d543d91d419986c2165ee5ebe948: Neither blocks nor log segments found. Creating new log.
I20260808 14:46:39.823496 16838 log.cc:824] T b8f39699643f4147ac9e4c93e5011518 P 8458d543d91d419986c2165ee5ebe948: Log is configured to *not* fsync() on all Append() calls
I20260808 14:46:39.824472 16839 tablet_bootstrap.cc:492] T b8f39699643f4147ac9e4c93e5011518 P 234c3248b7b848718a93f7a846301807: No bootstrap required, opened a new log
I20260808 14:46:39.824591 16839 ts_tablet_manager.cc:1397] T b8f39699643f4147ac9e4c93e5011518 P 234c3248b7b848718a93f7a846301807: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260808 14:46:39.826658 16839 raft_consensus.cc:348] T b8f39699643f4147ac9e4c93e5011518 P 234c3248b7b848718a93f7a846301807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b7196cab33c42d983ecee895ab0f699" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38053 } } peers { permanent_uuid: "234c3248b7b848718a93f7a846301807" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44861 } } peers { permanent_uuid: "8458d543d91d419986c2165ee5ebe948" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 46373 } }
I20260808 14:46:39.826962 16839 raft_consensus.cc:374] T b8f39699643f4147ac9e4c93e5011518 P 234c3248b7b848718a93f7a846301807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:46:39.827054 16839 raft_consensus.cc:729] T b8f39699643f4147ac9e4c93e5011518 P 234c3248b7b848718a93f7a846301807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 234c3248b7b848718a93f7a846301807, State: Initialized, Role: FOLLOWER
I20260808 14:46:39.827255 16839 consensus_queue.cc:260] T b8f39699643f4147ac9e4c93e5011518 P 234c3248b7b848718a93f7a846301807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b7196cab33c42d983ecee895ab0f699" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38053 } } peers { permanent_uuid: "234c3248b7b848718a93f7a846301807" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44861 } } peers { permanent_uuid: "8458d543d91d419986c2165ee5ebe948" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 46373 } }
I20260808 14:46:39.827674 16839 ts_tablet_manager.cc:1428] T b8f39699643f4147ac9e4c93e5011518 P 234c3248b7b848718a93f7a846301807: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 14:46:39.827826 16813 heartbeater.cc:503] Master 127.30.214.190:33245 was elected leader, sending a full tablet report...
I20260808 14:46:39.828964 16838 tablet_bootstrap.cc:492] T b8f39699643f4147ac9e4c93e5011518 P 8458d543d91d419986c2165ee5ebe948: No bootstrap required, opened a new log
I20260808 14:46:39.829108 16838 ts_tablet_manager.cc:1397] T b8f39699643f4147ac9e4c93e5011518 P 8458d543d91d419986c2165ee5ebe948: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260808 14:46:39.831207 16838 raft_consensus.cc:348] T b8f39699643f4147ac9e4c93e5011518 P 8458d543d91d419986c2165ee5ebe948 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b7196cab33c42d983ecee895ab0f699" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38053 } } peers { permanent_uuid: "234c3248b7b848718a93f7a846301807" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44861 } } peers { permanent_uuid: "8458d543d91d419986c2165ee5ebe948" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 46373 } }
I20260808 14:46:39.831486 16833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:46:39.806796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.129:38053 (local address 127.0.0.1:42020)
0808 14:46:39.807239 (+ 443us) negotiation.cc:107] Waiting for socket to connect
0808 14:46:39.824314 (+ 17075us) client_negotiation.cc:174] Beginning negotiation
0808 14:46:39.824379 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:46:39.824664 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:46:39.824665 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:46:39.824668 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:46:39.824725 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:46:39.824727 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:46:39.826029 (+ 1302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:46:39.826030 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:46:39.827148 (+ 1118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:46:39.827152 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:46:39.831180 (+ 4028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:46:39.831181 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:46:39.831264 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:46:39.831270 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 14:46:39.831326 (+ 56us) client_negotiation.cc:240] Negotiation successful
0808 14:46:39.831387 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":410,"thread_start_us":106,"threads_started":1}
I20260808 14:46:39.831483 16838 raft_consensus.cc:374] T b8f39699643f4147ac9e4c93e5011518 P 8458d543d91d419986c2165ee5ebe948 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:46:39.831682 16838 raft_consensus.cc:729] T b8f39699643f4147ac9e4c93e5011518 P 8458d543d91d419986c2165ee5ebe948 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8458d543d91d419986c2165ee5ebe948, State: Initialized, Role: FOLLOWER
I20260808 14:46:39.831828 16835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:46:39.807084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42020 (local address 127.30.214.129:38053)
0808 14:46:39.824274 (+ 17190us) server_negotiation.cc:206] Beginning negotiation
0808 14:46:39.824280 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:46:39.824447 (+ 167us) server_negotiation.cc:407] Connection header received
0808 14:46:39.824486 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:46:39.824489 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:46:39.824506 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:46:39.824580 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:46:39.824801 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:46:39.825926 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:46:39.827255 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:46:39.828011 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:46:39.831038 (+ 3027us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:46:39.831136 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 14:46:39.831693 (+ 557us) server_negotiation.cc:299] Negotiation successful
0808 14:46:39.831751 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17143,"thread_start_us":55,"threads_started":1}
I20260808 14:46:39.831995 16838 consensus_queue.cc:260] T b8f39699643f4147ac9e4c93e5011518 P 8458d543d91d419986c2165ee5ebe948 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b7196cab33c42d983ecee895ab0f699" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38053 } } peers { permanent_uuid: "234c3248b7b848718a93f7a846301807" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44861 } } peers { permanent_uuid: "8458d543d91d419986c2165ee5ebe948" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 46373 } }
I20260808 14:46:39.832350 16838 ts_tablet_manager.cc:1428] T b8f39699643f4147ac9e4c93e5011518 P 8458d543d91d419986c2165ee5ebe948: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 14:46:39.832517 16587 heartbeater.cc:503] Master 127.30.214.190:33245 was elected leader, sending a full tablet report...
I20260808 14:46:39.832549 16258 tablet_service.cc:1467] Processing CreateTablet for tablet b8f39699643f4147ac9e4c93e5011518 (DEFAULT_TABLE table=test-table [id=f09b4d546793459c8c9c06f2604fba99]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:46:39.832931 16258 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8f39699643f4147ac9e4c93e5011518. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:46:39.840476 16847 tablet_bootstrap.cc:492] T b8f39699643f4147ac9e4c93e5011518 P 1b7196cab33c42d983ecee895ab0f699: Bootstrap starting.
I20260808 14:46:39.841290 16847 tablet_bootstrap.cc:654] T b8f39699643f4147ac9e4c93e5011518 P 1b7196cab33c42d983ecee895ab0f699: Neither blocks nor log segments found. Creating new log.
I20260808 14:46:39.841742 16847 log.cc:824] T b8f39699643f4147ac9e4c93e5011518 P 1b7196cab33c42d983ecee895ab0f699: Log is configured to *not* fsync() on all Append() calls
I20260808 14:46:39.842532 16847 tablet_bootstrap.cc:492] T b8f39699643f4147ac9e4c93e5011518 P 1b7196cab33c42d983ecee895ab0f699: No bootstrap required, opened a new log
I20260808 14:46:39.842597 16847 ts_tablet_manager.cc:1397] T b8f39699643f4147ac9e4c93e5011518 P 1b7196cab33c42d983ecee895ab0f699: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:46:39.844986 16847 raft_consensus.cc:348] T b8f39699643f4147ac9e4c93e5011518 P 1b7196cab33c42d983ecee895ab0f699 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b7196cab33c42d983ecee895ab0f699" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38053 } } peers { permanent_uuid: "234c3248b7b848718a93f7a846301807" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44861 } } peers { permanent_uuid: "8458d543d91d419986c2165ee5ebe948" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 46373 } }
I20260808 14:46:39.845149 16847 raft_consensus.cc:374] T b8f39699643f4147ac9e4c93e5011518 P 1b7196cab33c42d983ecee895ab0f699 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:46:39.845178 16847 raft_consensus.cc:729] T b8f39699643f4147ac9e4c93e5011518 P 1b7196cab33c42d983ecee895ab0f699 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b7196cab33c42d983ecee895ab0f699, State: Initialized, Role: FOLLOWER
I20260808 14:46:39.845469 16847 consensus_queue.cc:260] T b8f39699643f4147ac9e4c93e5011518 P 1b7196cab33c42d983ecee895ab0f699 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b7196cab33c42d983ecee895ab0f699" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38053 } } peers { permanent_uuid: "234c3248b7b848718a93f7a846301807" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44861 } } peers { permanent_uuid: "8458d543d91d419986c2165ee5ebe948" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 46373 } }
I20260808 14:46:39.845865 16847 ts_tablet_manager.cc:1428] T b8f39699643f4147ac9e4c93e5011518 P 1b7196cab33c42d983ecee895ab0f699: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 14:46:39.846024 16371 heartbeater.cc:503] Master 127.30.214.190:33245 was elected leader, sending a full tablet report...
Aug 08 14:46:39 dist-test-slave-42z9 krb5kdc[15265](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200399, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.190@KRBTEST.COM for HTTP/127.30.214.148@KRBTEST.COM
I20260808 14:46:39.991065 16844 raft_consensus.cc:482] T b8f39699643f4147ac9e4c93e5011518 P 234c3248b7b848718a93f7a846301807 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:46:39.991245 16844 raft_consensus.cc:504] T b8f39699643f4147ac9e4c93e5011518 P 234c3248b7b848718a93f7a846301807 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b7196cab33c42d983ecee895ab0f699" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38053 } } peers { permanent_uuid: "234c3248b7b848718a93f7a846301807" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44861 } } peers { permanent_uuid: "8458d543d91d419986c2165ee5ebe948" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 46373 } }
I20260808 14:46:39.991748 16844 leader_election.cc:288] T b8f39699643f4147ac9e4c93e5011518 P 234c3248b7b848718a93f7a846301807 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b7196cab33c42d983ecee895ab0f699 (127.30.214.129:38053), 8458d543d91d419986c2165ee5ebe948 (127.30.214.130:46373)
I20260808 14:46:39.995723 16815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:46:39.992013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.129:38053 (local address 127.30.214.131:51873)
0808 14:46:39.992129 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0808 14:46:39.992140 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:46:39.992206 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:46:39.992556 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:46:39.992557 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:46:39.992559 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:46:39.992630 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:46:39.992631 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:46:39.993566 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:46:39.993567 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:46:39.994702 (+ 1135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:46:39.994705 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:46:39.995481 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:46:39.995482 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:46:39.995551 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:46:39.995554 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:46:39.995610 (+ 56us) client_negotiation.cc:240] Negotiation successful
0808 14:46:39.995651 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":94}
W20260808 14:46:39.995922 16372 tablet.cc:2369] T b8f39699643f4147ac9e4c93e5011518 P 1b7196cab33c42d983ecee895ab0f699: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:46:39.996580 16835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:46:39.992317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:51873 (local address 127.30.214.129:38053)
0808 14:46:39.992407 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0808 14:46:39.992409 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:46:39.992418 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:46:39.992447 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:46:39.992448 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:46:39.992456 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:46:39.992503 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:46:39.992694 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:46:39.993467 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:46:39.994830 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:46:39.995367 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:46:39.995441 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:46:39.995451 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 14:46:39.996475 (+ 1024us) server_negotiation.cc:299] Negotiation successful
0808 14:46:39.996521 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 14:46:39.996814 16285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8f39699643f4147ac9e4c93e5011518" candidate_uuid: "234c3248b7b848718a93f7a846301807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b7196cab33c42d983ecee895ab0f699" is_pre_election: true
I20260808 14:46:39.996970 16285 raft_consensus.cc:2454] T b8f39699643f4147ac9e4c93e5011518 P 1b7196cab33c42d983ecee895ab0f699 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 234c3248b7b848718a93f7a846301807 in term 0.
I20260808 14:46:39.997033 16837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:46:39.993076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:55563 (local address 127.30.214.130:46373)
0808 14:46:39.993125 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 14:46:39.993126 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:46:39.993272 (+ 146us) server_negotiation.cc:407] Connection header received
0808 14:46:39.993366 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:46:39.993368 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:46:39.993376 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:46:39.993403 (+ 27us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:46:39.993663 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:46:39.994358 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:46:39.995714 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:46:39.996252 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:46:39.996296 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:46:39.996304 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 14:46:39.996915 (+ 611us) server_negotiation.cc:299] Negotiation successful
0808 14:46:39.996964 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 14:46:39.997206 16623 leader_election.cc:302] T b8f39699643f4147ac9e4c93e5011518 P 234c3248b7b848718a93f7a846301807 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b7196cab33c42d983ecee895ab0f699, 234c3248b7b848718a93f7a846301807; no voters:
I20260808 14:46:39.997334 16844 raft_consensus.cc:2781] T b8f39699643f4147ac9e4c93e5011518 P 234c3248b7b848718a93f7a846301807 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:46:39.997380 16844 raft_consensus.cc:482] T b8f39699643f4147ac9e4c93e5011518 P 234c3248b7b848718a93f7a846301807 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:46:39.997416 16844 raft_consensus.cc:3037] T b8f39699643f4147ac9e4c93e5011518 P 234c3248b7b848718a93f7a846301807 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:46:39.997637 16853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:46:39.992872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.130:46373 (local address 127.30.214.131:55563)
0808 14:46:39.993202 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0808 14:46:39.993213 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:46:39.993297 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:46:39.993498 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:46:39.993499 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:46:39.993501 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:46:39.993581 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:46:39.993583 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:46:39.994485 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:46:39.994486 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:46:39.995608 (+ 1122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:46:39.995611 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:46:39.996605 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:46:39.996606 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:46:39.996825 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:46:39.996830 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 14:46:39.997369 (+ 539us) client_negotiation.cc:240] Negotiation successful
0808 14:46:39.997540 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":311,"thread_start_us":96,"threads_started":1}
I20260808 14:46:39.998088 16521 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8f39699643f4147ac9e4c93e5011518" candidate_uuid: "234c3248b7b848718a93f7a846301807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8458d543d91d419986c2165ee5ebe948" is_pre_election: true
I20260808 14:46:39.998234 16521 raft_consensus.cc:2454] T b8f39699643f4147ac9e4c93e5011518 P 8458d543d91d419986c2165ee5ebe948 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 234c3248b7b848718a93f7a846301807 in term 0.
I20260808 14:46:39.998349 16844 raft_consensus.cc:504] T b8f39699643f4147ac9e4c93e5011518 P 234c3248b7b848718a93f7a846301807 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b7196cab33c42d983ecee895ab0f699" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38053 } } peers { permanent_uuid: "234c3248b7b848718a93f7a846301807" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44861 } } peers { permanent_uuid: "8458d543d91d419986c2165ee5ebe948" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 46373 } }
I20260808 14:46:39.998488 16844 leader_election.cc:288] T b8f39699643f4147ac9e4c93e5011518 P 234c3248b7b848718a93f7a846301807 [CANDIDATE]: Term 1 election: Requested vote from peers 1b7196cab33c42d983ecee895ab0f699 (127.30.214.129:38053), 8458d543d91d419986c2165ee5ebe948 (127.30.214.130:46373)
I20260808 14:46:39.998692 16521 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8f39699643f4147ac9e4c93e5011518" candidate_uuid: "234c3248b7b848718a93f7a846301807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8458d543d91d419986c2165ee5ebe948"
I20260808 14:46:39.998721 16285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8f39699643f4147ac9e4c93e5011518" candidate_uuid: "234c3248b7b848718a93f7a846301807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b7196cab33c42d983ecee895ab0f699"
I20260808 14:46:39.998790 16285 raft_consensus.cc:3037] T b8f39699643f4147ac9e4c93e5011518 P 1b7196cab33c42d983ecee895ab0f699 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:46:39.998767 16521 raft_consensus.cc:3037] T b8f39699643f4147ac9e4c93e5011518 P 8458d543d91d419986c2165ee5ebe948 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:46:39.999627 16285 raft_consensus.cc:2454] T b8f39699643f4147ac9e4c93e5011518 P 1b7196cab33c42d983ecee895ab0f699 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 234c3248b7b848718a93f7a846301807 in term 1.
I20260808 14:46:39.999717 16521 raft_consensus.cc:2454] T b8f39699643f4147ac9e4c93e5011518 P 8458d543d91d419986c2165ee5ebe948 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 234c3248b7b848718a93f7a846301807 in term 1.
I20260808 14:46:39.999794 16623 leader_election.cc:302] T b8f39699643f4147ac9e4c93e5011518 P 234c3248b7b848718a93f7a846301807 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b7196cab33c42d983ecee895ab0f699, 234c3248b7b848718a93f7a846301807; no voters:
I20260808 14:46:39.999872 16844 raft_consensus.cc:2781] T b8f39699643f4147ac9e4c93e5011518 P 234c3248b7b848718a93f7a846301807 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:46:40.000020 16844 raft_consensus.cc:686] T b8f39699643f4147ac9e4c93e5011518 P 234c3248b7b848718a93f7a846301807 [term 1 LEADER]: Becoming Leader. State: Replica: 234c3248b7b848718a93f7a846301807, State: Running, Role: LEADER
I20260808 14:46:40.000106 16844 consensus_queue.cc:237] T b8f39699643f4147ac9e4c93e5011518 P 234c3248b7b848718a93f7a846301807 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b7196cab33c42d983ecee895ab0f699" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38053 } } peers { permanent_uuid: "234c3248b7b848718a93f7a846301807" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44861 } } peers { permanent_uuid: "8458d543d91d419986c2165ee5ebe948" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 46373 } }
I20260808 14:46:40.000916 16027 catalog_manager.cc:5495] T b8f39699643f4147ac9e4c93e5011518 P 234c3248b7b848718a93f7a846301807 reported cstate change: term changed from 0 to 1, leader changed from <none> to 234c3248b7b848718a93f7a846301807 (127.30.214.131). New cstate: current_term: 1 leader_uuid: "234c3248b7b848718a93f7a846301807" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b7196cab33c42d983ecee895ab0f699" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "234c3248b7b848718a93f7a846301807" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 44861 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8458d543d91d419986c2165ee5ebe948" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 46373 } health_report { overall_health: UNKNOWN } } }
W20260808 14:46:40.018551 16814 tablet.cc:2369] T b8f39699643f4147ac9e4c93e5011518 P 234c3248b7b848718a93f7a846301807: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:46:40.022356 16588 tablet.cc:2369] T b8f39699643f4147ac9e4c93e5011518 P 8458d543d91d419986c2165ee5ebe948: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:46:40.046970 16836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:46:40.043720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34974 (local address 127.30.214.131:44861)
0808 14:46:40.043779 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0808 14:46:40.043782 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:46:40.043790 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:46:40.043832 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:46:40.043833 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:46:40.043854 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:46:40.043932 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:46:40.044079 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:46:40.044792 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:46:40.045987 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:46:40.046324 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:46:40.046389 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:46:40.046561 (+ 172us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:46:40.046720 (+ 159us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:46:40.046841 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0808 14:46:40.046862 (+ 21us) server_negotiation.cc:299] Negotiation successful
0808 14:46:40.046889 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 14:46:40.049405 16521 raft_consensus.cc:1261] T b8f39699643f4147ac9e4c93e5011518 P 8458d543d91d419986c2165ee5ebe948 [term 1 FOLLOWER]: Refusing update from remote peer 234c3248b7b848718a93f7a846301807: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:46:40.049499 16285 raft_consensus.cc:1261] T b8f39699643f4147ac9e4c93e5011518 P 1b7196cab33c42d983ecee895ab0f699 [term 1 FOLLOWER]: Refusing update from remote peer 234c3248b7b848718a93f7a846301807: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:46:40.049871 16859 consensus_queue.cc:1035] T b8f39699643f4147ac9e4c93e5011518 P 234c3248b7b848718a93f7a846301807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8458d543d91d419986c2165ee5ebe948" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 46373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:46:40.050010 16844 consensus_queue.cc:1035] T b8f39699643f4147ac9e4c93e5011518 P 234c3248b7b848718a93f7a846301807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b7196cab33c42d983ecee895ab0f699" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:46:40.059736 16865 mvcc.cc:205] Tried to move back new op lower bound from 7316276838599622656 to 7316276838400937984. Current Snapshot: MvccSnapshot[applied={T|T < 7316276838599622656}]
I20260808 14:46:40.060058 16864 mvcc.cc:205] Tried to move back new op lower bound from 7316276838599622656 to 7316276838400937984. Current Snapshot: MvccSnapshot[applied={T|T < 7316276838599622656}]
I20260808 14:46:40.060104 16870 mvcc.cc:205] Tried to move back new op lower bound from 7316276838599622656 to 7316276838400937984. Current Snapshot: MvccSnapshot[applied={T|T < 7316276838599622656}]
I20260808 14:46:40.063491 16025 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36790:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:46:40.063608 16025 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36790:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:46:40.064378 16025 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4f67219f3ca64874b87cf73eb6486897: Sending DeleteTablet for 3 replicas of tablet b8f39699643f4147ac9e4c93e5011518
I20260808 14:46:40.064756 16707 tablet_service.cc:1514] Processing DeleteTablet for tablet b8f39699643f4147ac9e4c93e5011518 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:46:40 UTC) from {username='kudu', principal='kudu/127.30.214.190@KRBTEST.COM'} at 127.0.0.1:34958
I20260808 14:46:40.064813 16459 tablet_service.cc:1514] Processing DeleteTablet for tablet b8f39699643f4147ac9e4c93e5011518 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:46:40 UTC) from {username='kudu', principal='kudu/127.30.214.190@KRBTEST.COM'} at 127.0.0.1:55416
I20260808 14:46:40.064936 16258 tablet_service.cc:1514] Processing DeleteTablet for tablet b8f39699643f4147ac9e4c93e5011518 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:46:40 UTC) from {username='kudu', principal='kudu/127.30.214.190@KRBTEST.COM'} at 127.0.0.1:42020
I20260808 14:46:40.065186 16888 tablet_replica.cc:330] T b8f39699643f4147ac9e4c93e5011518 P 1b7196cab33c42d983ecee895ab0f699: stopping tablet replica
I20260808 14:46:40.065287 16888 raft_consensus.cc:2229] T b8f39699643f4147ac9e4c93e5011518 P 1b7196cab33c42d983ecee895ab0f699 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:46:40.065408 16888 raft_consensus.cc:2258] T b8f39699643f4147ac9e4c93e5011518 P 1b7196cab33c42d983ecee895ab0f699 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:46:40.065521 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 16158
I20260808 14:46:40.072836 16887 tablet_replica.cc:330] T b8f39699643f4147ac9e4c93e5011518 P 8458d543d91d419986c2165ee5ebe948: stopping tablet replica
I20260808 14:46:40.073009 16887 raft_consensus.cc:2229] T b8f39699643f4147ac9e4c93e5011518 P 8458d543d91d419986c2165ee5ebe948 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:46:40.073167 16887 raft_consensus.cc:2258] T b8f39699643f4147ac9e4c93e5011518 P 8458d543d91d419986c2165ee5ebe948 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:46:40.079737 16886 tablet_replica.cc:330] T b8f39699643f4147ac9e4c93e5011518 P 234c3248b7b848718a93f7a846301807: stopping tablet replica
I20260808 14:46:40.079885 16886 raft_consensus.cc:2229] T b8f39699643f4147ac9e4c93e5011518 P 234c3248b7b848718a93f7a846301807 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:46:40.080011 16886 raft_consensus.cc:2258] T b8f39699643f4147ac9e4c93e5011518 P 234c3248b7b848718a93f7a846301807 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:46:40.083173 16886 ts_tablet_manager.cc:1905] T b8f39699643f4147ac9e4c93e5011518 P 234c3248b7b848718a93f7a846301807: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:46:40.090121 16886 ts_tablet_manager.cc:1918] T b8f39699643f4147ac9e4c93e5011518 P 234c3248b7b848718a93f7a846301807: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:46:40.090273 16886 log.cc:1196] T b8f39699643f4147ac9e4c93e5011518 P 234c3248b7b848718a93f7a846301807: Deleting WAL directory at /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/ts-2/wal/wals/b8f39699643f4147ac9e4c93e5011518
I20260808 14:46:40.090663 16886 ts_tablet_manager.cc:1939] T b8f39699643f4147ac9e4c93e5011518 P 234c3248b7b848718a93f7a846301807: Deleting consensus metadata
I20260808 14:46:40.130962 16887 ts_tablet_manager.cc:1905] T b8f39699643f4147ac9e4c93e5011518 P 8458d543d91d419986c2165ee5ebe948: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:46:40.132813 16887 ts_tablet_manager.cc:1918] T b8f39699643f4147ac9e4c93e5011518 P 8458d543d91d419986c2165ee5ebe948: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:46:40.132905 16887 log.cc:1196] T b8f39699643f4147ac9e4c93e5011518 P 8458d543d91d419986c2165ee5ebe948: Deleting WAL directory at /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786200295877777-31578-0/minicluster-data/ts-1/wal/wals/b8f39699643f4147ac9e4c93e5011518
I20260808 14:46:40.133198 16887 ts_tablet_manager.cc:1939] T b8f39699643f4147ac9e4c93e5011518 P 8458d543d91d419986c2165ee5ebe948: Deleting consensus metadata
I20260808 14:46:40.133723 16006 catalog_manager.cc:4841] TS 8458d543d91d419986c2165ee5ebe948 (127.30.214.130:46373): tablet b8f39699643f4147ac9e4c93e5011518 (table test-table [id=f09b4d546793459c8c9c06f2604fba99]) successfully deleted
I20260808 14:46:40.133831 16006 catalog_manager.cc:4841] TS 234c3248b7b848718a93f7a846301807 (127.30.214.131:44861): tablet b8f39699643f4147ac9e4c93e5011518 (table test-table [id=f09b4d546793459c8c9c06f2604fba99]) successfully deleted
W20260808 14:46:40.146766 16002 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.30.214.129:38053 (error 108)
I20260808 14:46:40.147028 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 16382
I20260808 14:46:40.150714 16833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:46:40.150583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.129:38053 (local address 127.0.0.1:42022)
0808 14:46:40.150630 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0808 14:46:40.150673 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.129:38053: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
W20260808 14:46:40.150900 16002 catalog_manager.cc:4584] TS 1b7196cab33c42d983ecee895ab0f699 (127.30.214.129:38053): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b8f39699643f4147ac9e4c93e5011518: Network error: Client connection negotiation failed: client connection to 127.30.214.129:38053: connect: Connection refused (error 111)
I20260808 14:46:40.155123 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 16594
I20260808 14:46:40.198355 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 15975
Aug 08 14:46:40 dist-test-slave-42z9 krb5kdc[15265](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200399, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.190@KRBTEST.COM for HTTP/127.30.214.148@KRBTEST.COM
I20260808 14:46:40.209672 31578 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260808 14:46:40.554421 31578 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260808 14:46:40.554536 31578 mini_ranger.cc:66] Stopping Ranger...
I20260808 14:46:40.898603 31578 mini_ranger.cc:68] Stopped Ranger
2026-08-08 14:46:40.898 UTC [15315] LOG: received smart shutdown request
2026-08-08 14:46:40.902 UTC [15315] LOG: background worker "logical replication launcher" (PID 15326) exited with exit code 1
2026-08-08 14:46:40.903 UTC [15319] LOG: shutting down
2026-08-08 14:46:41.042 UTC [15315] LOG: database system is shut down
2026-08-08T14:46:41Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (45779 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:46:41 dist-test-slave-42z9 krb5kdc[16906](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:46:41 dist-test-slave-42z9 krb5kdc[16906](info): set up 2 sockets
Aug 08 14:46:41 dist-test-slave-42z9 krb5kdc[16906](info): commencing operation
krb5kdc: starting...
W20260808 14:46:42.264973 31578 mini_kdc.cc:121] Time spent starting KDC: real 1.104s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Aug 08 14:46:42 dist-test-slave-42z9 krb5kdc[16906](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200402, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:46:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:46:42Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.30.214.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.30.214.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.30.214.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/krb5kdc/rangeradmin_127.30.214.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.30.214.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/krb5kdc/rangeradmin_127.30.214.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.30.214.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.30.214.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.30.214.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/krb5kdc/rangerlookup_127.30.214.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.30.214.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/krb5kdc/rangerlookup_127.30.214.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.30.214.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.30.214.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.30.214.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/krb5kdc/HTTP_127.30.214.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.30.214.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/krb5kdc/HTTP_127.30.214.148@KRBTEST.COM.keytab.
I20260808 14:46:42.428608 31578 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskT6IgCE/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/postgres -l logfile start
2026-08-08 14:46:44.668 UTC [16947] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-08 14:46:44.668 UTC [16947] LOG: listening on IPv4 address "127.30.214.148", port 44073
2026-08-08 14:46:44.671 UTC [16947] LOG: listening on Unix socket "/tmp/.s.PGSQL.44073"
2026-08-08 14:46:44.694 UTC [16953] LOG: database system was shut down at 2026-08-08 14:46:43 UTC
2026-08-08 14:46:44.698 UTC [16947] LOG: database system is ready to accept connections
I20260808 14:46:45.750108 31578 mini_postgres.cc:96] Postgres bound to 44073
2026-08-08 14:46:45.757 UTC [16966] FATAL: database "slave" does not exist
127.30.214.148:44073 - accepting connections
I20260808 14:46:45.757797 31578 mini_ranger.cc:161] Starting Ranger...
I20260808 14:46:45.773329 31578 mini_ranger.cc:84] Created miniranger Postgres user
I20260808 14:46:46.198716 31578 mini_ranger.cc:87] Created ranger Postgres database
I20260808 14:46:46.198788 31578 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ranger-admin
2026-08-08 14:46:46,483 [I] DB FLAVOR :POSTGRES
2026-08-08 14:46:46,483 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 14:46:46,483 [I] Checking connection..
2026-08-08 14:46:46,483 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskT6IgCE/build/release/bin/postgresql.jar:/tmp/dist-test-taskT6IgCE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.214.148:44073/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-08 14:46:46,746 [I] Checking connection passed.
2026-08-08 14:46:46,747 [I] --------- Verifying version history table ---------
2026-08-08 14:46:46,747 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskT6IgCE/build/release/bin/postgresql.jar:/tmp/dist-test-taskT6IgCE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.214.148:44073/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 14:46:47,019 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 14:46:47,019 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskT6IgCE/build/release/bin/postgresql.jar:/tmp/dist-test-taskT6IgCE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.214.148:44073/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 14:46:47,288 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 14:46:47,288 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-08 14:46:47,288 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskT6IgCE/build/release/bin/postgresql.jar:/tmp/dist-test-taskT6IgCE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.214.148:44073/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskT6IgCE/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-08 14:46:47.556 UTC [17071] WARNING: there is no transaction in progress
2026-08-08 14:46:47,563 [I] create_dbversion_catalog.sql file imported successfully
2026-08-08 14:46:47,563 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskT6IgCE/build/release/bin/postgresql.jar:/tmp/dist-test-taskT6IgCE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.214.148:44073/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 14:46:47,833 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-08 14:46:47,834 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 14:46:47,834 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskT6IgCE/build/release/bin/postgresql.jar:/tmp/dist-test-taskT6IgCE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.214.148:44073/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-08 14:46:48,105 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskT6IgCE/build/release/bin/postgresql.jar:/tmp/dist-test-taskT6IgCE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.214.148:44073/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-08 14:46:48,377 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskT6IgCE/build/release/bin/postgresql.jar:/tmp/dist-test-taskT6IgCE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.214.148:44073/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-42z9.c.gcp-upstream.internal','N') ;"
2026-08-08 14:46:48,617 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskT6IgCE/build/release/bin/postgresql.jar:/tmp/dist-test-taskT6IgCE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.214.148:44073/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 14:46:48,867 [I] Table x_portal_user does not exist in database ranger
2026-08-08 14:46:48,868 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskT6IgCE/build/release/bin/postgresql.jar:/tmp/dist-test-taskT6IgCE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.214.148:44073/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 14:46:49,135 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-08 14:46:49,135 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskT6IgCE/build/release/bin/postgresql.jar:/tmp/dist-test-taskT6IgCE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.214.148:44073/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 14:46:49,410 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskT6IgCE/build/release/bin/postgresql.jar:/tmp/dist-test-taskT6IgCE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.214.148:44073/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 14:46:49,675 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-08 14:46:49,675 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskT6IgCE/build/release/bin/postgresql.jar:/tmp/dist-test-taskT6IgCE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.214.148:44073/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskT6IgCE/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-08 14:46:50.728 UTC [17238] WARNING: there is no transaction in progress
2026-08-08 14:46:50.747 UTC [17238] WARNING: there is no transaction in progress
2026-08-08 14:46:50.765 UTC [17238] WARNING: there is no transaction in progress
2026-08-08 14:46:50.781 UTC [17238] WARNING: there is no transaction in progress
2026-08-08 14:46:50.798 UTC [17238] WARNING: there is no transaction in progress
2026-08-08 14:46:50.821 UTC [17238] WARNING: there is no transaction in progress
2026-08-08 14:46:50.881 UTC [17238] WARNING: there is no transaction in progress
2026-08-08 14:46:50.888 UTC [17238] WARNING: there is no transaction in progress
2026-08-08 14:46:50.904 UTC [17238] WARNING: there is no transaction in progress
2026-08-08 14:46:50.915 UTC [17238] WARNING: there is no transaction in progress
2026-08-08 14:46:50.926 UTC [17238] WARNING: there is no transaction in progress
2026-08-08 14:46:50.941 UTC [17238] WARNING: there is no transaction in progress
2026-08-08 14:46:50.952 UTC [17238] WARNING: there is no transaction in progress
2026-08-08 14:46:50.960 UTC [17238] WARNING: there is no transaction in progress
2026-08-08 14:46:50.968 UTC [17238] WARNING: there is no transaction in progress
2026-08-08 14:46:50.975 UTC [17238] WARNING: there is no transaction in progress
2026-08-08 14:46:51,579 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-08 14:46:51,580 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskT6IgCE/build/release/bin/postgresql.jar:/tmp/dist-test-taskT6IgCE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.214.148:44073/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-08 14:46:51,838 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-08 14:46:51,839 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskT6IgCE/build/release/bin/postgresql.jar:/tmp/dist-test-taskT6IgCE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.214.148:44073/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 14:46:52,110 [I] Table x_portal_user already exists in database 'ranger'
2026-08-08 14:46:52,110 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskT6IgCE/build/release/bin/postgresql.jar:/tmp/dist-test-taskT6IgCE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.214.148:44073/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 14:46:52,385 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-08 14:46:52,385 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskT6IgCE/build/release/bin/postgresql.jar:/tmp/dist-test-taskT6IgCE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.214.148:44073/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 14:46:52,655 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskT6IgCE/build/release/bin/postgresql.jar:/tmp/dist-test-taskT6IgCE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.214.148:44073/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 14:46:52,917 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskT6IgCE/build/release/bin/postgresql.jar:/tmp/dist-test-taskT6IgCE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.214.148:44073/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-42z9.c.gcp-upstream.internal';"
2026-08-08 14:46:53,181 [I] CORE_DB_SCHEMA import status has been updated
2026-08-08 14:46:53,182 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskT6IgCE/build/release/bin/postgresql.jar:/tmp/dist-test-taskT6IgCE/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.214.148:44073/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-08 14:46:53,443 [I] DB_PATCHES have already been applied
I20260808 14:46:53.449622 31578 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ranger-admin:/tmp/dist-test-taskT6IgCE/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskT6IgCE/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskT6IgCE/build/release/bin/postgresql.jar:/tmp/dist-test-taskT6IgCE/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260808 14:46:53.449693 31578 mini_ranger.cc:193] Using host: 127.30.214.148
I20260808 14:46:53.453809 31578 mini_ranger.cc:227] Ranger admin URL: http://127.30.214.148:35675
Aug 08, 2026 2:46:53 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 2:46:53 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 2:46:53 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ranger-admin/ews/webapp
Aug 08, 2026 2:46:53 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 08, 2026 2:46:53 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 08, 2026 2:46:54 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ranger-admin/ews/webapp].
Aug 08, 2026 2:46:54 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260808 14:46:54.721009 31578 mini_ranger.cc:160] Time spent starting Ranger: real 8.963s user 0.002s sys 0.009s
Aug 08, 2026 2:47:15 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 08, 2026 2:47:15 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 08, 2026 2:47:15 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 08, 2026 2:47:15 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 08, 2026 2:47:15 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 08, 2026 2:47:15 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 08, 2026 2:47:15 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 08, 2026 2:47:15 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 08, 2026 2:47:15 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 08, 2026 2:47:15 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 08, 2026 2:47:15 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 08, 2026 2:47:15 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 08, 2026 2:47:15 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 08, 2026 2:47:15 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 08, 2026 2:47:15 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 08, 2026 2:47:15 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 08, 2026 2:47:15 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 08, 2026 2:47:16 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260808 14:47:16.867380 31578 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.30.214.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.30.214.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.30.214.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/krb5kdc/rangerkms_127.30.214.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.30.214.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/krb5kdc/rangerkms_127.30.214.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.30.214.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.30.214.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.30.214.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/krb5kdc/HTTP_127.30.214.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.30.214.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/krb5kdc/HTTP_127.30.214.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 08 14:47:16 dist-test-slave-42z9 krb5kdc[16906](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200436, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260808 14:47:16.957038 31578 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260808 14:47:16.968488 31578 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260808 14:47:17.799618 31578 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260808 14:47:17.799690 31578 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ranger-kms
I20260808 14:47:17.799706 31578 mini_ranger_kms.cc:227] Using postgres at 127.30.214.148:44073
2026-08-08 14:47:17,968 [I] DB FLAVOR :POSTGRES
2026-08-08 14:47:17,969 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 14:47:17,969 [I] Checking connection
2026-08-08 14:47:17,969 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskT6IgCE/build/release/bin/postgresql.jar:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.214.148:44073/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-08 14:47:18,232 [I] connection success
2026-08-08 14:47:18,232 [I] --------- Verifying Ranger DB tables ---------
2026-08-08 14:47:18,232 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-08 14:47:18,233 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskT6IgCE/build/release/bin/postgresql.jar:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.214.148:44073/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-08 14:47:18,497 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-08 14:47:18,497 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 14:47:18,497 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-08 14:47:18,497 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskT6IgCE/build/release/bin/postgresql.jar:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.214.148:44073/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-08 14:47:18,757 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260808 14:47:19.253084 31578 mini_ranger_kms.cc:310] Created kms service
I20260808 14:47:19.468165 31578 mini_ranger_kms.cc:326] Created kudu user
I20260808 14:47:19.512508 31578 mini_ranger_kms.cc:343] Created rangerkms user
Aug 08 14:47:19 dist-test-slave-42z9 krb5kdc[16906](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200436, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.30.214.148@KRBTEST.COM
I20260808 14:47:19.886408 31578 mini_ranger_kms.cc:384] Added ranger policy
I20260808 14:47:19.886629 31578 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ranger-kms:/tmp/dist-test-taskT6IgCE/build/release/bin/postgresql.jar:/tmp/dist-test-taskT6IgCE/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskT6IgCE/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260808 14:47:19.886650 31578 mini_ranger_kms.cc:240] Using host: 127.30.214.148
I20260808 14:47:19.890880 31578 mini_ranger_kms.cc:276] Ranger KMS PID: 17548
I20260808 14:47:19.890965 31578 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.30.214.148:56741
Aug 08, 2026 2:47:20 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 2:47:20 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 2:47:21 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 08, 2026 2:47:21 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 08, 2026 2:47:21 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ranger-kms/ews/webapp].
Aug 08, 2026 2:47:21 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 08 14:47:22 dist-test-slave-42z9 krb5kdc[16906](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786200442, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.30.214.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:47:22.403573 31578 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.447s user 0.004s sys 0.151s
I20260808 14:47:22.403668 31578 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260808 14:47:22.403708 31578 mini_ranger_kms.cc:401] 127.30.214.148:56741/kms/v1/keys
Aug 08 14:47:22 dist-test-slave-42z9 krb5kdc[16906](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200442, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.30.214.148@KRBTEST.COM for HTTP/127.30.214.148@KRBTEST.COM
Aug 08 14:47:23 dist-test-slave-42z9 krb5kdc[16906](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200442, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.30.214.148@KRBTEST.COM for HTTP/127.30.214.148@KRBTEST.COM
Aug 08 14:47:25 dist-test-slave-42z9 krb5kdc[16906](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200445, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.30.214.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab.
Entry for principal kudu/127.30.214.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab.
I20260808 14:47:25.521102 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:37757
--webserver_interface=127.30.214.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab
--principal=kudu/127.30.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:41255
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.214.190:37757
--ranger_config_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.30.214.148:56741/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:47:25.606128 17634 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:47:25.606333 17634 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:47:25.606353 17634 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:47:25.607554 17634 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:47:25.607609 17634 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:47:25.607621 17634 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:47:25.607633 17634 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:47:25.607657 17634 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:47:25.609311 17634 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:41255
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/master-0/wal
--ranger_kms_url=127.30.214.148:56741/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.30.214.190:37757
--ranger_config_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab
--principal=kudu/127.30.214.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:37757
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17634
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:47:25.609745 17634 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:47:25.609972 17634 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:47:25.615176 17641 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:47:25.615324 17640 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:47:25.615198 17644 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:47:25.615487 17634 server_base.cc:1034] running on GCE node
I20260808 14:47:25.615783 17634 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:47:25.616078 17634 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:47:25.617246 17634 hybrid_clock.cc:648] HybridClock initialized: now 1786200445617233 us; error 34 us; skew 500 ppm
Aug 08 14:47:25 dist-test-slave-42z9 krb5kdc[16906](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200445, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:47:25.624169 17634 init.cc:377] Logged in from keytab as kudu/127.30.214.190@KRBTEST.COM (short username kudu)
I20260808 14:47:25.624676 17634 webserver.cc:460] Webserver started at http://127.30.214.190:33091/ using document root <none> and password file <none>
I20260808 14:47:25.624910 17634 fs_manager.cc:359] Metadata directory not provided
I20260808 14:47:25.624953 17634 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:47:25.625077 17634 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 14:47:25 dist-test-slave-42z9 krb5kdc[16906](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200445, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.190@KRBTEST.COM for HTTP/127.30.214.148@KRBTEST.COM
I20260808 14:47:25.674237 17634 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/master-0/data/instance:
uuid: "0fa7cf044bb74b63a4c9aaeacaa033a3"
format_stamp: "Formatted at 2026-08-08 14:47:25 on dist-test-slave-42z9"
server_key: "b95bef7e88e5ff923d0e35148f2aef29"
server_key_iv: "f8999c26220f72bfe06f9968e8761518"
server_key_version: "kuduclusterkey@0"
I20260808 14:47:25.674733 17634 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/master-0/wal/instance:
uuid: "0fa7cf044bb74b63a4c9aaeacaa033a3"
format_stamp: "Formatted at 2026-08-08 14:47:25 on dist-test-slave-42z9"
server_key: "b95bef7e88e5ff923d0e35148f2aef29"
server_key_iv: "f8999c26220f72bfe06f9968e8761518"
server_key_version: "kuduclusterkey@0"
I20260808 14:47:25.676590 17634 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260808 14:47:25.689234 17655 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:47:25.689499 17634 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:47:25.689606 17634 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/master-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/master-0/wal
uuid: "0fa7cf044bb74b63a4c9aaeacaa033a3"
format_stamp: "Formatted at 2026-08-08 14:47:25 on dist-test-slave-42z9"
server_key: "b95bef7e88e5ff923d0e35148f2aef29"
server_key_iv: "f8999c26220f72bfe06f9968e8761518"
server_key_version: "kuduclusterkey@0"
I20260808 14:47:25.689706 17634 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:47:25.709203 17634 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:47:25.711179 17634 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:47:25.711311 17634 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:47:25.716328 17634 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.190:37757
I20260808 14:47:25.716349 17739 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.190:37757 every 8 connection(s)
I20260808 14:47:25.716778 17634 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
I20260808 14:47:25.717585 17740 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:47:25.717680 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 17634
I20260808 14:47:25.717765 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/master-0/wal/instance
I20260808 14:47:25.717960 31578 external_mini_cluster.cc:1428] Setting key 9371c554a2cfd5b817241f3ea500c503
I20260808 14:47:25.721206 17740 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0fa7cf044bb74b63a4c9aaeacaa033a3: Bootstrap starting.
I20260808 14:47:25.722055 17740 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0fa7cf044bb74b63a4c9aaeacaa033a3: Neither blocks nor log segments found. Creating new log.
I20260808 14:47:25.722386 17740 log.cc:824] T 00000000000000000000000000000000 P 0fa7cf044bb74b63a4c9aaeacaa033a3: Log is configured to *not* fsync() on all Append() calls
I20260808 14:47:25.723129 17740 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0fa7cf044bb74b63a4c9aaeacaa033a3: No bootstrap required, opened a new log
I20260808 14:47:25.725581 17740 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0fa7cf044bb74b63a4c9aaeacaa033a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fa7cf044bb74b63a4c9aaeacaa033a3" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 37757 } }
I20260808 14:47:25.725780 17740 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0fa7cf044bb74b63a4c9aaeacaa033a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:47:25.725823 17740 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0fa7cf044bb74b63a4c9aaeacaa033a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fa7cf044bb74b63a4c9aaeacaa033a3, State: Initialized, Role: FOLLOWER
I20260808 14:47:25.726025 17740 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0fa7cf044bb74b63a4c9aaeacaa033a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fa7cf044bb74b63a4c9aaeacaa033a3" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 37757 } }
I20260808 14:47:25.726117 17740 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0fa7cf044bb74b63a4c9aaeacaa033a3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:47:25.726183 17740 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0fa7cf044bb74b63a4c9aaeacaa033a3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:47:25.726265 17740 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0fa7cf044bb74b63a4c9aaeacaa033a3 [term 0 FOLLOWER]: Advancing to term 1
Aug 08 14:47:25 dist-test-slave-42z9 krb5kdc[16906](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200445, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:47:25.727074 17740 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0fa7cf044bb74b63a4c9aaeacaa033a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fa7cf044bb74b63a4c9aaeacaa033a3" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 37757 } }
I20260808 14:47:25.727185 17740 leader_election.cc:302] T 00000000000000000000000000000000 P 0fa7cf044bb74b63a4c9aaeacaa033a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0fa7cf044bb74b63a4c9aaeacaa033a3; no voters:
I20260808 14:47:25.727372 17740 leader_election.cc:288] T 00000000000000000000000000000000 P 0fa7cf044bb74b63a4c9aaeacaa033a3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:47:25.727413 17748 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0fa7cf044bb74b63a4c9aaeacaa033a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:47:25.727629 17748 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0fa7cf044bb74b63a4c9aaeacaa033a3 [term 1 LEADER]: Becoming Leader. State: Replica: 0fa7cf044bb74b63a4c9aaeacaa033a3, State: Running, Role: LEADER
I20260808 14:47:25.727761 17740 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0fa7cf044bb74b63a4c9aaeacaa033a3 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:47:25.727766 17748 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0fa7cf044bb74b63a4c9aaeacaa033a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fa7cf044bb74b63a4c9aaeacaa033a3" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 37757 } }
I20260808 14:47:25.728189 17748 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0fa7cf044bb74b63a4c9aaeacaa033a3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0fa7cf044bb74b63a4c9aaeacaa033a3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fa7cf044bb74b63a4c9aaeacaa033a3" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 37757 } } }
I20260808 14:47:25.728346 17748 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0fa7cf044bb74b63a4c9aaeacaa033a3 [sys.catalog]: This master's current role is: LEADER
I20260808 14:47:25.728534 17748 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0fa7cf044bb74b63a4c9aaeacaa033a3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0fa7cf044bb74b63a4c9aaeacaa033a3. Latest consensus state: current_term: 1 leader_uuid: "0fa7cf044bb74b63a4c9aaeacaa033a3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fa7cf044bb74b63a4c9aaeacaa033a3" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 37757 } } }
I20260808 14:47:25.728646 17748 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0fa7cf044bb74b63a4c9aaeacaa033a3 [sys.catalog]: This master's current role is: LEADER
I20260808 14:47:25.728802 17758 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:47:25.729386 17758 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:47:25.729760 17740 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260808 14:47:25.736858 17746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:25.718679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51648 (local address 127.30.214.190:37757)
0808 14:47:25.718881 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0808 14:47:25.718892 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 14:47:25.718926 (+ 34us) server_negotiation.cc:407] Connection header received
0808 14:47:25.719487 (+ 561us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:47:25.719497 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:47:25.719561 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:47:25.719711 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:47:25.720588 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:25.722153 (+ 1565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:25.723307 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:25.723956 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:25.724077 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:25.727026 (+ 2949us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:47:25.727031 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:47:25.727031 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:47:25.727046 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:47:25.729039 (+ 1993us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:25.729498 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:25.729502 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:25.729502 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:25.729622 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:25.729848 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:25.729849 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:25.729849 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:25.730172 (+ 323us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:47:25.736252 (+ 6080us) server_negotiation.cc:1035] Waiting for connection context
0808 14:47:25.736378 (+ 126us) server_negotiation.cc:299] Negotiation successful
0808 14:47:25.736596 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":94,"threads_started":1}
I20260808 14:47:25.739673 17758 catalog_manager.cc:1347] Generated new cluster ID: 1c9c20a5bf2549f1ac1b2415dad7182d
I20260808 14:47:25.739741 17758 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:47:25.751341 17758 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:47:25.752208 17758 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:47:25.765799 17758 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0fa7cf044bb74b63a4c9aaeacaa033a3: Generated new TSK 0
I20260808 14:47:25.766117 17758 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.214.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab.
Entry for principal kudu/127.30.214.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab.
I20260808 14:47:26.552480 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.30.214.148:56741/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.129:0
--local_ip_for_outbound_sockets=127.30.214.129
--webserver_interface=127.30.214.129
--webserver_port=0
--tserver_master_addrs=127.30.214.190:37757
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab
--principal=kudu/127.30.214.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:41255
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:47:26.683074 17816 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:47:26.683424 17816 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:47:26.683468 17816 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:47:26.685374 17816 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:47:26.685552 17816 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:47:26.685672 17816 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.129
I20260808 14:47:26.688247 17816 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:41255
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.30.214.148:56741/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab
--principal=kudu/127.30.214.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.214.129
--webserver_port=0
--tserver_master_addrs=127.30.214.190:37757
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17816
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.129
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:47:26.688553 17816 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:47:26.688879 17816 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:47:26.695756 17821 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:47:26.695762 17830 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:47:26.695974 17822 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:47:26.696844 17816 server_base.cc:1034] running on GCE node
I20260808 14:47:26.697090 17816 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:47:26.697393 17816 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:47:26.700722 17816 hybrid_clock.cc:648] HybridClock initialized: now 1786200446700690 us; error 43 us; skew 500 ppm
Aug 08 14:47:26 dist-test-slave-42z9 krb5kdc[16906](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200446, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:47:26.704345 17816 init.cc:377] Logged in from keytab as kudu/127.30.214.129@KRBTEST.COM (short username kudu)
I20260808 14:47:26.704918 17816 webserver.cc:460] Webserver started at http://127.30.214.129:35533/ using document root <none> and password file <none>
I20260808 14:47:26.705250 17816 fs_manager.cc:359] Metadata directory not provided
I20260808 14:47:26.705319 17816 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:47:26.705492 17816 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 14:47:26 dist-test-slave-42z9 krb5kdc[16906](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200446, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.129@KRBTEST.COM for HTTP/127.30.214.148@KRBTEST.COM
I20260808 14:47:26.723166 17816 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-0/data/instance:
uuid: "93015d7f692e486fbe89e829b7059ab7"
format_stamp: "Formatted at 2026-08-08 14:47:26 on dist-test-slave-42z9"
server_key: "c512a682cff73f65382ae12dd4afafa0"
server_key_iv: "d738d6d01a41c626dfb186bb34adfdf5"
server_key_version: "kuduclusterkey@0"
I20260808 14:47:26.723743 17816 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-0/wal/instance:
uuid: "93015d7f692e486fbe89e829b7059ab7"
format_stamp: "Formatted at 2026-08-08 14:47:26 on dist-test-slave-42z9"
server_key: "c512a682cff73f65382ae12dd4afafa0"
server_key_iv: "d738d6d01a41c626dfb186bb34adfdf5"
server_key_version: "kuduclusterkey@0"
I20260808 14:47:26.729928 17816 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.000s
I20260808 14:47:26.751806 17848 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:47:26.752009 17816 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:47:26.752115 17816 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-0/wal
uuid: "93015d7f692e486fbe89e829b7059ab7"
format_stamp: "Formatted at 2026-08-08 14:47:26 on dist-test-slave-42z9"
server_key: "c512a682cff73f65382ae12dd4afafa0"
server_key_iv: "d738d6d01a41c626dfb186bb34adfdf5"
server_key_version: "kuduclusterkey@0"
I20260808 14:47:26.752226 17816 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:47:26.764324 17816 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:47:26.766993 17816 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:47:26.767238 17816 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:47:26.767607 17816 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:47:26.768070 17816 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:47:26.768174 17816 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:47:26.768280 17816 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:47:26.768356 17816 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:47:26.775985 17816 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.129:40919
I20260808 14:47:26.776578 17816 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
I20260808 14:47:26.777508 18029 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.129:40919 every 8 connection(s)
I20260808 14:47:26.785566 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 17816
I20260808 14:47:26.785676 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-0/wal/instance
I20260808 14:47:26.785858 31578 external_mini_cluster.cc:1428] Setting key ef388ca8e5dd154f1200cb07fe85858a
Aug 08 14:47:26 dist-test-slave-42z9 krb5kdc[16906](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200446, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.129@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:47:26.790925 18037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:26.778440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.129:53875 (local address 127.30.214.190:37757)
0808 14:47:26.778570 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0808 14:47:26.778572 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:47:26.778841 (+ 269us) server_negotiation.cc:407] Connection header received
0808 14:47:26.780449 (+ 1608us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:47:26.780451 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:47:26.780471 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:47:26.780568 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:47:26.781563 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:26.782321 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:26.783858 (+ 1537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:26.784149 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:26.784232 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:26.787319 (+ 3087us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:47:26.787320 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:47:26.787321 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:47:26.787330 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:47:26.789161 (+ 1831us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:26.789743 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:26.789744 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:26.789745 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:26.789813 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:26.790106 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:26.790108 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:26.790108 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:26.790253 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:47:26.790306 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 14:47:26.790725 (+ 419us) server_negotiation.cc:299] Negotiation successful
0808 14:47:26.790827 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96,"thread_start_us":57,"threads_started":1}
I20260808 14:47:26.791806 18038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:26.778425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:37757 (local address 127.30.214.129:53875)
0808 14:47:26.778657 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:26.778711 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 14:47:26.779395 (+ 684us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:47:26.780678 (+ 1283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:47:26.780684 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:47:26.780969 (+ 285us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:47:26.781390 (+ 421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:26.781397 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:26.782446 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:26.782448 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:26.783754 (+ 1306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:26.783757 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:26.784273 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:26.784274 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:26.784430 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:26.785062 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:47:26.785073 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:47:26.787195 (+ 2122us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:47:26.789266 (+ 2071us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:47:26.789276 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:47:26.789279 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:47:26.789652 (+ 373us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:47:26.789882 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:47:26.789883 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:47:26.789883 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:47:26.790029 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:47:26.790342 (+ 313us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:47:26.790351 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:47:26.790551 (+ 200us) client_negotiation.cc:769] Sending connection context
0808 14:47:26.791336 (+ 785us) client_negotiation.cc:240] Negotiation successful
0808 14:47:26.791530 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":107,"threads_started":1}
I20260808 14:47:26.792651 18034 heartbeater.cc:347] Connected to a master server at 127.30.214.190:37757
I20260808 14:47:26.792752 18034 heartbeater.cc:464] Registering TS with master...
I20260808 14:47:26.792959 18034 heartbeater.cc:511] Master 127.30.214.190:37757 requested a full tablet report, sending...
I20260808 14:47:26.793617 17680 ts_manager.cc:194] Registered new tserver with Master: 93015d7f692e486fbe89e829b7059ab7 (127.30.214.129:40919)
I20260808 14:47:26.794476 17680 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.214.129@KRBTEST.COM'} at 127.30.214.129:53875
WARNING: no policy specified for kudu/127.30.214.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab.
Entry for principal kudu/127.30.214.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab.
I20260808 14:47:26.860777 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.30.214.148:56741/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.130:0
--local_ip_for_outbound_sockets=127.30.214.130
--webserver_interface=127.30.214.130
--webserver_port=0
--tserver_master_addrs=127.30.214.190:37757
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab
--principal=kudu/127.30.214.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:41255
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 14:47:26 dist-test-slave-42z9 krb5kdc[16906](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786200446, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260808 14:47:27.023005 18048 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:47:27.023506 18048 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:47:27.023615 18048 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:47:27.025564 18048 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:47:27.025817 18048 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:47:27.025923 18048 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.130
I20260808 14:47:27.028354 18048 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:41255
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.30.214.148:56741/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab
--principal=kudu/127.30.214.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.214.130
--webserver_port=0
--tserver_master_addrs=127.30.214.190:37757
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18048
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.130
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:47:27.028929 18048 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:47:27.029301 18048 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:47:27.036269 18059 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:47:27.036728 18061 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:47:27.037233 18058 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:47:27.037696 18048 server_base.cc:1034] running on GCE node
I20260808 14:47:27.037927 18048 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:47:27.038183 18048 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:47:27.039340 18048 hybrid_clock.cc:648] HybridClock initialized: now 1786200447039325 us; error 31 us; skew 500 ppm
Aug 08 14:47:27 dist-test-slave-42z9 krb5kdc[16906](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200447, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:47:27.041937 18048 init.cc:377] Logged in from keytab as kudu/127.30.214.130@KRBTEST.COM (short username kudu)
I20260808 14:47:27.042444 18048 webserver.cc:460] Webserver started at http://127.30.214.130:40087/ using document root <none> and password file <none>
I20260808 14:47:27.042773 18048 fs_manager.cc:359] Metadata directory not provided
I20260808 14:47:27.042899 18048 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:47:27.043104 18048 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 14:47:27 dist-test-slave-42z9 krb5kdc[16906](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200447, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.130@KRBTEST.COM for HTTP/127.30.214.148@KRBTEST.COM
I20260808 14:47:27.063022 18048 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-1/data/instance:
uuid: "b67063b038464cce9936176f567b5a73"
format_stamp: "Formatted at 2026-08-08 14:47:27 on dist-test-slave-42z9"
server_key: "883f934384bdc74d6f899c4bae798829"
server_key_iv: "172b2a4bb26e6ae40c6418e4ddc47247"
server_key_version: "kuduclusterkey@0"
I20260808 14:47:27.065408 18048 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-1/wal/instance:
uuid: "b67063b038464cce9936176f567b5a73"
format_stamp: "Formatted at 2026-08-08 14:47:27 on dist-test-slave-42z9"
server_key: "883f934384bdc74d6f899c4bae798829"
server_key_iv: "172b2a4bb26e6ae40c6418e4ddc47247"
server_key_version: "kuduclusterkey@0"
I20260808 14:47:27.067684 18048 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260808 14:47:27.086536 18075 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:47:27.086798 18048 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.000s
I20260808 14:47:27.086891 18048 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-1/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-1/wal
uuid: "b67063b038464cce9936176f567b5a73"
format_stamp: "Formatted at 2026-08-08 14:47:27 on dist-test-slave-42z9"
server_key: "883f934384bdc74d6f899c4bae798829"
server_key_iv: "172b2a4bb26e6ae40c6418e4ddc47247"
server_key_version: "kuduclusterkey@0"
I20260808 14:47:27.086987 18048 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:47:27.130551 18048 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:47:27.132544 18048 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:47:27.132691 18048 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:47:27.132912 18048 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:47:27.133313 18048 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:47:27.133354 18048 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:47:27.133386 18048 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:47:27.133424 18048 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:47:27.140410 18048 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.130:38623
I20260808 14:47:27.140808 18048 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
I20260808 14:47:27.141522 18245 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.130:38623 every 8 connection(s)
I20260808 14:47:27.145674 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 18048
I20260808 14:47:27.145783 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-1/wal/instance
I20260808 14:47:27.145957 31578 external_mini_cluster.cc:1428] Setting key a215b969ae97ed6745a3b6618453a203
Aug 08 14:47:27 dist-test-slave-42z9 krb5kdc[16906](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200447, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.130@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.30.214.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.131@KRBTEST.COM" created.
I20260808 14:47:27.164870 18037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:27.141610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.130:46807 (local address 127.30.214.190:37757)
0808 14:47:27.141713 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0808 14:47:27.141715 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:47:27.142119 (+ 404us) server_negotiation.cc:407] Connection header received
0808 14:47:27.142832 (+ 713us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:47:27.142833 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:47:27.142850 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:47:27.142881 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:47:27.143750 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:27.144566 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:27.149318 (+ 4752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:27.149651 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:27.149699 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:27.154726 (+ 5027us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:47:27.154728 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:47:27.154729 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:47:27.154738 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:47:27.163021 (+ 8283us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:27.163661 (+ 640us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:27.163662 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:27.163663 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:27.163735 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:27.164019 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:27.164019 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:27.164020 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:27.164166 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:47:27.164221 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 14:47:27.164647 (+ 426us) server_negotiation.cc:299] Negotiation successful
0808 14:47:27.164753 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 14:47:27.165767 18249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:27.141819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:37757 (local address 127.30.214.130:46807)
0808 14:47:27.141983 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:27.142027 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 14:47:27.142699 (+ 672us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:47:27.143074 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:47:27.143078 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:47:27.143330 (+ 252us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:47:27.143630 (+ 300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:27.143637 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:27.144693 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:27.144694 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:27.149183 (+ 4489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:27.149188 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:27.149814 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:27.149814 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:27.149931 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:27.152384 (+ 2453us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:47:27.152399 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:47:27.154563 (+ 2164us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:47:27.163161 (+ 8598us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:47:27.163175 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:47:27.163179 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:47:27.163561 (+ 382us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:47:27.163798 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:47:27.163799 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:47:27.163799 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:47:27.163942 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:47:27.164247 (+ 305us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:47:27.164255 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:47:27.164442 (+ 187us) client_negotiation.cc:769] Sending connection context
0808 14:47:27.164549 (+ 107us) client_negotiation.cc:240] Negotiation successful
0808 14:47:27.165500 (+ 951us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":78,"threads_started":1}
I20260808 14:47:27.166479 18246 heartbeater.cc:347] Connected to a master server at 127.30.214.190:37757
I20260808 14:47:27.166584 18246 heartbeater.cc:464] Registering TS with master...
I20260808 14:47:27.166792 18246 heartbeater.cc:511] Master 127.30.214.190:37757 requested a full tablet report, sending...
I20260808 14:47:27.167184 17680 ts_manager.cc:194] Registered new tserver with Master: b67063b038464cce9936176f567b5a73 (127.30.214.130:38623)
I20260808 14:47:27.167634 17680 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.214.130@KRBTEST.COM'} at 127.30.214.130:46807
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab.
Entry for principal kudu/127.30.214.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab.
I20260808 14:47:27.181795 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.30.214.148:56741/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.131:0
--local_ip_for_outbound_sockets=127.30.214.131
--webserver_interface=127.30.214.131
--webserver_port=0
--tserver_master_addrs=127.30.214.190:37757
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab
--principal=kudu/127.30.214.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:41255
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:47:27.319798 18253 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:47:27.320171 18253 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:47:27.320256 18253 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:47:27.322116 18253 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:47:27.322387 18253 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:47:27.322484 18253 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.131
I20260808 14:47:27.324837 18253 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:41255
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.30.214.148:56741/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab
--principal=kudu/127.30.214.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.214.131
--webserver_port=0
--tserver_master_addrs=127.30.214.190:37757
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18253
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.131
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:47:27.325356 18253 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:47:27.325716 18253 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:47:27.332618 18265 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:47:27.332618 18270 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:47:27.333148 18264 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:47:27.334312 18253 server_base.cc:1034] running on GCE node
I20260808 14:47:27.334544 18253 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:47:27.334815 18253 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:47:27.335994 18253 hybrid_clock.cc:648] HybridClock initialized: now 1786200447335963 us; error 36 us; skew 500 ppm
Aug 08 14:47:27 dist-test-slave-42z9 krb5kdc[16906](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200447, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:47:27.339370 18253 init.cc:377] Logged in from keytab as kudu/127.30.214.131@KRBTEST.COM (short username kudu)
I20260808 14:47:27.339900 18253 webserver.cc:460] Webserver started at http://127.30.214.131:45761/ using document root <none> and password file <none>
I20260808 14:47:27.340157 18253 fs_manager.cc:359] Metadata directory not provided
I20260808 14:47:27.340206 18253 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:47:27.340333 18253 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 14:47:27 dist-test-slave-42z9 krb5kdc[16906](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200447, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.131@KRBTEST.COM for HTTP/127.30.214.148@KRBTEST.COM
I20260808 14:47:27.356096 18253 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-2/data/instance:
uuid: "7b5f92ff1175494aa169f3dd8c905df6"
format_stamp: "Formatted at 2026-08-08 14:47:27 on dist-test-slave-42z9"
server_key: "5990387f2041bab90943ca32f064c6ca"
server_key_iv: "0e03760d7c5624bc75e5e97d0d480063"
server_key_version: "kuduclusterkey@0"
I20260808 14:47:27.356762 18253 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-2/wal/instance:
uuid: "7b5f92ff1175494aa169f3dd8c905df6"
format_stamp: "Formatted at 2026-08-08 14:47:27 on dist-test-slave-42z9"
server_key: "5990387f2041bab90943ca32f064c6ca"
server_key_iv: "0e03760d7c5624bc75e5e97d0d480063"
server_key_version: "kuduclusterkey@0"
I20260808 14:47:27.367027 18253 fs_manager.cc:691] Time spent creating directory manager: real 0.010s user 0.002s sys 0.000s
I20260808 14:47:27.383034 18283 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:47:27.383319 18253 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 14:47:27.383419 18253 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-2/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-2/wal
uuid: "7b5f92ff1175494aa169f3dd8c905df6"
format_stamp: "Formatted at 2026-08-08 14:47:27 on dist-test-slave-42z9"
server_key: "5990387f2041bab90943ca32f064c6ca"
server_key_iv: "0e03760d7c5624bc75e5e97d0d480063"
server_key_version: "kuduclusterkey@0"
I20260808 14:47:27.383519 18253 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:47:27.436596 18253 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:47:27.439225 18253 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:47:27.439479 18253 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:47:27.439769 18253 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:47:27.440227 18253 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:47:27.440315 18253 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:47:27.440393 18253 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:47:27.440460 18253 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:47:27.447696 18253 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.131:40013
I20260808 14:47:27.448313 18253 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
I20260808 14:47:27.451304 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 18253
I20260808 14:47:27.451416 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-2/wal/instance
I20260808 14:47:27.451596 31578 external_mini_cluster.cc:1428] Setting key 73ba12550a6b90932369e018da4eece0
I20260808 14:47:27.451679 18453 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.131:40013 every 8 connection(s)
Aug 08 14:47:27 dist-test-slave-42z9 krb5kdc[16906](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200447, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.131@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:47:27.463763 18037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:27.451155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:52749 (local address 127.30.214.190:37757)
0808 14:47:27.451202 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 14:47:27.451204 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:47:27.452725 (+ 1521us) server_negotiation.cc:407] Connection header received
0808 14:47:27.453427 (+ 702us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:47:27.453428 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:47:27.453469 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:47:27.453498 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:47:27.454475 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:27.455219 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:27.456660 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:27.456981 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:27.457029 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:27.459975 (+ 2946us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:47:27.459976 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:47:27.459977 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:47:27.459985 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:47:27.461581 (+ 1596us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:27.462093 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:27.462094 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:27.462094 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:27.462154 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:27.462411 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:27.462412 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:27.462412 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:27.462566 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:47:27.462608 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0808 14:47:27.463579 (+ 971us) server_negotiation.cc:299] Negotiation successful
0808 14:47:27.463672 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 14:47:27.464797 18457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:27.450839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:37757 (local address 127.30.214.131:52749)
0808 14:47:27.452590 (+ 1751us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:27.452650 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0808 14:47:27.453308 (+ 658us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:47:27.453699 (+ 391us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:47:27.453703 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:47:27.454080 (+ 377us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:47:27.454372 (+ 292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:27.454378 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:27.455332 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:27.455333 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:27.456553 (+ 1220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:27.456557 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:27.457214 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:27.457215 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:27.457367 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:27.458065 (+ 698us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:47:27.458077 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:47:27.459853 (+ 1776us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:47:27.461679 (+ 1826us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:47:27.461688 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:47:27.461690 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:47:27.461992 (+ 302us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:47:27.462216 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:47:27.462217 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:47:27.462217 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:47:27.462345 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:47:27.463213 (+ 868us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:47:27.463220 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:47:27.463406 (+ 186us) client_negotiation.cc:769] Sending connection context
0808 14:47:27.464306 (+ 900us) client_negotiation.cc:240] Negotiation successful
0808 14:47:27.464496 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1704,"thread_start_us":108,"threads_started":1}
I20260808 14:47:27.465420 18454 heartbeater.cc:347] Connected to a master server at 127.30.214.190:37757
I20260808 14:47:27.465547 18454 heartbeater.cc:464] Registering TS with master...
I20260808 14:47:27.465742 18454 heartbeater.cc:511] Master 127.30.214.190:37757 requested a full tablet report, sending...
I20260808 14:47:27.466256 17680 ts_manager.cc:194] Registered new tserver with Master: 7b5f92ff1175494aa169f3dd8c905df6 (127.30.214.131:40013)
I20260808 14:47:27.466728 17680 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.214.131@KRBTEST.COM'} at 127.30.214.131:52749
I20260808 14:47:27.474083 31578 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:47:27.475018 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 17816
Aug 08 14:47:27 dist-test-slave-42z9 krb5kdc[16906](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200446, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.190@KRBTEST.COM for HTTP/127.30.214.148@KRBTEST.COM
I20260808 14:47:27.490531 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 18048
I20260808 14:47:27.522476 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 18253
I20260808 14:47:27.545078 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 17634
I20260808 14:47:27.617743 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:37757
--webserver_interface=127.30.214.190
--webserver_port=33091
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab
--principal=kudu/127.30.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:41255
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.214.190:37757
--ranger_config_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.30.214.148:56741/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.30.214.148:56741/kms with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:47:27.716068 18458 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:47:27.716313 18458 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:47:27.716336 18458 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:47:27.717617 18458 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:47:27.717670 18458 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:47:27.717684 18458 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:47:27.717695 18458 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:47:27.717718 18458 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:47:27.719492 18458 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:41255
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.30.214.148:56741/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.30.214.190:37757
--ranger_config_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab
--principal=kudu/127.30.214.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:37757
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.214.190
--webserver_port=33091
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18458
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:47:27.719755 18458 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:47:27.719991 18458 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:47:27.724946 18471 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:47:27.724928 18466 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:47:27.724952 18469 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:47:27.725262 18458 server_base.cc:1034] running on GCE node
I20260808 14:47:27.725569 18458 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:47:27.725893 18458 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:47:27.727077 18458 hybrid_clock.cc:648] HybridClock initialized: now 1786200447727061 us; error 30 us; skew 500 ppm
Aug 08 14:47:27 dist-test-slave-42z9 krb5kdc[16906](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200447, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:47:27.729823 18458 init.cc:377] Logged in from keytab as kudu/127.30.214.190@KRBTEST.COM (short username kudu)
I20260808 14:47:27.730320 18458 webserver.cc:460] Webserver started at http://127.30.214.190:33091/ using document root <none> and password file <none>
I20260808 14:47:27.730540 18458 fs_manager.cc:359] Metadata directory not provided
I20260808 14:47:27.730592 18458 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 14:47:27 dist-test-slave-42z9 krb5kdc[16906](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200447, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.190@KRBTEST.COM for HTTP/127.30.214.148@KRBTEST.COM
I20260808 14:47:27.769691 18458 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:47:27.770655 18483 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:47:27.770843 18458 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:47:27.770951 18458 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/master-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/master-0/wal
uuid: "0fa7cf044bb74b63a4c9aaeacaa033a3"
format_stamp: "Formatted at 2026-08-08 14:47:25 on dist-test-slave-42z9"
server_key: "b95bef7e88e5ff923d0e35148f2aef29"
server_key_iv: "f8999c26220f72bfe06f9968e8761518"
server_key_version: "kuduclusterkey@0"
I20260808 14:47:27.771340 18458 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:47:27.779011 18458 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:47:27.781121 18458 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:47:27.781250 18458 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:47:27.785533 18458 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.190:37757
I20260808 14:47:27.785559 18556 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.190:37757 every 8 connection(s)
I20260808 14:47:27.786010 18458 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
I20260808 14:47:27.787268 18559 sys_catalog.cc:263] Verifying existing consensus state
I20260808 14:47:27.787889 18559 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0fa7cf044bb74b63a4c9aaeacaa033a3: Bootstrap starting.
I20260808 14:47:27.795732 18559 log.cc:824] T 00000000000000000000000000000000 P 0fa7cf044bb74b63a4c9aaeacaa033a3: Log is configured to *not* fsync() on all Append() calls
I20260808 14:47:27.796079 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 18458
I20260808 14:47:27.796356 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.30.214.148:56741/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.129:40919
--local_ip_for_outbound_sockets=127.30.214.129
--tserver_master_addrs=127.30.214.190:37757
--webserver_port=35533
--webserver_interface=127.30.214.129
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab
--principal=kudu/127.30.214.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:41255
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.30.214.148:56741/kms with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:47:27.798115 18559 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0fa7cf044bb74b63a4c9aaeacaa033a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 14:47:27.798419 18559 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0fa7cf044bb74b63a4c9aaeacaa033a3: Bootstrap complete.
I20260808 14:47:27.800700 18559 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0fa7cf044bb74b63a4c9aaeacaa033a3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fa7cf044bb74b63a4c9aaeacaa033a3" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 37757 } }
I20260808 14:47:27.800998 18559 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0fa7cf044bb74b63a4c9aaeacaa033a3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fa7cf044bb74b63a4c9aaeacaa033a3, State: Initialized, Role: FOLLOWER
I20260808 14:47:27.801151 18559 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0fa7cf044bb74b63a4c9aaeacaa033a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fa7cf044bb74b63a4c9aaeacaa033a3" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 37757 } }
I20260808 14:47:27.801216 18559 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0fa7cf044bb74b63a4c9aaeacaa033a3 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:47:27.801267 18559 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0fa7cf044bb74b63a4c9aaeacaa033a3 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:47:27.801313 18559 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0fa7cf044bb74b63a4c9aaeacaa033a3 [term 1 FOLLOWER]: Advancing to term 2
I20260808 14:47:27.802359 18559 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0fa7cf044bb74b63a4c9aaeacaa033a3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fa7cf044bb74b63a4c9aaeacaa033a3" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 37757 } }
I20260808 14:47:27.802465 18559 leader_election.cc:302] T 00000000000000000000000000000000 P 0fa7cf044bb74b63a4c9aaeacaa033a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0fa7cf044bb74b63a4c9aaeacaa033a3; no voters:
I20260808 14:47:27.802650 18559 leader_election.cc:288] T 00000000000000000000000000000000 P 0fa7cf044bb74b63a4c9aaeacaa033a3 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 14:47:27.802702 18565 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0fa7cf044bb74b63a4c9aaeacaa033a3 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 14:47:27.802871 18565 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0fa7cf044bb74b63a4c9aaeacaa033a3 [term 2 LEADER]: Becoming Leader. State: Replica: 0fa7cf044bb74b63a4c9aaeacaa033a3, State: Running, Role: LEADER
I20260808 14:47:27.802929 18559 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0fa7cf044bb74b63a4c9aaeacaa033a3 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:47:27.803076 18565 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0fa7cf044bb74b63a4c9aaeacaa033a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fa7cf044bb74b63a4c9aaeacaa033a3" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 37757 } }
I20260808 14:47:27.803875 18567 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0fa7cf044bb74b63a4c9aaeacaa033a3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0fa7cf044bb74b63a4c9aaeacaa033a3. Latest consensus state: current_term: 2 leader_uuid: "0fa7cf044bb74b63a4c9aaeacaa033a3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fa7cf044bb74b63a4c9aaeacaa033a3" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 37757 } } }
I20260808 14:47:27.803972 18567 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0fa7cf044bb74b63a4c9aaeacaa033a3 [sys.catalog]: This master's current role is: LEADER
I20260808 14:47:27.803869 18569 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0fa7cf044bb74b63a4c9aaeacaa033a3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "0fa7cf044bb74b63a4c9aaeacaa033a3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fa7cf044bb74b63a4c9aaeacaa033a3" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 37757 } } }
I20260808 14:47:27.804133 18569 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0fa7cf044bb74b63a4c9aaeacaa033a3 [sys.catalog]: This master's current role is: LEADER
I20260808 14:47:27.804167 18588 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:47:27.804728 18588 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:47:27.804903 18588 catalog_manager.cc:1259] Loaded cluster ID: 1c9c20a5bf2549f1ac1b2415dad7182d
I20260808 14:47:27.804975 18588 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:47:27.805219 18559 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260808 14:47:27.806190 18588 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:47:27.806382 18588 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 0fa7cf044bb74b63a4c9aaeacaa033a3: Loaded TSK: 0
I20260808 14:47:27.806610 18588 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 14:47:27.915004 18564 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:47:27.915402 18564 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:47:27.915489 18564 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:47:27.917388 18564 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:47:27.917527 18564 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:47:27.917624 18564 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.129
I20260808 14:47:27.919979 18564 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:41255
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.30.214.148:56741/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab
--principal=kudu/127.30.214.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.129:40919
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.214.129
--webserver_port=35533
--tserver_master_addrs=127.30.214.190:37757
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18564
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.129
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:47:27.920511 18564 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:47:27.920883 18564 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:47:27.928311 18628 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:47:27.928525 18627 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:47:27.928376 18631 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:47:27.929244 18564 server_base.cc:1034] running on GCE node
I20260808 14:47:27.929508 18564 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:47:27.929804 18564 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:47:27.930987 18564 hybrid_clock.cc:648] HybridClock initialized: now 1786200447930967 us; error 33 us; skew 500 ppm
Aug 08 14:47:27 dist-test-slave-42z9 krb5kdc[16906](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200447, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:47:27.934594 18564 init.cc:377] Logged in from keytab as kudu/127.30.214.129@KRBTEST.COM (short username kudu)
I20260808 14:47:27.935146 18564 webserver.cc:460] Webserver started at http://127.30.214.129:35533/ using document root <none> and password file <none>
I20260808 14:47:27.935420 18564 fs_manager.cc:359] Metadata directory not provided
I20260808 14:47:27.935495 18564 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 14:47:27 dist-test-slave-42z9 krb5kdc[16906](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200447, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.129@KRBTEST.COM for HTTP/127.30.214.148@KRBTEST.COM
I20260808 14:47:27.965895 18564 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.001s sys 0.000s
I20260808 14:47:27.970165 18644 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:47:27.970448 18564 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.000s
I20260808 14:47:27.970567 18564 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-0/wal
uuid: "93015d7f692e486fbe89e829b7059ab7"
format_stamp: "Formatted at 2026-08-08 14:47:26 on dist-test-slave-42z9"
server_key: "c512a682cff73f65382ae12dd4afafa0"
server_key_iv: "d738d6d01a41c626dfb186bb34adfdf5"
server_key_version: "kuduclusterkey@0"
I20260808 14:47:27.970968 18564 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:47:27.990707 18564 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:47:27.992651 18564 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:47:27.992802 18564 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:47:27.993048 18564 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:47:27.993407 18564 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:47:27.993482 18564 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:47:27.993523 18564 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:47:27.993561 18564 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:47:28.000530 18564 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.129:40919
I20260808 14:47:28.000973 18564 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
I20260808 14:47:28.001595 18817 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.129:40919 every 8 connection(s)
I20260808 14:47:28.004016 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 18564
I20260808 14:47:28.004311 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.30.214.148:56741/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.130:38623
--local_ip_for_outbound_sockets=127.30.214.130
--tserver_master_addrs=127.30.214.190:37757
--webserver_port=40087
--webserver_interface=127.30.214.130
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab
--principal=kudu/127.30.214.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:41255
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.30.214.148:56741/kms with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 14:47:28 dist-test-slave-42z9 krb5kdc[16906](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200447, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.129@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:47:28.015470 18822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:28.001801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:37757 (local address 127.30.214.129:40969)
0808 14:47:28.002036 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:28.002068 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0808 14:47:28.002592 (+ 524us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:47:28.003187 (+ 595us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:47:28.003192 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:47:28.003384 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:47:28.003590 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:28.003594 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:28.005316 (+ 1722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:28.005318 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:28.006525 (+ 1207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:28.006528 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:28.007473 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:28.007475 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:28.007619 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:28.008174 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:47:28.008185 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:47:28.010784 (+ 2599us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:47:28.013166 (+ 2382us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:47:28.013176 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:47:28.013179 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:47:28.013564 (+ 385us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:47:28.014062 (+ 498us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:47:28.014063 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:47:28.014064 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:47:28.014217 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:47:28.014752 (+ 535us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:47:28.014759 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:47:28.014919 (+ 160us) client_negotiation.cc:769] Sending connection context
0808 14:47:28.015034 (+ 115us) client_negotiation.cc:240] Negotiation successful
0808 14:47:28.015214 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":75,"threads_started":1}
I20260808 14:47:28.016319 18824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:28.001926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.129:40969 (local address 127.30.214.190:37757)
0808 14:47:28.002181 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0808 14:47:28.002190 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:47:28.002230 (+ 40us) server_negotiation.cc:407] Connection header received
0808 14:47:28.002821 (+ 591us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:47:28.002828 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:47:28.002890 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:47:28.003726 (+ 836us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:47:28.003820 (+ 94us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:28.005185 (+ 1365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:28.006622 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:28.007246 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:28.007350 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:28.010944 (+ 3594us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:47:28.010950 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:47:28.010951 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:47:28.010966 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:47:28.013050 (+ 2084us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:28.013660 (+ 610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:28.013664 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:28.013665 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:28.013787 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:28.014299 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:28.014300 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:28.014300 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:28.014636 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:47:28.014719 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 14:47:28.015947 (+ 1228us) server_negotiation.cc:299] Negotiation successful
0808 14:47:28.016104 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":193,"thread_start_us":109,"threads_started":1}
I20260808 14:47:28.017637 18818 heartbeater.cc:347] Connected to a master server at 127.30.214.190:37757
I20260808 14:47:28.017746 18818 heartbeater.cc:464] Registering TS with master...
I20260808 14:47:28.017956 18818 heartbeater.cc:511] Master 127.30.214.190:37757 requested a full tablet report, sending...
W20260808 14:47:28.018997 18818 heartbeater.cc:644] Failed to heartbeat to 127.30.214.190:37757 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 14:47:28.019088 18818 heartbeater.cc:464] Registering TS with master...
I20260808 14:47:28.019157 18818 heartbeater.cc:511] Master 127.30.214.190:37757 requested a full tablet report, sending...
I20260808 14:47:28.019543 18818 heartbeater.cc:464] Registering TS with master...
I20260808 14:47:28.019627 18818 heartbeater.cc:511] Master 127.30.214.190:37757 requested a full tablet report, sending...
W20260808 14:47:28.019986 18818 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 14:47:28.150501 18825 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:47:28.150828 18825 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:47:28.150874 18825 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:47:28.152843 18825 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:47:28.152927 18825 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:47:28.152973 18825 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.130
I20260808 14:47:28.155568 18825 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:41255
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.30.214.148:56741/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab
--principal=kudu/127.30.214.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.130:38623
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.214.130
--webserver_port=40087
--tserver_master_addrs=127.30.214.190:37757
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18825
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.130
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:47:28.155925 18825 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:47:28.156250 18825 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 14:47:28.162703 18825 server_base.cc:1034] running on GCE node
W20260808 14:47:28.162863 18837 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:47:28.162894 18834 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:47:28.162935 18833 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:47:28.163295 18825 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:47:28.163616 18825 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:47:28.164808 18825 hybrid_clock.cc:648] HybridClock initialized: now 1786200448164793 us; error 31 us; skew 500 ppm
Aug 08 14:47:28 dist-test-slave-42z9 krb5kdc[16906](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200448, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:47:28.168107 18825 init.cc:377] Logged in from keytab as kudu/127.30.214.130@KRBTEST.COM (short username kudu)
I20260808 14:47:28.168746 18825 webserver.cc:460] Webserver started at http://127.30.214.130:40087/ using document root <none> and password file <none>
I20260808 14:47:28.169152 18825 fs_manager.cc:359] Metadata directory not provided
I20260808 14:47:28.169250 18825 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 14:47:28 dist-test-slave-42z9 krb5kdc[16906](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200448, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.130@KRBTEST.COM for HTTP/127.30.214.148@KRBTEST.COM
I20260808 14:47:28.192124 18825 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:47:28.193025 18850 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:47:28.193214 18825 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 14:47:28.193297 18825 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-1/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-1/wal
uuid: "b67063b038464cce9936176f567b5a73"
format_stamp: "Formatted at 2026-08-08 14:47:27 on dist-test-slave-42z9"
server_key: "883f934384bdc74d6f899c4bae798829"
server_key_iv: "172b2a4bb26e6ae40c6418e4ddc47247"
server_key_version: "kuduclusterkey@0"
I20260808 14:47:28.193725 18825 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:47:28.208415 18825 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:47:28.210757 18825 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:47:28.211026 18825 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:47:28.211309 18825 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:47:28.211759 18825 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:47:28.211841 18825 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:47:28.211905 18825 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:47:28.211953 18825 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:47:28.219141 18825 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.130:38623
I20260808 14:47:28.219681 18825 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
I20260808 14:47:28.221675 19025 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.130:38623 every 8 connection(s)
Aug 08 14:47:28 dist-test-slave-42z9 krb5kdc[16906](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200448, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.130@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:47:28.230062 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 18825
I20260808 14:47:28.230372 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.30.214.148:56741/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.131:40013
--local_ip_for_outbound_sockets=127.30.214.131
--tserver_master_addrs=127.30.214.190:37757
--webserver_port=45761
--webserver_interface=127.30.214.131
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab
--principal=kudu/127.30.214.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:41255
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.30.214.148:56741/kms with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:47:28.230793 18824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:28.222348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.130:54011 (local address 127.30.214.190:37757)
0808 14:47:28.222408 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0808 14:47:28.222410 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:47:28.222645 (+ 235us) server_negotiation.cc:407] Connection header received
0808 14:47:28.223140 (+ 495us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:47:28.223142 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:47:28.223158 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:47:28.223210 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:47:28.223777 (+ 567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:28.224289 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:28.225502 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:28.225757 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:28.225795 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:28.227846 (+ 2051us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:47:28.227848 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:47:28.227849 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:47:28.227857 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:47:28.229147 (+ 1290us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:28.229633 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:28.229634 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:28.229635 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:28.229701 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:28.230005 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:28.230006 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:28.230006 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:28.230153 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:47:28.230200 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 14:47:28.230608 (+ 408us) server_negotiation.cc:299] Negotiation successful
0808 14:47:28.230707 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 14:47:28.231307 19028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:28.222335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:37757 (local address 127.30.214.130:54011)
0808 14:47:28.222507 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:28.222553 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 14:47:28.223040 (+ 487us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:47:28.223281 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:47:28.223285 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:47:28.223492 (+ 207us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:47:28.223688 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:28.223692 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:28.224385 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:28.224385 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:28.225351 (+ 966us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:28.225354 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:28.225893 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:28.225894 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:28.225997 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:28.226493 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:47:28.226502 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:47:28.227752 (+ 1250us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:47:28.229230 (+ 1478us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:47:28.229237 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:47:28.229241 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:47:28.229539 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:47:28.229774 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:47:28.229775 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:47:28.229775 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:47:28.229921 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:47:28.230249 (+ 328us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:47:28.230256 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:47:28.230445 (+ 189us) client_negotiation.cc:769] Sending connection context
0808 14:47:28.230890 (+ 445us) client_negotiation.cc:240] Negotiation successful
0808 14:47:28.231068 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":83,"threads_started":1}
I20260808 14:47:28.233240 19026 heartbeater.cc:347] Connected to a master server at 127.30.214.190:37757
I20260808 14:47:28.233355 19026 heartbeater.cc:464] Registering TS with master...
I20260808 14:47:28.233618 19026 heartbeater.cc:511] Master 127.30.214.190:37757 requested a full tablet report, sending...
W20260808 14:47:28.234392 19026 heartbeater.cc:644] Failed to heartbeat to 127.30.214.190:37757 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 14:47:28.234465 19026 heartbeater.cc:464] Registering TS with master...
I20260808 14:47:28.234529 19026 heartbeater.cc:511] Master 127.30.214.190:37757 requested a full tablet report, sending...
I20260808 14:47:28.234937 19026 heartbeater.cc:464] Registering TS with master...
I20260808 14:47:28.235018 19026 heartbeater.cc:511] Master 127.30.214.190:37757 requested a full tablet report, sending...
W20260808 14:47:28.235404 19026 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 14:47:28.354430 19030 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:47:28.354815 19030 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:47:28.354909 19030 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:47:28.356840 19030 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:47:28.356915 19030 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:47:28.356972 19030 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.131
I20260808 14:47:28.359443 19030 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:41255
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.30.214.148:56741/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab
--principal=kudu/127.30.214.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.131:40013
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.214.131
--webserver_port=45761
--tserver_master_addrs=127.30.214.190:37757
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19030
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.131
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:47:28.359903 19030 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:47:28.360255 19030 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:47:28.367441 19048 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:47:28.367528 19041 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:47:28.368564 19030 server_base.cc:1034] running on GCE node
W20260808 14:47:28.369599 19045 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:47:28.370043 19030 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:47:28.370386 19030 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:47:28.371563 19030 hybrid_clock.cc:648] HybridClock initialized: now 1786200448371512 us; error 59 us; skew 500 ppm
Aug 08 14:47:28 dist-test-slave-42z9 krb5kdc[16906](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200448, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:47:28.375597 19030 init.cc:377] Logged in from keytab as kudu/127.30.214.131@KRBTEST.COM (short username kudu)
I20260808 14:47:28.376458 19030 webserver.cc:460] Webserver started at http://127.30.214.131:45761/ using document root <none> and password file <none>
I20260808 14:47:28.376811 19030 fs_manager.cc:359] Metadata directory not provided
I20260808 14:47:28.376959 19030 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 14:47:28 dist-test-slave-42z9 krb5kdc[16906](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200448, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.131@KRBTEST.COM for HTTP/127.30.214.148@KRBTEST.COM
I20260808 14:47:28.399731 19030 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.000s
I20260808 14:47:28.400691 19061 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:47:28.400905 19030 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:47:28.401023 19030 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-2/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-2/wal
uuid: "7b5f92ff1175494aa169f3dd8c905df6"
format_stamp: "Formatted at 2026-08-08 14:47:27 on dist-test-slave-42z9"
server_key: "5990387f2041bab90943ca32f064c6ca"
server_key_iv: "0e03760d7c5624bc75e5e97d0d480063"
server_key_version: "kuduclusterkey@0"
I20260808 14:47:28.401549 19030 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:47:28.456349 19030 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:47:28.458626 19030 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:47:28.458798 19030 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:47:28.459115 19030 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:47:28.459543 19030 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:47:28.459604 19030 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:47:28.459635 19030 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:47:28.459712 19030 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:47:28.466581 19030 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.131:40013
I20260808 14:47:28.466754 19245 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.131:40013 every 8 connection(s)
I20260808 14:47:28.467072 19030 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
I20260808 14:47:28.471611 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 19030
Aug 08 14:47:28 dist-test-slave-42z9 krb5kdc[16906](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200448, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.131@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:47:28.478706 18824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:28.467857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:46817 (local address 127.30.214.190:37757)
0808 14:47:28.467930 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0808 14:47:28.467932 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:47:28.468127 (+ 195us) server_negotiation.cc:407] Connection header received
0808 14:47:28.468808 (+ 681us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:47:28.468810 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:47:28.468823 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:47:28.468916 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:47:28.469689 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:28.470427 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:28.471897 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:28.472209 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:28.472259 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:28.475122 (+ 2863us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:47:28.475124 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:47:28.475124 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:47:28.475133 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:47:28.476844 (+ 1711us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:28.477365 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:28.477366 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:28.477366 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:28.477426 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:28.477755 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:28.477756 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:28.477757 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:28.477878 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:47:28.477945 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 14:47:28.478302 (+ 357us) server_negotiation.cc:299] Negotiation successful
0808 14:47:28.478608 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 14:47:28.478703 19249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:28.467817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:37757 (local address 127.30.214.131:46817)
0808 14:47:28.467994 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:28.468045 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0808 14:47:28.468680 (+ 635us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:47:28.468997 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:47:28.469002 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:47:28.469250 (+ 248us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:47:28.469568 (+ 318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:28.469575 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:28.470544 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:28.470546 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:28.471786 (+ 1240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:28.471789 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:28.472541 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:28.472542 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:28.472655 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:28.473252 (+ 597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:47:28.473263 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:47:28.475015 (+ 1752us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:47:28.476936 (+ 1921us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:47:28.476946 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:47:28.476949 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:47:28.477268 (+ 319us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:47:28.477539 (+ 271us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:47:28.477540 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:47:28.477540 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:47:28.477685 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:47:28.477941 (+ 256us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:47:28.477948 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:47:28.478130 (+ 182us) client_negotiation.cc:769] Sending connection context
0808 14:47:28.478266 (+ 136us) client_negotiation.cc:240] Negotiation successful
0808 14:47:28.478449 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":73,"threads_started":1}
I20260808 14:47:28.479586 19246 heartbeater.cc:347] Connected to a master server at 127.30.214.190:37757
I20260808 14:47:28.479755 19246 heartbeater.cc:464] Registering TS with master...
I20260808 14:47:28.479982 19246 heartbeater.cc:511] Master 127.30.214.190:37757 requested a full tablet report, sending...
I20260808 14:47:28.480631 19252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:28.472370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51662 (local address 127.30.214.190:37757)
0808 14:47:28.472927 (+ 557us) server_negotiation.cc:206] Beginning negotiation
0808 14:47:28.472929 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:47:28.473152 (+ 223us) server_negotiation.cc:407] Connection header received
0808 14:47:28.473177 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:47:28.473177 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:47:28.473190 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:47:28.473244 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:47:28.474143 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:28.474746 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:28.475808 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:28.476087 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:28.476146 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:28.477606 (+ 1460us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:47:28.477607 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:47:28.477608 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:47:28.477621 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:47:28.479232 (+ 1611us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:28.479637 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:28.479638 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:28.479638 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:28.479704 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:28.479909 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:28.479910 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:28.479910 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:28.480048 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:47:28.480315 (+ 267us) server_negotiation.cc:1035] Waiting for connection context
0808 14:47:28.480444 (+ 129us) server_negotiation.cc:299] Negotiation successful
0808 14:47:28.480536 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":525,"thread_start_us":69,"threads_started":1}
W20260808 14:47:28.480779 19246 heartbeater.cc:644] Failed to heartbeat to 127.30.214.190:37757 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 14:47:28.480988 19246 heartbeater.cc:464] Registering TS with master...
I20260808 14:47:28.481101 19246 heartbeater.cc:511] Master 127.30.214.190:37757 requested a full tablet report, sending...
I20260808 14:47:28.481518 19246 heartbeater.cc:464] Registering TS with master...
I20260808 14:47:28.481606 19246 heartbeater.cc:511] Master 127.30.214.190:37757 requested a full tablet report, sending...
W20260808 14:47:28.481951 19246 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 08 14:47:28 dist-test-slave-42z9 krb5kdc[16906](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786200448, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:47:29.020210 18818 heartbeater.cc:464] Registering TS with master...
I20260808 14:47:29.020394 18818 heartbeater.cc:511] Master 127.30.214.190:37757 requested a full tablet report, sending...
I20260808 14:47:29.020924 18507 ts_manager.cc:194] Registered new tserver with Master: 93015d7f692e486fbe89e829b7059ab7 (127.30.214.129:40919)
I20260808 14:47:29.021967 18507 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.214.129@KRBTEST.COM'} at 127.30.214.129:40969
I20260808 14:47:29.235610 19026 heartbeater.cc:464] Registering TS with master...
I20260808 14:47:29.235790 19026 heartbeater.cc:511] Master 127.30.214.190:37757 requested a full tablet report, sending...
I20260808 14:47:29.236232 18507 ts_manager.cc:194] Registered new tserver with Master: b67063b038464cce9936176f567b5a73 (127.30.214.130:38623)
I20260808 14:47:29.236785 18507 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.214.130@KRBTEST.COM'} at 127.30.214.130:54011
Aug 08 14:47:29 dist-test-slave-42z9 krb5kdc[16906](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200448, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.190@KRBTEST.COM for HTTP/127.30.214.148@KRBTEST.COM
I20260808 14:47:29.482138 19246 heartbeater.cc:464] Registering TS with master...
I20260808 14:47:29.482321 19246 heartbeater.cc:511] Master 127.30.214.190:37757 requested a full tablet report, sending...
I20260808 14:47:29.482715 18507 ts_manager.cc:194] Registered new tserver with Master: 7b5f92ff1175494aa169f3dd8c905df6 (127.30.214.131:40013)
I20260808 14:47:29.483224 18507 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.214.131@KRBTEST.COM'} at 127.30.214.131:46817
I20260808 14:47:29.484683 31578 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:47:29.501320 19277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:29.493269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51672 (local address 127.30.214.190:37757)
0808 14:47:29.493414 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0808 14:47:29.493417 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:47:29.493504 (+ 87us) server_negotiation.cc:407] Connection header received
0808 14:47:29.493607 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:47:29.493608 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:47:29.493622 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:47:29.493694 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:47:29.494441 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:29.495231 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:29.496322 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:29.496615 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:29.496682 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:29.498301 (+ 1619us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:47:29.498303 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:47:29.498303 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:47:29.498312 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:47:29.500090 (+ 1778us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:29.500492 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:29.500494 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:29.500494 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:29.500560 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:29.500766 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:29.500767 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:29.500767 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:29.500902 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:47:29.500995 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0808 14:47:29.501131 (+ 136us) server_negotiation.cc:299] Negotiation successful
0808 14:47:29.501221 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":80,"threads_started":1}
I20260808 14:47:29.503806 18507 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51672:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:47:29.506191 18507 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:47:29.517386 19284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:29.509479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.130:38623 (local address 127.0.0.1:32994)
0808 14:47:29.510007 (+ 528us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:29.510039 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0808 14:47:29.510118 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:47:29.513338 (+ 3220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:47:29.513339 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:47:29.513342 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:47:29.513405 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:29.513407 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:29.514776 (+ 1369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:29.514777 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:29.516040 (+ 1263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:29.516043 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:29.517046 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:29.517048 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:29.517149 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:29.517166 (+ 17us) client_negotiation.cc:769] Sending connection context
0808 14:47:29.517219 (+ 53us) client_negotiation.cc:240] Negotiation successful
0808 14:47:29.517277 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":511,"mutex_wait_us":7,"thread_start_us":130,"threads_started":1}
I20260808 14:47:29.517477 19288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:29.509767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52600 (local address 127.30.214.129:40919)
0808 14:47:29.512816 (+ 3049us) server_negotiation.cc:206] Beginning negotiation
0808 14:47:29.512820 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:47:29.512831 (+ 11us) server_negotiation.cc:407] Connection header received
0808 14:47:29.512870 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:47:29.512872 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:47:29.512889 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:47:29.512995 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:47:29.513207 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:29.514345 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:29.516143 (+ 1798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:29.516921 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:29.516993 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:29.517063 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 14:47:29.517329 (+ 266us) server_negotiation.cc:299] Negotiation successful
0808 14:47:29.517373 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3013,"thread_start_us":68,"threads_started":1}
I20260808 14:47:29.518622 19287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:29.509579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32994 (local address 127.30.214.130:38623)
0808 14:47:29.513172 (+ 3593us) server_negotiation.cc:206] Beginning negotiation
0808 14:47:29.513177 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:47:29.513187 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:47:29.513218 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:47:29.513219 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:47:29.513235 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:47:29.513515 (+ 280us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:47:29.513596 (+ 81us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:29.514664 (+ 1068us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:29.516156 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:29.516921 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:29.518376 (+ 1455us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:29.518458 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 14:47:29.518485 (+ 27us) server_negotiation.cc:299] Negotiation successful
0808 14:47:29.518533 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3556,"thread_start_us":46,"threads_started":1}
I20260808 14:47:29.518944 19289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:29.509477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.129:40919 (local address 127.0.0.1:52600)
0808 14:47:29.509986 (+ 509us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:29.510045 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0808 14:47:29.510118 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:47:29.513010 (+ 2892us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:47:29.513014 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:47:29.513017 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:47:29.513114 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:29.513116 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:29.514437 (+ 1321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:29.514438 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:29.516034 (+ 1596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:29.516047 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:29.517102 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:29.517103 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:29.517166 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:29.517169 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:47:29.517236 (+ 67us) client_negotiation.cc:240] Negotiation successful
0808 14:47:29.517279 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":471,"thread_start_us":99,"threads_started":1}
I20260808 14:47:29.519994 18688 tablet_service.cc:1467] Processing CreateTablet for tablet 0b3f10e15e614df4854e99f25aefa6bf (DEFAULT_TABLE table=test-table [id=d1e4c634c0ea432bb2161478b14997ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:47:29.520192 18898 tablet_service.cc:1467] Processing CreateTablet for tablet 0b3f10e15e614df4854e99f25aefa6bf (DEFAULT_TABLE table=test-table [id=d1e4c634c0ea432bb2161478b14997ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:47:29.520395 18688 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0b3f10e15e614df4854e99f25aefa6bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:47:29.520574 18898 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0b3f10e15e614df4854e99f25aefa6bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:47:29.521890 19284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:29.509837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.131:40013 (local address 127.0.0.1:56792)
0808 14:47:29.517506 (+ 7669us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:29.517518 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:47:29.517565 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:47:29.518198 (+ 633us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:47:29.518199 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:47:29.518202 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:47:29.518243 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:29.518245 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:29.519494 (+ 1249us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:29.519495 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:29.520488 (+ 993us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:29.520491 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:29.521608 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:29.521609 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:29.521685 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:29.521689 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:47:29.521749 (+ 60us) client_negotiation.cc:240] Negotiation successful
0808 14:47:29.521798 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7656,"thread_start_us":79,"threads_started":1}
I20260808 14:47:29.522162 19290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:29.509927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56792 (local address 127.30.214.131:40013)
0808 14:47:29.512731 (+ 2804us) server_negotiation.cc:206] Beginning negotiation
0808 14:47:29.512737 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:47:29.517849 (+ 5112us) server_negotiation.cc:407] Connection header received
0808 14:47:29.517897 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:47:29.517900 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:47:29.517918 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:47:29.518015 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:47:29.518345 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:29.519392 (+ 1047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:29.520598 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:29.521368 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:29.521478 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:29.521537 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 14:47:29.522034 (+ 497us) server_negotiation.cc:299] Negotiation successful
0808 14:47:29.522087 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2758,"thread_start_us":50,"threads_started":1}
I20260808 14:47:29.522847 19108 tablet_service.cc:1467] Processing CreateTablet for tablet 0b3f10e15e614df4854e99f25aefa6bf (DEFAULT_TABLE table=test-table [id=d1e4c634c0ea432bb2161478b14997ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:47:29.523248 19108 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0b3f10e15e614df4854e99f25aefa6bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:47:29.524417 19293 tablet_bootstrap.cc:492] T 0b3f10e15e614df4854e99f25aefa6bf P b67063b038464cce9936176f567b5a73: Bootstrap starting.
I20260808 14:47:29.525166 19293 tablet_bootstrap.cc:654] T 0b3f10e15e614df4854e99f25aefa6bf P b67063b038464cce9936176f567b5a73: Neither blocks nor log segments found. Creating new log.
I20260808 14:47:29.525621 19293 log.cc:824] T 0b3f10e15e614df4854e99f25aefa6bf P b67063b038464cce9936176f567b5a73: Log is configured to *not* fsync() on all Append() calls
I20260808 14:47:29.526185 19292 tablet_bootstrap.cc:492] T 0b3f10e15e614df4854e99f25aefa6bf P 93015d7f692e486fbe89e829b7059ab7: Bootstrap starting.
I20260808 14:47:29.526940 19292 tablet_bootstrap.cc:654] T 0b3f10e15e614df4854e99f25aefa6bf P 93015d7f692e486fbe89e829b7059ab7: Neither blocks nor log segments found. Creating new log.
I20260808 14:47:29.527388 19292 log.cc:824] T 0b3f10e15e614df4854e99f25aefa6bf P 93015d7f692e486fbe89e829b7059ab7: Log is configured to *not* fsync() on all Append() calls
I20260808 14:47:29.527729 19295 tablet_bootstrap.cc:492] T 0b3f10e15e614df4854e99f25aefa6bf P 7b5f92ff1175494aa169f3dd8c905df6: Bootstrap starting.
I20260808 14:47:29.527968 19293 tablet_bootstrap.cc:492] T 0b3f10e15e614df4854e99f25aefa6bf P b67063b038464cce9936176f567b5a73: No bootstrap required, opened a new log
I20260808 14:47:29.528101 19293 ts_tablet_manager.cc:1397] T 0b3f10e15e614df4854e99f25aefa6bf P b67063b038464cce9936176f567b5a73: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20260808 14:47:29.528494 19295 tablet_bootstrap.cc:654] T 0b3f10e15e614df4854e99f25aefa6bf P 7b5f92ff1175494aa169f3dd8c905df6: Neither blocks nor log segments found. Creating new log.
I20260808 14:47:29.528841 19295 log.cc:824] T 0b3f10e15e614df4854e99f25aefa6bf P 7b5f92ff1175494aa169f3dd8c905df6: Log is configured to *not* fsync() on all Append() calls
I20260808 14:47:29.530071 19295 tablet_bootstrap.cc:492] T 0b3f10e15e614df4854e99f25aefa6bf P 7b5f92ff1175494aa169f3dd8c905df6: No bootstrap required, opened a new log
I20260808 14:47:29.530139 19295 ts_tablet_manager.cc:1397] T 0b3f10e15e614df4854e99f25aefa6bf P 7b5f92ff1175494aa169f3dd8c905df6: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:47:29.530915 19293 raft_consensus.cc:348] T 0b3f10e15e614df4854e99f25aefa6bf P b67063b038464cce9936176f567b5a73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b67063b038464cce9936176f567b5a73" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 38623 } } peers { permanent_uuid: "93015d7f692e486fbe89e829b7059ab7" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 40919 } } peers { permanent_uuid: "7b5f92ff1175494aa169f3dd8c905df6" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40013 } }
I20260808 14:47:29.531095 19293 raft_consensus.cc:374] T 0b3f10e15e614df4854e99f25aefa6bf P b67063b038464cce9936176f567b5a73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:47:29.531131 19293 raft_consensus.cc:729] T 0b3f10e15e614df4854e99f25aefa6bf P b67063b038464cce9936176f567b5a73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b67063b038464cce9936176f567b5a73, State: Initialized, Role: FOLLOWER
I20260808 14:47:29.531284 19293 consensus_queue.cc:260] T 0b3f10e15e614df4854e99f25aefa6bf P b67063b038464cce9936176f567b5a73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b67063b038464cce9936176f567b5a73" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 38623 } } peers { permanent_uuid: "93015d7f692e486fbe89e829b7059ab7" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 40919 } } peers { permanent_uuid: "7b5f92ff1175494aa169f3dd8c905df6" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40013 } }
I20260808 14:47:29.531608 19293 ts_tablet_manager.cc:1428] T 0b3f10e15e614df4854e99f25aefa6bf P b67063b038464cce9936176f567b5a73: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260808 14:47:29.531733 19026 heartbeater.cc:503] Master 127.30.214.190:37757 was elected leader, sending a full tablet report...
I20260808 14:47:29.532516 19295 raft_consensus.cc:348] T 0b3f10e15e614df4854e99f25aefa6bf P 7b5f92ff1175494aa169f3dd8c905df6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b67063b038464cce9936176f567b5a73" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 38623 } } peers { permanent_uuid: "93015d7f692e486fbe89e829b7059ab7" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 40919 } } peers { permanent_uuid: "7b5f92ff1175494aa169f3dd8c905df6" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40013 } }
I20260808 14:47:29.532667 19295 raft_consensus.cc:374] T 0b3f10e15e614df4854e99f25aefa6bf P 7b5f92ff1175494aa169f3dd8c905df6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:47:29.532694 19295 raft_consensus.cc:729] T 0b3f10e15e614df4854e99f25aefa6bf P 7b5f92ff1175494aa169f3dd8c905df6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b5f92ff1175494aa169f3dd8c905df6, State: Initialized, Role: FOLLOWER
I20260808 14:47:29.533717 19295 consensus_queue.cc:260] T 0b3f10e15e614df4854e99f25aefa6bf P 7b5f92ff1175494aa169f3dd8c905df6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b67063b038464cce9936176f567b5a73" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 38623 } } peers { permanent_uuid: "93015d7f692e486fbe89e829b7059ab7" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 40919 } } peers { permanent_uuid: "7b5f92ff1175494aa169f3dd8c905df6" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40013 } }
I20260808 14:47:29.534085 19295 ts_tablet_manager.cc:1428] T 0b3f10e15e614df4854e99f25aefa6bf P 7b5f92ff1175494aa169f3dd8c905df6: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
I20260808 14:47:29.534255 19246 heartbeater.cc:503] Master 127.30.214.190:37757 was elected leader, sending a full tablet report...
I20260808 14:47:29.536334 19292 tablet_bootstrap.cc:492] T 0b3f10e15e614df4854e99f25aefa6bf P 93015d7f692e486fbe89e829b7059ab7: No bootstrap required, opened a new log
I20260808 14:47:29.536445 19292 ts_tablet_manager.cc:1397] T 0b3f10e15e614df4854e99f25aefa6bf P 93015d7f692e486fbe89e829b7059ab7: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20260808 14:47:29.539009 19292 raft_consensus.cc:348] T 0b3f10e15e614df4854e99f25aefa6bf P 93015d7f692e486fbe89e829b7059ab7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b67063b038464cce9936176f567b5a73" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 38623 } } peers { permanent_uuid: "93015d7f692e486fbe89e829b7059ab7" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 40919 } } peers { permanent_uuid: "7b5f92ff1175494aa169f3dd8c905df6" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40013 } }
I20260808 14:47:29.539222 19292 raft_consensus.cc:374] T 0b3f10e15e614df4854e99f25aefa6bf P 93015d7f692e486fbe89e829b7059ab7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:47:29.539261 19292 raft_consensus.cc:729] T 0b3f10e15e614df4854e99f25aefa6bf P 93015d7f692e486fbe89e829b7059ab7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93015d7f692e486fbe89e829b7059ab7, State: Initialized, Role: FOLLOWER
I20260808 14:47:29.539556 19292 consensus_queue.cc:260] T 0b3f10e15e614df4854e99f25aefa6bf P 93015d7f692e486fbe89e829b7059ab7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b67063b038464cce9936176f567b5a73" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 38623 } } peers { permanent_uuid: "93015d7f692e486fbe89e829b7059ab7" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 40919 } } peers { permanent_uuid: "7b5f92ff1175494aa169f3dd8c905df6" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40013 } }
I20260808 14:47:29.539956 19292 ts_tablet_manager.cc:1428] T 0b3f10e15e614df4854e99f25aefa6bf P 93015d7f692e486fbe89e829b7059ab7: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 14:47:29.540009 18818 heartbeater.cc:503] Master 127.30.214.190:37757 was elected leader, sending a full tablet report...
Aug 08 14:47:29 dist-test-slave-42z9 krb5kdc[16906](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200448, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.190@KRBTEST.COM for HTTP/127.30.214.148@KRBTEST.COM
W20260808 14:47:29.718415 19247 tablet.cc:2369] T 0b3f10e15e614df4854e99f25aefa6bf P 7b5f92ff1175494aa169f3dd8c905df6: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:47:29.723172 19027 tablet.cc:2369] T 0b3f10e15e614df4854e99f25aefa6bf P b67063b038464cce9936176f567b5a73: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:47:29.738209 19300 raft_consensus.cc:482] T 0b3f10e15e614df4854e99f25aefa6bf P 7b5f92ff1175494aa169f3dd8c905df6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:47:29.738440 19300 raft_consensus.cc:504] T 0b3f10e15e614df4854e99f25aefa6bf P 7b5f92ff1175494aa169f3dd8c905df6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b67063b038464cce9936176f567b5a73" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 38623 } } peers { permanent_uuid: "93015d7f692e486fbe89e829b7059ab7" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 40919 } } peers { permanent_uuid: "7b5f92ff1175494aa169f3dd8c905df6" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40013 } }
I20260808 14:47:29.739035 19300 leader_election.cc:288] T 0b3f10e15e614df4854e99f25aefa6bf P 7b5f92ff1175494aa169f3dd8c905df6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b67063b038464cce9936176f567b5a73 (127.30.214.130:38623), 93015d7f692e486fbe89e829b7059ab7 (127.30.214.129:40919)
I20260808 14:47:29.744381 19288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:29.739944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:40043 (local address 127.30.214.129:40919)
0808 14:47:29.740055 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0808 14:47:29.740058 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:47:29.740532 (+ 474us) server_negotiation.cc:407] Connection header received
0808 14:47:29.740664 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:47:29.740666 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:47:29.740680 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:47:29.740712 (+ 32us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:47:29.740991 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:29.741868 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:29.743334 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:29.743904 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:29.743963 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:29.743976 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0808 14:47:29.744240 (+ 264us) server_negotiation.cc:299] Negotiation successful
0808 14:47:29.744291 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 14:47:29.744943 19308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:29.739465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.129:40919 (local address 127.30.214.131:40043)
0808 14:47:29.740434 (+ 969us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:29.740450 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:47:29.740572 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:47:29.740802 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:47:29.740804 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:47:29.740807 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:47:29.740913 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:29.740916 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:29.741983 (+ 1067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:29.741984 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:29.743224 (+ 1240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:29.743229 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:29.744067 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:29.744068 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:29.744153 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:29.744158 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 14:47:29.744770 (+ 612us) client_negotiation.cc:240] Negotiation successful
0808 14:47:29.744830 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":942,"thread_start_us":159,"threads_started":1}
I20260808 14:47:29.745549 18754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b3f10e15e614df4854e99f25aefa6bf" candidate_uuid: "7b5f92ff1175494aa169f3dd8c905df6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93015d7f692e486fbe89e829b7059ab7" is_pre_election: true
I20260808 14:47:29.745770 18754 raft_consensus.cc:2454] T 0b3f10e15e614df4854e99f25aefa6bf P 93015d7f692e486fbe89e829b7059ab7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b5f92ff1175494aa169f3dd8c905df6 in term 0.
I20260808 14:47:29.746184 19063 leader_election.cc:302] T 0b3f10e15e614df4854e99f25aefa6bf P 7b5f92ff1175494aa169f3dd8c905df6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b5f92ff1175494aa169f3dd8c905df6, 93015d7f692e486fbe89e829b7059ab7; no voters:
I20260808 14:47:29.746340 19300 raft_consensus.cc:2781] T 0b3f10e15e614df4854e99f25aefa6bf P 7b5f92ff1175494aa169f3dd8c905df6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:47:29.746387 19300 raft_consensus.cc:482] T 0b3f10e15e614df4854e99f25aefa6bf P 7b5f92ff1175494aa169f3dd8c905df6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:47:29.746408 19300 raft_consensus.cc:3037] T 0b3f10e15e614df4854e99f25aefa6bf P 7b5f92ff1175494aa169f3dd8c905df6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:47:29.747583 19300 raft_consensus.cc:504] T 0b3f10e15e614df4854e99f25aefa6bf P 7b5f92ff1175494aa169f3dd8c905df6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b67063b038464cce9936176f567b5a73" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 38623 } } peers { permanent_uuid: "93015d7f692e486fbe89e829b7059ab7" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 40919 } } peers { permanent_uuid: "7b5f92ff1175494aa169f3dd8c905df6" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40013 } }
I20260808 14:47:29.747736 19300 leader_election.cc:288] T 0b3f10e15e614df4854e99f25aefa6bf P 7b5f92ff1175494aa169f3dd8c905df6 [CANDIDATE]: Term 1 election: Requested vote from peers b67063b038464cce9936176f567b5a73 (127.30.214.130:38623), 93015d7f692e486fbe89e829b7059ab7 (127.30.214.129:40919)
I20260808 14:47:29.748167 18754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b3f10e15e614df4854e99f25aefa6bf" candidate_uuid: "7b5f92ff1175494aa169f3dd8c905df6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93015d7f692e486fbe89e829b7059ab7"
I20260808 14:47:29.748294 18754 raft_consensus.cc:3037] T 0b3f10e15e614df4854e99f25aefa6bf P 93015d7f692e486fbe89e829b7059ab7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:47:29.749296 18754 raft_consensus.cc:2454] T 0b3f10e15e614df4854e99f25aefa6bf P 93015d7f692e486fbe89e829b7059ab7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b5f92ff1175494aa169f3dd8c905df6 in term 1.
I20260808 14:47:29.749583 19063 leader_election.cc:302] T 0b3f10e15e614df4854e99f25aefa6bf P 7b5f92ff1175494aa169f3dd8c905df6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b5f92ff1175494aa169f3dd8c905df6, 93015d7f692e486fbe89e829b7059ab7; no voters:
I20260808 14:47:29.749740 19300 raft_consensus.cc:2781] T 0b3f10e15e614df4854e99f25aefa6bf P 7b5f92ff1175494aa169f3dd8c905df6 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:47:29.749929 19300 raft_consensus.cc:686] T 0b3f10e15e614df4854e99f25aefa6bf P 7b5f92ff1175494aa169f3dd8c905df6 [term 1 LEADER]: Becoming Leader. State: Replica: 7b5f92ff1175494aa169f3dd8c905df6, State: Running, Role: LEADER
I20260808 14:47:29.750017 19287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:29.740423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:40129 (local address 127.30.214.130:38623)
0808 14:47:29.740490 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0808 14:47:29.740492 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:47:29.746723 (+ 6231us) server_negotiation.cc:407] Connection header received
0808 14:47:29.746837 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:47:29.746839 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:47:29.746851 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:47:29.746880 (+ 29us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:47:29.747083 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:29.747760 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:29.748989 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:29.749579 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:29.749631 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:29.749656 (+ 25us) server_negotiation.cc:1035] Waiting for connection context
0808 14:47:29.749887 (+ 231us) server_negotiation.cc:299] Negotiation successful
0808 14:47:29.749943 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 14:47:29.750041 19300 consensus_queue.cc:237] T 0b3f10e15e614df4854e99f25aefa6bf P 7b5f92ff1175494aa169f3dd8c905df6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b67063b038464cce9936176f567b5a73" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 38623 } } peers { permanent_uuid: "93015d7f692e486fbe89e829b7059ab7" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 40919 } } peers { permanent_uuid: "7b5f92ff1175494aa169f3dd8c905df6" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40013 } }
I20260808 14:47:29.750262 19312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:29.740132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.130:38623 (local address 127.30.214.131:40129)
0808 14:47:29.746613 (+ 6481us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:29.746626 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:47:29.746761 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:47:29.746950 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:47:29.746951 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:47:29.746953 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:47:29.747019 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:29.747021 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:29.747872 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:29.747872 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:29.748872 (+ 1000us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:29.748875 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:29.749715 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:29.749716 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:29.749795 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:29.749800 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 14:47:29.750139 (+ 339us) client_negotiation.cc:240] Negotiation successful
0808 14:47:29.750184 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6455,"thread_start_us":133,"threads_started":1}
I20260808 14:47:29.750631 18952 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b3f10e15e614df4854e99f25aefa6bf" candidate_uuid: "7b5f92ff1175494aa169f3dd8c905df6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b67063b038464cce9936176f567b5a73" is_pre_election: true
I20260808 14:47:29.750820 18952 raft_consensus.cc:2454] T 0b3f10e15e614df4854e99f25aefa6bf P b67063b038464cce9936176f567b5a73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b5f92ff1175494aa169f3dd8c905df6 in term 0.
I20260808 14:47:29.750974 18951 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b3f10e15e614df4854e99f25aefa6bf" candidate_uuid: "7b5f92ff1175494aa169f3dd8c905df6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b67063b038464cce9936176f567b5a73"
I20260808 14:47:29.751036 18951 raft_consensus.cc:3037] T 0b3f10e15e614df4854e99f25aefa6bf P b67063b038464cce9936176f567b5a73 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:47:29.751119 18505 catalog_manager.cc:5495] T 0b3f10e15e614df4854e99f25aefa6bf P 7b5f92ff1175494aa169f3dd8c905df6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7b5f92ff1175494aa169f3dd8c905df6 (127.30.214.131). New cstate: current_term: 1 leader_uuid: "7b5f92ff1175494aa169f3dd8c905df6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b67063b038464cce9936176f567b5a73" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 38623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93015d7f692e486fbe89e829b7059ab7" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 40919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b5f92ff1175494aa169f3dd8c905df6" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40013 } health_report { overall_health: HEALTHY } } }
I20260808 14:47:29.752002 18951 raft_consensus.cc:2454] T 0b3f10e15e614df4854e99f25aefa6bf P b67063b038464cce9936176f567b5a73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b5f92ff1175494aa169f3dd8c905df6 in term 1.
W20260808 14:47:29.752931 18820 tablet.cc:2369] T 0b3f10e15e614df4854e99f25aefa6bf P 93015d7f692e486fbe89e829b7059ab7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:47:29.798413 19290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:29.795882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51934 (local address 127.30.214.131:40013)
0808 14:47:29.795935 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 14:47:29.795937 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:47:29.795945 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:47:29.795990 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:47:29.795991 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:47:29.796012 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:47:29.796092 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:47:29.796249 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:29.796767 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:29.797627 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:29.797849 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:29.797928 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:29.798069 (+ 141us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:47:29.798186 (+ 117us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:47:29.798257 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 14:47:29.798297 (+ 40us) server_negotiation.cc:299] Negotiation successful
0808 14:47:29.798323 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 14:47:29.800433 18754 raft_consensus.cc:1261] T 0b3f10e15e614df4854e99f25aefa6bf P 93015d7f692e486fbe89e829b7059ab7 [term 1 FOLLOWER]: Refusing update from remote peer 7b5f92ff1175494aa169f3dd8c905df6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:47:29.800494 18951 raft_consensus.cc:1261] T 0b3f10e15e614df4854e99f25aefa6bf P b67063b038464cce9936176f567b5a73 [term 1 FOLLOWER]: Refusing update from remote peer 7b5f92ff1175494aa169f3dd8c905df6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:47:29.800909 19300 consensus_queue.cc:1035] T 0b3f10e15e614df4854e99f25aefa6bf P 7b5f92ff1175494aa169f3dd8c905df6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93015d7f692e486fbe89e829b7059ab7" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 40919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:47:29.801113 19300 consensus_queue.cc:1035] T 0b3f10e15e614df4854e99f25aefa6bf P 7b5f92ff1175494aa169f3dd8c905df6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b67063b038464cce9936176f567b5a73" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 38623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:47:29.806021 19318 mvcc.cc:205] Tried to move back new op lower bound from 7316277042379378688 to 7316277042176786432. Current Snapshot: MvccSnapshot[applied={T|T < 7316277042379378688}]
I20260808 14:47:29.808050 19322 mvcc.cc:205] Tried to move back new op lower bound from 7316277042379378688 to 7316277042176786432. Current Snapshot: MvccSnapshot[applied={T|T < 7316277042379378688}]
I20260808 14:47:29.812573 18505 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51672:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:47:29.812737 18505 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51672:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:47:29.814075 18505 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0fa7cf044bb74b63a4c9aaeacaa033a3: Sending DeleteTablet for 3 replicas of tablet 0b3f10e15e614df4854e99f25aefa6bf
I20260808 14:47:29.814779 18898 tablet_service.cc:1514] Processing DeleteTablet for tablet 0b3f10e15e614df4854e99f25aefa6bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:47:29 UTC) from {username='kudu', principal='kudu/127.30.214.190@KRBTEST.COM'} at 127.0.0.1:32994
I20260808 14:47:29.815125 18688 tablet_service.cc:1514] Processing DeleteTablet for tablet 0b3f10e15e614df4854e99f25aefa6bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:47:29 UTC) from {username='kudu', principal='kudu/127.30.214.190@KRBTEST.COM'} at 127.0.0.1:52600
I20260808 14:47:29.815608 19108 tablet_service.cc:1514] Processing DeleteTablet for tablet 0b3f10e15e614df4854e99f25aefa6bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:47:29 UTC) from {username='kudu', principal='kudu/127.30.214.190@KRBTEST.COM'} at 127.0.0.1:56792
I20260808 14:47:29.816563 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 18564
I20260808 14:47:29.832912 19335 tablet_replica.cc:330] T 0b3f10e15e614df4854e99f25aefa6bf P 7b5f92ff1175494aa169f3dd8c905df6: stopping tablet replica
I20260808 14:47:29.833177 19335 raft_consensus.cc:2229] T 0b3f10e15e614df4854e99f25aefa6bf P 7b5f92ff1175494aa169f3dd8c905df6 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:47:29.833498 19335 raft_consensus.cc:2258] T 0b3f10e15e614df4854e99f25aefa6bf P 7b5f92ff1175494aa169f3dd8c905df6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:47:29.833807 19333 tablet_replica.cc:330] T 0b3f10e15e614df4854e99f25aefa6bf P b67063b038464cce9936176f567b5a73: stopping tablet replica
I20260808 14:47:29.834317 19335 ts_tablet_manager.cc:1905] T 0b3f10e15e614df4854e99f25aefa6bf P 7b5f92ff1175494aa169f3dd8c905df6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:47:29.836202 19335 ts_tablet_manager.cc:1918] T 0b3f10e15e614df4854e99f25aefa6bf P 7b5f92ff1175494aa169f3dd8c905df6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:47:29.836374 19335 log.cc:1196] T 0b3f10e15e614df4854e99f25aefa6bf P 7b5f92ff1175494aa169f3dd8c905df6: Deleting WAL directory at /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-2/wal/wals/0b3f10e15e614df4854e99f25aefa6bf
I20260808 14:47:29.836777 19335 ts_tablet_manager.cc:1939] T 0b3f10e15e614df4854e99f25aefa6bf P 7b5f92ff1175494aa169f3dd8c905df6: Deleting consensus metadata
I20260808 14:47:29.837402 18486 catalog_manager.cc:4841] TS 7b5f92ff1175494aa169f3dd8c905df6 (127.30.214.131:40013): tablet 0b3f10e15e614df4854e99f25aefa6bf (table test-table [id=d1e4c634c0ea432bb2161478b14997ed]) successfully deleted
W20260808 14:47:29.838765 18484 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.30.214.129:40919 (error 108)
I20260808 14:47:29.839170 19333 raft_consensus.cc:2229] T 0b3f10e15e614df4854e99f25aefa6bf P b67063b038464cce9936176f567b5a73 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:47:29.839511 19333 raft_consensus.cc:2258] T 0b3f10e15e614df4854e99f25aefa6bf P b67063b038464cce9936176f567b5a73 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:47:29.840019 19333 ts_tablet_manager.cc:1905] T 0b3f10e15e614df4854e99f25aefa6bf P b67063b038464cce9936176f567b5a73: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260808 14:47:29.841465 19284 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:47:29.839205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.129:40919 (local address 127.0.0.1:47918)
0808 14:47:29.839252 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:29.839264 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:47:29.839311 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:47:29.841387 (+ 2076us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.129:40919: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":24}
W20260808 14:47:29.841616 18484 catalog_manager.cc:4584] TS 93015d7f692e486fbe89e829b7059ab7 (127.30.214.129:40919): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 0b3f10e15e614df4854e99f25aefa6bf: Network error: Client connection negotiation failed: client connection to 127.30.214.129:40919: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 14:47:29.841881 19333 ts_tablet_manager.cc:1918] T 0b3f10e15e614df4854e99f25aefa6bf P b67063b038464cce9936176f567b5a73: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:47:29.842005 19333 log.cc:1196] T 0b3f10e15e614df4854e99f25aefa6bf P b67063b038464cce9936176f567b5a73: Deleting WAL directory at /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786200295877777-31578-0/minicluster-data/ts-1/wal/wals/0b3f10e15e614df4854e99f25aefa6bf
I20260808 14:47:29.842366 19333 ts_tablet_manager.cc:1939] T 0b3f10e15e614df4854e99f25aefa6bf P b67063b038464cce9936176f567b5a73: Deleting consensus metadata
I20260808 14:47:29.842911 18487 catalog_manager.cc:4841] TS b67063b038464cce9936176f567b5a73 (127.30.214.130:38623): tablet 0b3f10e15e614df4854e99f25aefa6bf (table test-table [id=d1e4c634c0ea432bb2161478b14997ed]) successfully deleted
I20260808 14:47:29.843488 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 18825
I20260808 14:47:29.863960 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 19030
I20260808 14:47:29.875540 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 18458
I20260808 14:47:29.889515 31578 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260808 14:47:30.238472 31578 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260808 14:47:30.238571 31578 mini_ranger.cc:66] Stopping Ranger...
I20260808 14:47:30.584338 31578 mini_ranger.cc:68] Stopped Ranger
2026-08-08 14:47:30.584 UTC [16947] LOG: received smart shutdown request
2026-08-08 14:47:30.589 UTC [16947] LOG: background worker "logical replication launcher" (PID 16962) exited with exit code 1
2026-08-08 14:47:30.589 UTC [16955] LOG: shutting down
2026-08-08 14:47:30.741 UTC [16947] LOG: database system is shut down
2026-08-08T14:47:30Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (49697 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200295877777-31578-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:47:30 dist-test-slave-42z9 krb5kdc[19355](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:47:30 dist-test-slave-42z9 krb5kdc[19355](info): set up 2 sockets
Aug 08 14:47:30 dist-test-slave-42z9 krb5kdc[19355](info): commencing operation
krb5kdc: starting...
W20260808 14:47:31.980827 31578 mini_kdc.cc:121] Time spent starting KDC: real 1.123s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Aug 08 14:47:32 dist-test-slave-42z9 krb5kdc[19355](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200452, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:47:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:47:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.214.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab.
Entry for principal kudu/127.30.214.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab.
I20260808 14:47:32.104532 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200295877777-31578-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200295877777-31578-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200295877777-31578-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:45827
--webserver_interface=127.30.214.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab
--principal=kudu/127.30.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:42651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.214.190:45827,127.30.214.189:43455,127.30.214.188:42713
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:47:32.189178 19375 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:47:32.189424 19375 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:47:32.189476 19375 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:47:32.190709 19375 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:47:32.190761 19375 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:47:32.190774 19375 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:47:32.190786 19375 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:47:32.190809 19375 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:47:32.192471 19375 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:42651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200295877777-31578-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200295877777-31578-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.214.190:45827,127.30.214.189:43455,127.30.214.188:42713
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab
--principal=kudu/127.30.214.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:45827
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19375
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200295877777-31578-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:47:32.192736 19375 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:47:32.192965 19375 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:47:32.197899 19383 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:47:32.197912 19387 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:47:32.197912 19382 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:47:32.197992 19375 server_base.cc:1034] running on GCE node
I20260808 14:47:32.198380 19375 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:47:32.198689 19375 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:47:32.199855 19375 hybrid_clock.cc:648] HybridClock initialized: now 1786200452199836 us; error 34 us; skew 500 ppm
Aug 08 14:47:32 dist-test-slave-42z9 krb5kdc[19355](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200452, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:47:32.202430 19375 init.cc:377] Logged in from keytab as kudu/127.30.214.190@KRBTEST.COM (short username kudu)
I20260808 14:47:32.202913 19375 webserver.cc:460] Webserver started at http://127.30.214.190:42593/ using document root <none> and password file <none>
I20260808 14:47:32.203125 19375 fs_manager.cc:359] Metadata directory not provided
I20260808 14:47:32.203174 19375 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:47:32.203305 19375 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:47:32.204394 19375 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200295877777-31578-0/minicluster-data/master-0/data/instance:
uuid: "89459175f2ed4000a8cbf64ec271b7a7"
format_stamp: "Formatted at 2026-08-08 14:47:32 on dist-test-slave-42z9"
server_key: "3aa44335f2bf9172affabf5a3d0aed88"
server_key_iv: "9cd1e17f9b3183ba88a73243b99c9207"
server_key_version: "encryptionkey@0"
I20260808 14:47:32.204742 19375 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200295877777-31578-0/minicluster-data/master-0/wal/instance:
uuid: "89459175f2ed4000a8cbf64ec271b7a7"
format_stamp: "Formatted at 2026-08-08 14:47:32 on dist-test-slave-42z9"
server_key: "3aa44335f2bf9172affabf5a3d0aed88"
server_key_iv: "9cd1e17f9b3183ba88a73243b99c9207"
server_key_version: "encryptionkey@0"
I20260808 14:47:32.206127 19375 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:47:32.206817 19397 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:47:32.206974 19375 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:47:32.207060 19375 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200295877777-31578-0/minicluster-data/master-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200295877777-31578-0/minicluster-data/master-0/wal
uuid: "89459175f2ed4000a8cbf64ec271b7a7"
format_stamp: "Formatted at 2026-08-08 14:47:32 on dist-test-slave-42z9"
server_key: "3aa44335f2bf9172affabf5a3d0aed88"
server_key_iv: "9cd1e17f9b3183ba88a73243b99c9207"
server_key_version: "encryptionkey@0"
I20260808 14:47:32.207123 19375 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200295877777-31578-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200295877777-31578-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200295877777-31578-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:47:32.220755 19375 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:47:32.223435 19375 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:47:32.223568 19375 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:47:32.227535 19375 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.190:45827
I20260808 14:47:32.227577 19475 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.190:45827 every 8 connection(s)
I20260808 14:47:32.227923 19375 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
I20260808 14:47:32.228849 19477 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:47:32.230165 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 19375
I20260808 14:47:32.230273 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200295877777-31578-0/minicluster-data/master-0/wal/instance
I20260808 14:47:32.230423 31578 external_mini_cluster.cc:1428] Setting key 108e691fd895bb5885d095701720c7a2
I20260808 14:47:32.230626 19477 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.214.190" port: 45827 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 14:47:32 dist-test-slave-42z9 krb5kdc[19355](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200452, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.190@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.30.214.189@KRBTEST.COM; defaulting to no policy
I20260808 14:47:32.241341 19479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:32.231401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:45827 (local address 127.0.0.1:46332)
0808 14:47:32.231591 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:32.231632 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 14:47:32.232152 (+ 520us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:47:32.232454 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:47:32.232457 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:47:32.232830 (+ 373us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:47:32.233076 (+ 246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:32.233083 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:32.234119 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:32.234120 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:32.234825 (+ 705us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:32.234827 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:32.235517 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:32.235517 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:32.235577 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:32.236188 (+ 611us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:47:32.236196 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:47:32.237801 (+ 1605us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:47:32.239950 (+ 2149us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:47:32.239958 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:47:32.239959 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:47:32.240205 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:47:32.240438 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:47:32.240439 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:47:32.240439 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:47:32.240517 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:47:32.240833 (+ 316us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:47:32.240836 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:47:32.240894 (+ 58us) client_negotiation.cc:769] Sending connection context
0808 14:47:32.240995 (+ 101us) client_negotiation.cc:240] Negotiation successful
0808 14:47:32.241221 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"mutex_wait_us":62,"thread_start_us":93,"threads_started":1}
I20260808 14:47:32.241345 19480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:32.231615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46332 (local address 127.30.214.190:45827)
0808 14:47:32.231731 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0808 14:47:32.231736 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:47:32.231768 (+ 32us) server_negotiation.cc:407] Connection header received
0808 14:47:32.232327 (+ 559us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:47:32.232329 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:47:32.232347 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:47:32.232423 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:47:32.233169 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:32.234024 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:32.234925 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:32.235435 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:32.235555 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:32.237898 (+ 2343us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:47:32.237909 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:47:32.237910 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:47:32.237918 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:47:32.239845 (+ 1927us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:32.240279 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:32.240282 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:32.240283 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:32.240380 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:32.240566 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:32.240566 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:32.240567 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:32.240786 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:47:32.240846 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 14:47:32.241025 (+ 179us) server_negotiation.cc:299] Negotiation successful
0808 14:47:32.241138 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88,"thread_start_us":54,"threads_started":1}
I20260808 14:47:32.242149 19477 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.214.189" port: 43455 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:47:32.242497 19479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:32.242386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.189:43455 (local address 127.0.0.1:42776)
0808 14:47:32.242421 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:32.242472 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.189:43455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
W20260808 14:47:32.242632 19398 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.30.214.189:43455: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.189@KRBTEST.COM" created.
I20260808 14:47:32.243044 19479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:32.242958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.189:43455 (local address 127.0.0.1:42778)
0808 14:47:32.242999 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:32.243024 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.189:43455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260808 14:47:32.243134 19477 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.214.189:43455: Network error: Client connection negotiation failed: client connection to 127.30.214.189:43455: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.189.keytab.
Entry for principal kudu/127.30.214.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.189.keytab.
I20260808 14:47:32.257360 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200295877777-31578-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200295877777-31578-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200295877777-31578-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200295877777-31578-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.189:43455
--webserver_interface=127.30.214.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.189.keytab
--principal=kudu/127.30.214.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:42651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.214.190:45827,127.30.214.189:43455,127.30.214.188:42713
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:47:32.292348 19477 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.214.189" port: 43455 } attempt: 1
I20260808 14:47:32.292824 19479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:32.292705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.189:43455 (local address 127.0.0.1:42780)
0808 14:47:32.292762 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:32.292794 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.189:43455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260808 14:47:32.293213 19479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:32.293125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.189:43455 (local address 127.0.0.1:42792)
0808 14:47:32.293169 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:32.293195 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.189:43455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260808 14:47:32.293303 19477 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.214.189:43455: Network error: Client connection negotiation failed: client connection to 127.30.214.189:43455: connect: Connection refused (error 111)
W20260808 14:47:32.342159 19487 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:47:32.342393 19487 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:47:32.342427 19487 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:47:32.343653 19487 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:47:32.343705 19487 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:47:32.343725 19487 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:47:32.343742 19487 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:47:32.343758 19487 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:47:32.345337 19487 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:42651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200295877777-31578-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200295877777-31578-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.30.214.190:45827,127.30.214.189:43455,127.30.214.188:42713
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.189.keytab
--principal=kudu/127.30.214.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.189:43455
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200295877777-31578-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.30.214.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19487
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200295877777-31578-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:47:32.345647 19487 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:47:32.345868 19487 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:47:32.350724 19492 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:47:32.350750 19493 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:47:32.350844 19487 server_base.cc:1034] running on GCE node
W20260808 14:47:32.350726 19497 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:47:32.351198 19487 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:47:32.351500 19487 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:47:32.352670 19487 hybrid_clock.cc:648] HybridClock initialized: now 1786200452352655 us; error 31 us; skew 500 ppm
Aug 08 14:47:32 dist-test-slave-42z9 krb5kdc[19355](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200452, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:47:32.355329 19487 init.cc:377] Logged in from keytab as kudu/127.30.214.189@KRBTEST.COM (short username kudu)
I20260808 14:47:32.355799 19487 webserver.cc:460] Webserver started at http://127.30.214.189:35617/ using document root <none> and password file <none>
I20260808 14:47:32.356006 19487 fs_manager.cc:359] Metadata directory not provided
I20260808 14:47:32.356051 19487 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:47:32.356189 19487 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:47:32.357265 19487 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200295877777-31578-0/minicluster-data/master-1/data/instance:
uuid: "2035f77d5cad423589f3742d6c2d7486"
format_stamp: "Formatted at 2026-08-08 14:47:32 on dist-test-slave-42z9"
server_key: "7e850a294b82fe0c30a83597dd1dc2c5"
server_key_iv: "ffe26183076663a20927dd505ca86d62"
server_key_version: "encryptionkey@0"
I20260808 14:47:32.357645 19487 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200295877777-31578-0/minicluster-data/master-1/wal/instance:
uuid: "2035f77d5cad423589f3742d6c2d7486"
format_stamp: "Formatted at 2026-08-08 14:47:32 on dist-test-slave-42z9"
server_key: "7e850a294b82fe0c30a83597dd1dc2c5"
server_key_iv: "ffe26183076663a20927dd505ca86d62"
server_key_version: "encryptionkey@0"
I20260808 14:47:32.358911 19487 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:47:32.359571 19507 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:47:32.359732 19487 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:47:32.359819 19487 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200295877777-31578-0/minicluster-data/master-1/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200295877777-31578-0/minicluster-data/master-1/wal
uuid: "2035f77d5cad423589f3742d6c2d7486"
format_stamp: "Formatted at 2026-08-08 14:47:32 on dist-test-slave-42z9"
server_key: "7e850a294b82fe0c30a83597dd1dc2c5"
server_key_iv: "ffe26183076663a20927dd505ca86d62"
server_key_version: "encryptionkey@0"
I20260808 14:47:32.359889 19487 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200295877777-31578-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200295877777-31578-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200295877777-31578-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:47:32.361467 19477 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.214.189" port: 43455 } attempt: 2
I20260808 14:47:32.361873 19479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:32.361716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.189:43455 (local address 127.0.0.1:42804)
0808 14:47:32.361784 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:32.361827 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.189:43455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260808 14:47:32.362156 19479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:32.362087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.189:43455 (local address 127.0.0.1:42814)
0808 14:47:32.362110 (+ 23us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:32.362136 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.189:43455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":13}
W20260808 14:47:32.362244 19477 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.214.189:43455: Network error: Client connection negotiation failed: client connection to 127.30.214.189:43455: connect: Connection refused (error 111)
I20260808 14:47:32.377604 19487 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:47:32.380065 19487 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:47:32.380215 19487 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:47:32.384282 19487 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.189:43455
I20260808 14:47:32.384332 19583 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.189:43455 every 8 connection(s)
I20260808 14:47:32.384660 19487 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200295877777-31578-0/minicluster-data/master-1/data/info.pb
I20260808 14:47:32.385558 19587 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:47:32.387187 19587 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.214.190" port: 45827 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 14:47:32 dist-test-slave-42z9 krb5kdc[19355](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200452, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.189@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:47:32.393527 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 19487
I20260808 14:47:32.393635 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200295877777-31578-0/minicluster-data/master-1/wal/instance
I20260808 14:47:32.393802 31578 external_mini_cluster.cc:1428] Setting key 54af200361a8d4261a821fbdf737e8ef
I20260808 14:47:32.396077 19480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:32.387912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46344 (local address 127.30.214.190:45827)
0808 14:47:32.387967 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 14:47:32.387970 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:47:32.388179 (+ 209us) server_negotiation.cc:407] Connection header received
0808 14:47:32.388668 (+ 489us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:47:32.388669 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:47:32.388687 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:47:32.388735 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:47:32.389403 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:32.389927 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:32.390887 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:32.391087 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:32.391143 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:32.393213 (+ 2070us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:47:32.393215 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:47:32.393215 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:47:32.393224 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:47:32.394621 (+ 1397us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:32.395092 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:32.395093 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:32.395093 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:32.395146 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:32.395395 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:32.395396 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:32.395396 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:32.395502 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:47:32.395562 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 14:47:32.395876 (+ 314us) server_negotiation.cc:299] Negotiation successful
0808 14:47:32.395976 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 14:47:32.396159 19589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:32.387877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:45827 (local address 127.0.0.1:46344)
0808 14:47:32.388053 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:32.388092 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 14:47:32.388567 (+ 475us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:47:32.388816 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:47:32.388819 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:47:32.389093 (+ 274us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:47:32.389304 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:32.389308 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:32.390023 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:32.390024 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:32.390797 (+ 773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:32.390799 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:32.391164 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:32.391165 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:32.391282 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:32.391737 (+ 455us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:47:32.391744 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:47:32.393112 (+ 1368us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:47:32.394705 (+ 1593us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:47:32.394715 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:47:32.394718 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:47:32.395020 (+ 302us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:47:32.395198 (+ 178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:47:32.395199 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:47:32.395199 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:47:32.395340 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:47:32.395560 (+ 220us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:47:32.395567 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:47:32.395748 (+ 181us) client_negotiation.cc:769] Sending connection context
0808 14:47:32.395842 (+ 94us) client_negotiation.cc:240] Negotiation successful
0808 14:47:32.395980 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":80,"threads_started":1}
I20260808 14:47:32.396718 19587 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.214.189" port: 43455 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 14:47:32 dist-test-slave-42z9 krb5kdc[19355](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200452, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.189@KRBTEST.COM for kudu/127.30.214.189@KRBTEST.COM
WARNING: no policy specified for kudu/127.30.214.188@KRBTEST.COM; defaulting to no policy
I20260808 14:47:32.404599 19589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:32.396967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.189:43455 (local address 127.0.0.1:42818)
0808 14:47:32.397016 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:32.397029 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:47:32.397067 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:47:32.397343 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:47:32.397344 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:47:32.397511 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:47:32.397570 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:32.397571 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:32.398808 (+ 1237us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:32.398808 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:32.399298 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:32.399300 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:32.399941 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:32.399941 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:32.400002 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:32.400400 (+ 398us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:47:32.400405 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:47:32.401961 (+ 1556us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:47:32.403702 (+ 1741us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:47:32.403703 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:47:32.403704 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:47:32.403870 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:47:32.404033 (+ 163us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:47:32.404034 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:47:32.404034 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:47:32.404079 (+ 45us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:47:32.404299 (+ 220us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:47:32.404299 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:47:32.404336 (+ 37us) client_negotiation.cc:769] Sending connection context
0808 14:47:32.404388 (+ 52us) client_negotiation.cc:240] Negotiation successful
0808 14:47:32.404465 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260808 14:47:32.404623 19592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:32.397032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42818 (local address 127.30.214.189:43455)
0808 14:47:32.397187 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0808 14:47:32.397193 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:47:32.397217 (+ 24us) server_negotiation.cc:407] Connection header received
0808 14:47:32.397239 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:47:32.397242 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:47:32.397256 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:47:32.397334 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:47:32.397637 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:32.398710 (+ 1073us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:32.399390 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:32.399866 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:32.399949 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:32.402053 (+ 2104us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:47:32.402062 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:47:32.402062 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:47:32.402069 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:47:32.403640 (+ 1571us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:32.403935 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:32.403938 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:32.403938 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:32.403988 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:32.404119 (+ 131us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:32.404120 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:32.404120 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:32.404256 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:47:32.404315 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 14:47:32.404421 (+ 106us) server_negotiation.cc:299] Negotiation successful
0808 14:47:32.404525 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":84,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.188@KRBTEST.COM" created.
I20260808 14:47:32.405478 19587 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.214.188" port: 42713 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:47:32.405854 19589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:32.405729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.188:42713 (local address 127.0.0.1:45464)
0808 14:47:32.405781 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:32.405831 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.188:42713: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260808 14:47:32.406000 19512 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.30.214.188:42713: connect: Connection refused (error 111)
I20260808 14:47:32.406412 19589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:32.406337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.188:42713 (local address 127.0.0.1:45476)
0808 14:47:32.406372 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:32.406396 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.188:42713: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
W20260808 14:47:32.406507 19587 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.214.188:42713: Network error: Client connection negotiation failed: client connection to 127.30.214.188:42713: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.188.keytab.
Entry for principal kudu/127.30.214.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.188.keytab.
I20260808 14:47:32.419907 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200295877777-31578-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200295877777-31578-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200295877777-31578-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200295877777-31578-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.188:42713
--webserver_interface=127.30.214.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.188.keytab
--principal=kudu/127.30.214.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:42651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.214.190:45827,127.30.214.189:43455,127.30.214.188:42713
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:47:32.453402 19477 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.214.189" port: 43455 } attempt: 3
I20260808 14:47:32.455746 19587 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.214.188" port: 42713 } attempt: 1
I20260808 14:47:32.456180 19589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:32.456039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.188:42713 (local address 127.0.0.1:45490)
0808 14:47:32.456099 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:32.456142 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.188:42713: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260808 14:47:32.456560 19589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:32.456449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.188:42713 (local address 127.0.0.1:45498)
0808 14:47:32.456501 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:32.456533 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.188:42713: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260808 14:47:32.456656 19587 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.214.188:42713: Network error: Client connection negotiation failed: client connection to 127.30.214.188:42713: connect: Connection refused (error 111)
Aug 08 14:47:32 dist-test-slave-42z9 krb5kdc[19355](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200452, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.190@KRBTEST.COM for kudu/127.30.214.189@KRBTEST.COM
I20260808 14:47:32.460983 19479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:32.453804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.189:43455 (local address 127.0.0.1:42834)
0808 14:47:32.453868 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:32.453882 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 14:47:32.453940 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:47:32.454104 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:47:32.454105 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:47:32.454264 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:47:32.454338 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:32.454340 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:32.455357 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:32.455359 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:32.455914 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:32.455917 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:32.456433 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:32.456435 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:32.456511 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:32.456981 (+ 470us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:47:32.456986 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:47:32.458451 (+ 1465us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:47:32.460100 (+ 1649us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:47:32.460101 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:47:32.460101 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:47:32.460270 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:47:32.460458 (+ 188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:47:32.460459 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:47:32.460459 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:47:32.460504 (+ 45us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:47:32.460739 (+ 235us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:47:32.460740 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:47:32.460780 (+ 40us) client_negotiation.cc:769] Sending connection context
0808 14:47:32.460825 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 14:47:32.460903 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260808 14:47:32.461018 19592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:32.453893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42834 (local address 127.30.214.189:43455)
0808 14:47:32.453955 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 14:47:32.453957 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:47:32.453969 (+ 12us) server_negotiation.cc:407] Connection header received
0808 14:47:32.453999 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:47:32.454001 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:47:32.454013 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:47:32.454099 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:47:32.454405 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:32.455207 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:32.456025 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:32.456308 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:32.456371 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:32.458553 (+ 2182us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:47:32.458555 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:47:32.458556 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:47:32.458565 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:47:32.460005 (+ 1440us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:32.460328 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:32.460329 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:32.460330 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:32.460400 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:32.460550 (+ 150us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:32.460551 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:32.460551 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:32.460687 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:47:32.460751 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 14:47:32.460849 (+ 98us) server_negotiation.cc:299] Negotiation successful
0808 14:47:32.460933 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 14:47:32.461511 19477 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.214.188" port: 42713 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:47:32.461829 19479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:32.461739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.188:42713 (local address 127.0.0.1:45512)
0808 14:47:32.461781 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:32.461808 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.188:42713: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260808 14:47:32.462177 19479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:32.462098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.188:42713 (local address 127.0.0.1:45518)
0808 14:47:32.462137 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:32.462160 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.188:42713: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260808 14:47:32.462271 19477 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.214.188:42713: Network error: Client connection negotiation failed: client connection to 127.30.214.188:42713: connect: Connection refused (error 111)
I20260808 14:47:32.493484 19477 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.214.188" port: 42713 } attempt: 1
I20260808 14:47:32.494035 19479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:32.493845 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.188:42713 (local address 127.0.0.1:45534)
0808 14:47:32.493946 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:32.494000 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.188:42713: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260808 14:47:32.494391 19479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:32.494305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.188:42713 (local address 127.0.0.1:45548)
0808 14:47:32.494348 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:32.494374 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.188:42713: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260808 14:47:32.494510 19477 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.214.188:42713: Network error: Client connection negotiation failed: client connection to 127.30.214.188:42713: connect: Connection refused (error 111)
W20260808 14:47:32.506467 19595 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:47:32.506677 19595 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:47:32.506698 19595 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:47:32.507843 19595 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:47:32.507895 19595 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:47:32.507908 19595 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:47:32.507933 19595 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:47:32.507956 19595 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:47:32.509567 19595 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:42651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200295877777-31578-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200295877777-31578-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.30.214.190:45827,127.30.214.189:43455,127.30.214.188:42713
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.188.keytab
--principal=kudu/127.30.214.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.188:42713
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200295877777-31578-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.30.214.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19595
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200295877777-31578-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:47:32.509831 19595 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:47:32.510082 19595 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:47:32.514895 19601 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:47:32.514979 19602 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:47:32.515110 19605 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:47:32.515162 19595 server_base.cc:1034] running on GCE node
I20260808 14:47:32.515420 19595 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:47:32.515712 19595 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:47:32.516898 19595 hybrid_clock.cc:648] HybridClock initialized: now 1786200452516881 us; error 33 us; skew 500 ppm
Aug 08 14:47:32 dist-test-slave-42z9 krb5kdc[19355](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200452, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:47:32.519445 19595 init.cc:377] Logged in from keytab as kudu/127.30.214.188@KRBTEST.COM (short username kudu)
I20260808 14:47:32.519908 19595 webserver.cc:460] Webserver started at http://127.30.214.188:34629/ using document root <none> and password file <none>
I20260808 14:47:32.520124 19595 fs_manager.cc:359] Metadata directory not provided
I20260808 14:47:32.520165 19595 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:47:32.520260 19595 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:47:32.521292 19595 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200295877777-31578-0/minicluster-data/master-2/data/instance:
uuid: "5a81a8d3711d4f01822c789a3eb6fa46"
format_stamp: "Formatted at 2026-08-08 14:47:32 on dist-test-slave-42z9"
server_key: "02e3cd10e1d1636f762eaa647eab86d8"
server_key_iv: "97e919a1149bdd776bca149bb714d1aa"
server_key_version: "encryptionkey@0"
I20260808 14:47:32.521652 19595 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200295877777-31578-0/minicluster-data/master-2/wal/instance:
uuid: "5a81a8d3711d4f01822c789a3eb6fa46"
format_stamp: "Formatted at 2026-08-08 14:47:32 on dist-test-slave-42z9"
server_key: "02e3cd10e1d1636f762eaa647eab86d8"
server_key_iv: "97e919a1149bdd776bca149bb714d1aa"
server_key_version: "encryptionkey@0"
I20260808 14:47:32.522964 19595 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:47:32.523599 19615 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:47:32.523736 19595 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:47:32.523804 19595 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200295877777-31578-0/minicluster-data/master-2/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200295877777-31578-0/minicluster-data/master-2/wal
uuid: "5a81a8d3711d4f01822c789a3eb6fa46"
format_stamp: "Formatted at 2026-08-08 14:47:32 on dist-test-slave-42z9"
server_key: "02e3cd10e1d1636f762eaa647eab86d8"
server_key_iv: "97e919a1149bdd776bca149bb714d1aa"
server_key_version: "encryptionkey@0"
I20260808 14:47:32.523886 19595 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200295877777-31578-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200295877777-31578-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200295877777-31578-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:47:32.524780 19587 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.214.188" port: 42713 } attempt: 2
I20260808 14:47:32.525135 19589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:32.525026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.188:42713 (local address 127.0.0.1:45562)
0808 14:47:32.525075 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:32.525106 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.188:42713: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260808 14:47:32.525521 19589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:32.525406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.188:42713 (local address 127.0.0.1:45578)
0808 14:47:32.525468 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:32.525498 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.188:42713: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
W20260808 14:47:32.525616 19587 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.214.188:42713: Network error: Client connection negotiation failed: client connection to 127.30.214.188:42713: connect: Connection refused (error 111)
I20260808 14:47:32.533566 19595 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:47:32.535323 19595 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:47:32.535467 19595 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:47:32.539491 19595 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.188:42713
I20260808 14:47:32.539544 19697 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.188:42713 every 8 connection(s)
I20260808 14:47:32.539868 19595 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200295877777-31578-0/minicluster-data/master-2/data/info.pb
I20260808 14:47:32.540750 19700 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:47:32.542426 19700 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.214.190" port: 45827 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:47:32.545759 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 19595
I20260808 14:47:32.545850 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786200295877777-31578-0/minicluster-data/master-2/wal/instance
I20260808 14:47:32.546025 31578 external_mini_cluster.cc:1428] Setting key 28c9e73acbfb49455c04804e5481acf2
Aug 08 14:47:32 dist-test-slave-42z9 krb5kdc[19355](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200452, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.188@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
Aug 08 14:47:32 dist-test-slave-42z9 krb5kdc[19355](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200452, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.214.188@KRBTEST.COM
I20260808 14:47:32.551819 19480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:32.543164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46356 (local address 127.30.214.190:45827)
0808 14:47:32.543211 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 14:47:32.543213 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:47:32.543437 (+ 224us) server_negotiation.cc:407] Connection header received
0808 14:47:32.543940 (+ 503us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:47:32.543941 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:47:32.543954 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:47:32.544004 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:47:32.544686 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:32.545157 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:32.546259 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:32.546534 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:32.546616 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:32.548969 (+ 2353us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:47:32.548970 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:47:32.548970 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:47:32.548979 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:47:32.550430 (+ 1451us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:32.550886 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:32.550888 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:32.550888 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:32.550946 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:32.551176 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:32.551177 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:32.551178 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:32.551296 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:47:32.551353 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 14:47:32.551632 (+ 279us) server_negotiation.cc:299] Negotiation successful
0808 14:47:32.551727 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 14:47:32.551977 19703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:32.543118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:45827 (local address 127.0.0.1:46356)
0808 14:47:32.543308 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:32.543348 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 14:47:32.543835 (+ 487us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:47:32.544116 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:47:32.544119 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:47:32.544382 (+ 263us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:47:32.544588 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:32.544592 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:32.545246 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:32.545247 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:32.546168 (+ 921us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:32.546171 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:32.546623 (+ 452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:32.546624 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:32.546767 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:32.547352 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:47:32.547361 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:47:32.548866 (+ 1505us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:47:32.550520 (+ 1654us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:47:32.550528 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:47:32.550531 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:47:32.550808 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:47:32.551002 (+ 194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:47:32.551003 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:47:32.551003 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:47:32.551117 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:47:32.551354 (+ 237us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:47:32.551361 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:47:32.551507 (+ 146us) client_negotiation.cc:769] Sending connection context
0808 14:47:32.551600 (+ 93us) client_negotiation.cc:240] Negotiation successful
0808 14:47:32.551752 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":74,"threads_started":1}
I20260808 14:47:32.552474 19700 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.214.189" port: 43455 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:47:32.554415 19705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:32.546418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45586 (local address 127.30.214.188:42713)
0808 14:47:32.546578 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0808 14:47:32.546582 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:47:32.546605 (+ 23us) server_negotiation.cc:407] Connection header received
0808 14:47:32.546665 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:47:32.546667 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:47:32.546690 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:47:32.546761 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:47:32.547415 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:32.548077 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:32.548966 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:32.549367 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:32.549460 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:32.551536 (+ 2076us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:47:32.551545 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:47:32.551545 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:47:32.551552 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:47:32.553389 (+ 1837us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:32.553723 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:32.553726 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:32.553726 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:32.553788 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:32.553952 (+ 164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:32.553953 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:32.553953 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:32.554085 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:47:32.554219 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0808 14:47:32.554286 (+ 67us) server_negotiation.cc:299] Negotiation successful
0808 14:47:32.554345 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":95,"threads_started":1}
Aug 08 14:47:32 dist-test-slave-42z9 krb5kdc[19355](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200452, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.188@KRBTEST.COM for kudu/127.30.214.189@KRBTEST.COM
I20260808 14:47:32.559437 19592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:32.552792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42850 (local address 127.30.214.189:43455)
0808 14:47:32.552848 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 14:47:32.552850 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:47:32.552860 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:47:32.552884 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:47:32.552885 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:47:32.552895 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:47:32.552948 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:47:32.553167 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:32.553802 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:32.554771 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:32.555055 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:32.555128 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:32.556929 (+ 1801us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:47:32.556930 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:47:32.556931 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:47:32.556939 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:47:32.558438 (+ 1499us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:32.558737 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:32.558737 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:32.558738 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:32.558794 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:32.558945 (+ 151us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:32.558946 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:32.558946 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:32.559078 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:47:32.559133 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 14:47:32.559297 (+ 164us) server_negotiation.cc:299] Negotiation successful
0808 14:47:32.559371 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 14:47:32.559485 19703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:32.552719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.189:43455 (local address 127.0.0.1:42850)
0808 14:47:32.552772 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:32.552784 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:47:32.552825 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:47:32.552963 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:47:32.552964 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:47:32.553068 (+ 104us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:47:32.553102 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:32.553103 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:32.553886 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:32.553887 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:32.554539 (+ 652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:32.554542 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:32.555124 (+ 582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:32.555125 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:32.555185 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:32.555557 (+ 372us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:47:32.555562 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:47:32.556836 (+ 1274us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:47:32.558514 (+ 1678us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:47:32.558515 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:47:32.558515 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:47:32.558672 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:47:32.558850 (+ 178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:47:32.558851 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:47:32.558851 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:47:32.558896 (+ 45us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:47:32.559154 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:47:32.559155 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:47:32.559202 (+ 47us) client_negotiation.cc:769] Sending connection context
0808 14:47:32.559278 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 14:47:32.559386 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
Aug 08 14:47:32 dist-test-slave-42z9 krb5kdc[19355](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200452, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:47:32.559859 19700 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.214.188" port: 42713 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:47:32.562795 19480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:32.555329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46364 (local address 127.30.214.190:45827)
0808 14:47:32.555390 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 14:47:32.555392 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:47:32.555400 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:47:32.555422 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:47:32.555423 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:47:32.555433 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:47:32.555486 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:47:32.555922 (+ 436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:32.556606 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:32.557477 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:32.557705 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:32.557775 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:32.560197 (+ 2422us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:47:32.560198 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:47:32.560199 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:47:32.560206 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:47:32.561686 (+ 1480us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:32.562040 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:32.562041 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:32.562042 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:32.562100 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:32.562251 (+ 151us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:32.562252 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:32.562252 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:32.562396 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:47:32.562577 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0808 14:47:32.562616 (+ 39us) server_negotiation.cc:299] Negotiation successful
0808 14:47:32.562700 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
Aug 08 14:47:32 dist-test-slave-42z9 krb5kdc[19355](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200452, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.188@KRBTEST.COM for kudu/127.30.214.188@KRBTEST.COM
I20260808 14:47:32.566635 19703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:32.560134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.188:42713 (local address 127.0.0.1:45590)
0808 14:47:32.560181 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:32.560191 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:47:32.560224 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:47:32.560330 (+ 106us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:47:32.560331 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:47:32.560443 (+ 112us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:47:32.560481 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:32.560482 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:32.561332 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:32.561332 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:32.561901 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:32.561904 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:32.562328 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:32.562329 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:32.562371 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:32.562770 (+ 399us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:47:32.562776 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:47:32.564165 (+ 1389us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:47:32.565696 (+ 1531us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:47:32.565697 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:47:32.565698 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:47:32.565925 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:47:32.566100 (+ 175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:47:32.566101 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:47:32.566101 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:47:32.566169 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:47:32.566416 (+ 247us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:47:32.566416 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:47:32.566453 (+ 37us) client_negotiation.cc:769] Sending connection context
0808 14:47:32.566498 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 14:47:32.566571 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
I20260808 14:47:32.566740 19705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:32.560172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45590 (local address 127.30.214.188:42713)
0808 14:47:32.560208 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 14:47:32.560209 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:47:32.560218 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:47:32.560259 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:47:32.560260 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:47:32.560269 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:47:32.560328 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:47:32.560551 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:32.561253 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:32.561977 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:32.562262 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:32.562325 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:32.564252 (+ 1927us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:47:32.564253 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:47:32.564254 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:47:32.564259 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:47:32.565633 (+ 1374us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:32.565991 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:32.565992 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:32.565993 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:32.566044 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:32.566224 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:32.566224 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:32.566225 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:32.566349 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:47:32.566413 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 14:47:32.566551 (+ 138us) server_negotiation.cc:299] Negotiation successful
0808 14:47:32.566625 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
Aug 08 14:47:32 dist-test-slave-42z9 krb5kdc[19355](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200452, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.214.189@KRBTEST.COM
I20260808 14:47:32.568461 19700 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a81a8d3711d4f01822c789a3eb6fa46: Bootstrap starting.
I20260808 14:47:32.569415 19700 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5a81a8d3711d4f01822c789a3eb6fa46: Neither blocks nor log segments found. Creating new log.
I20260808 14:47:32.569650 19477 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.214.188" port: 42713 } attempt: 2
I20260808 14:47:32.569777 19700 log.cc:824] T 00000000000000000000000000000000 P 5a81a8d3711d4f01822c789a3eb6fa46: Log is configured to *not* fsync() on all Append() calls
I20260808 14:47:32.570534 19592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:32.563428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42864 (local address 127.30.214.189:43455)
0808 14:47:32.563470 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 14:47:32.563471 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:47:32.563480 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:47:32.563501 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:47:32.563502 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:47:32.563511 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:47:32.563574 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:47:32.564014 (+ 440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:32.564616 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:32.565534 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:32.565753 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:32.565826 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:32.568141 (+ 2315us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:47:32.568142 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:47:32.568143 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:47:32.568149 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:47:32.569422 (+ 1273us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:32.569773 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:32.569774 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:32.569774 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:32.569838 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:32.570034 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:32.570035 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:32.570035 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:32.570149 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:47:32.570337 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0808 14:47:32.570373 (+ 36us) server_negotiation.cc:299] Negotiation successful
0808 14:47:32.570448 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 14:47:32.571374 19700 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a81a8d3711d4f01822c789a3eb6fa46: No bootstrap required, opened a new log
I20260808 14:47:32.572297 31578 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:47:32.573076 19700 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5a81a8d3711d4f01822c789a3eb6fa46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89459175f2ed4000a8cbf64ec271b7a7" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 45827 } } peers { permanent_uuid: "2035f77d5cad423589f3742d6c2d7486" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 43455 } } peers { permanent_uuid: "5a81a8d3711d4f01822c789a3eb6fa46" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 42713 } }
I20260808 14:47:32.573195 19700 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5a81a8d3711d4f01822c789a3eb6fa46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:47:32.573215 19700 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5a81a8d3711d4f01822c789a3eb6fa46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a81a8d3711d4f01822c789a3eb6fa46, State: Initialized, Role: FOLLOWER
I20260808 14:47:32.573305 19700 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5a81a8d3711d4f01822c789a3eb6fa46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89459175f2ed4000a8cbf64ec271b7a7" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 45827 } } peers { permanent_uuid: "2035f77d5cad423589f3742d6c2d7486" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 43455 } } peers { permanent_uuid: "5a81a8d3711d4f01822c789a3eb6fa46" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 42713 } }
I20260808 14:47:32.573637 19711 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5a81a8d3711d4f01822c789a3eb6fa46 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89459175f2ed4000a8cbf64ec271b7a7" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 45827 } } peers { permanent_uuid: "2035f77d5cad423589f3742d6c2d7486" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 43455 } } peers { permanent_uuid: "5a81a8d3711d4f01822c789a3eb6fa46" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 42713 } } }
Aug 08 14:47:32 dist-test-slave-42z9 krb5kdc[19355](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200452, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.190@KRBTEST.COM for kudu/127.30.214.188@KRBTEST.COM
I20260808 14:47:32.573654 19700 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5a81a8d3711d4f01822c789a3eb6fa46 [sys.catalog]: configured and running, proceeding with master startup.
W20260808 14:47:32.576395 19735 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5a81a8d3711d4f01822c789a3eb6fa46: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:47:32.576586 19735 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:47:32.577566 19479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:32.569937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.188:42713 (local address 127.0.0.1:45600)
0808 14:47:32.570063 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:32.570074 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:47:32.570128 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:47:32.570264 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:47:32.570265 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:47:32.570399 (+ 134us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:47:32.570441 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:32.570443 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:32.571260 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:32.571262 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:32.571947 (+ 685us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:32.571950 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:32.572392 (+ 442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:32.572393 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:32.572450 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:32.572868 (+ 418us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:47:32.572874 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:47:32.574353 (+ 1479us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:47:32.576119 (+ 1766us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:47:32.576120 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:47:32.576121 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:47:32.576342 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:47:32.576865 (+ 523us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:47:32.576866 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:47:32.576866 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:47:32.576930 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:47:32.577230 (+ 300us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:47:32.577231 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:47:32.577276 (+ 45us) client_negotiation.cc:769] Sending connection context
0808 14:47:32.577334 (+ 58us) client_negotiation.cc:240] Negotiation successful
0808 14:47:32.577428 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108}
I20260808 14:47:32.577841 19705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:32.569973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45600 (local address 127.30.214.188:42713)
0808 14:47:32.570008 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0808 14:47:32.570010 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:47:32.570124 (+ 114us) server_negotiation.cc:407] Connection header received
0808 14:47:32.570182 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:47:32.570182 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:47:32.570192 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:47:32.570494 (+ 302us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:47:32.570536 (+ 42us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:32.571158 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:32.572032 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:32.572310 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:32.572383 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:32.574445 (+ 2062us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:47:32.574447 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:47:32.574447 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:47:32.574454 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:47:32.576021 (+ 1567us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:32.576731 (+ 710us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:32.576733 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:32.576733 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:32.576796 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:32.576990 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:32.576991 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:32.576991 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:32.577145 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:47:32.577204 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 14:47:32.577686 (+ 482us) server_negotiation.cc:299] Negotiation successful
0808 14:47:32.577763 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 14:47:32.577919 19711 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5a81a8d3711d4f01822c789a3eb6fa46 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:47:32.579953 19477 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 89459175f2ed4000a8cbf64ec271b7a7: Bootstrap starting.
I20260808 14:47:32.577117 19595 master_runner.cc:186] Error getting master registration for 127.30.214.190:45827: OK, instance_id { permanent_uuid: "89459175f2ed4000a8cbf64ec271b7a7" instance_seqno: 1786200452226415 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 14:47:32.580088 19595 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 14:47:32.580752 19477 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 89459175f2ed4000a8cbf64ec271b7a7: Neither blocks nor log segments found. Creating new log.
I20260808 14:47:32.581044 19477 log.cc:824] T 00000000000000000000000000000000 P 89459175f2ed4000a8cbf64ec271b7a7: Log is configured to *not* fsync() on all Append() calls
I20260808 14:47:32.581723 19480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:32.573841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46374 (local address 127.30.214.190:45827)
0808 14:47:32.573882 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 14:47:32.573884 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:47:32.574398 (+ 514us) server_negotiation.cc:407] Connection header received
0808 14:47:32.574489 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:47:32.574490 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:47:32.574501 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:47:32.574531 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:47:32.575333 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:32.575986 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:32.576960 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:32.577220 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:32.577261 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:32.578920 (+ 1659us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:47:32.578922 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:47:32.578922 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:47:32.578929 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:47:32.580464 (+ 1535us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:32.580860 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:32.580861 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:32.580862 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:32.580928 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:32.581117 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:32.581118 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:32.581118 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:32.581241 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:47:32.581310 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 14:47:32.581546 (+ 236us) server_negotiation.cc:299] Negotiation successful
0808 14:47:32.581634 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 14:47:32.585619 19592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:32.574166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42880 (local address 127.30.214.189:43455)
0808 14:47:32.574212 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 14:47:32.574214 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:47:32.574527 (+ 313us) server_negotiation.cc:407] Connection header received
0808 14:47:32.574611 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:47:32.574612 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:47:32.574622 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:47:32.574650 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:47:32.575308 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:32.576021 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:32.581156 (+ 5135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:32.581422 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:32.581487 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:32.582886 (+ 1399us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:47:32.582888 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:47:32.582888 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:47:32.582895 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:47:32.584423 (+ 1528us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:32.584784 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:32.584785 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:32.584786 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:32.584847 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:32.585072 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:32.585073 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:32.585073 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:32.585211 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:47:32.585309 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 14:47:32.585426 (+ 117us) server_negotiation.cc:299] Negotiation successful
0808 14:47:32.585526 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 14:47:32.586598 19715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:32.573885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45602 (local address 127.30.214.188:42713)
0808 14:47:32.574014 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0808 14:47:32.574016 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:47:32.575548 (+ 1532us) server_negotiation.cc:407] Connection header received
0808 14:47:32.575571 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:47:32.575572 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:47:32.575583 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:47:32.575649 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:47:32.580267 (+ 4618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:32.581042 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:32.581996 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:32.582290 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:32.582334 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:32.583706 (+ 1372us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:47:32.583708 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:47:32.583708 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:47:32.583715 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:47:32.585246 (+ 1531us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:32.585704 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:32.585705 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:32.585705 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:32.585786 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:32.586015 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:32.586016 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:32.586017 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:32.586158 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:47:32.586250 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 14:47:32.586452 (+ 202us) server_negotiation.cc:299] Negotiation successful
0808 14:47:32.586523 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105,"thread_start_us":74,"threads_started":1}
I20260808 14:47:32.590283 19477 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 89459175f2ed4000a8cbf64ec271b7a7: No bootstrap required, opened a new log
I20260808 14:47:32.592372 19477 raft_consensus.cc:348] T 00000000000000000000000000000000 P 89459175f2ed4000a8cbf64ec271b7a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89459175f2ed4000a8cbf64ec271b7a7" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 45827 } } peers { permanent_uuid: "2035f77d5cad423589f3742d6c2d7486" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 43455 } } peers { permanent_uuid: "5a81a8d3711d4f01822c789a3eb6fa46" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 42713 } }
I20260808 14:47:32.592530 19477 raft_consensus.cc:374] T 00000000000000000000000000000000 P 89459175f2ed4000a8cbf64ec271b7a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:47:32.592576 19477 raft_consensus.cc:729] T 00000000000000000000000000000000 P 89459175f2ed4000a8cbf64ec271b7a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89459175f2ed4000a8cbf64ec271b7a7, State: Initialized, Role: FOLLOWER
I20260808 14:47:32.592702 19477 consensus_queue.cc:260] T 00000000000000000000000000000000 P 89459175f2ed4000a8cbf64ec271b7a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89459175f2ed4000a8cbf64ec271b7a7" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 45827 } } peers { permanent_uuid: "2035f77d5cad423589f3742d6c2d7486" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 43455 } } peers { permanent_uuid: "5a81a8d3711d4f01822c789a3eb6fa46" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 42713 } }
I20260808 14:47:32.592990 19738 sys_catalog.cc:455] T 00000000000000000000000000000000 P 89459175f2ed4000a8cbf64ec271b7a7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89459175f2ed4000a8cbf64ec271b7a7" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 45827 } } peers { permanent_uuid: "2035f77d5cad423589f3742d6c2d7486" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 43455 } } peers { permanent_uuid: "5a81a8d3711d4f01822c789a3eb6fa46" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 42713 } } }
I20260808 14:47:32.593063 19477 sys_catalog.cc:564] T 00000000000000000000000000000000 P 89459175f2ed4000a8cbf64ec271b7a7 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:47:32.593075 19738 sys_catalog.cc:458] T 00000000000000000000000000000000 P 89459175f2ed4000a8cbf64ec271b7a7 [sys.catalog]: This master's current role is: FOLLOWER
W20260808 14:47:32.595315 19760 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 89459175f2ed4000a8cbf64ec271b7a7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:47:32.595388 19760 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:47:32.596361 19375 master_runner.cc:186] Error getting master registration for 127.30.214.189:43455: OK, instance_id { permanent_uuid: "2035f77d5cad423589f3742d6c2d7486" instance_seqno: 1786200452383181 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 14:47:32.599313 19375 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 14:47:32.616765 19587 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.214.188" port: 42713 } attempt: 3
Aug 08 14:47:32 dist-test-slave-42z9 krb5kdc[19355](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200452, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.189@KRBTEST.COM for kudu/127.30.214.188@KRBTEST.COM
I20260808 14:47:32.625782 19589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:32.617107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.188:42713 (local address 127.0.0.1:45608)
0808 14:47:32.617164 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:32.617175 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:47:32.617214 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:47:32.617357 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:47:32.617357 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:47:32.617585 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:47:32.617643 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:32.617645 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:32.618597 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:32.618598 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:32.619443 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:32.619446 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:32.619962 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:32.619963 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:32.620032 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:32.620551 (+ 519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:47:32.620557 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:47:32.622230 (+ 1673us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:47:32.624627 (+ 2397us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:47:32.624629 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:47:32.624629 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:47:32.624866 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:47:32.625084 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:47:32.625085 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:47:32.625085 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:47:32.625151 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:47:32.625405 (+ 254us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:47:32.625406 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:47:32.625489 (+ 83us) client_negotiation.cc:769] Sending connection context
0808 14:47:32.625561 (+ 72us) client_negotiation.cc:240] Negotiation successful
0808 14:47:32.625672 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260808 14:47:32.625799 19715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:32.617180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45608 (local address 127.30.214.188:42713)
0808 14:47:32.617228 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 14:47:32.617230 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:47:32.617239 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:47:32.617265 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:47:32.617266 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:47:32.617276 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:47:32.617343 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:47:32.617725 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:32.618509 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:32.619534 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:32.619884 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:32.619958 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:32.622338 (+ 2380us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:47:32.622340 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:47:32.622340 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:47:32.622348 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:47:32.624535 (+ 2187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:32.624941 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:32.624942 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:32.624942 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:32.625021 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:32.625208 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:32.625208 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:32.625209 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:32.625347 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:47:32.625410 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 14:47:32.625609 (+ 199us) server_negotiation.cc:299] Negotiation successful
0808 14:47:32.625704 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 14:47:32.627998 19587 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2035f77d5cad423589f3742d6c2d7486: Bootstrap starting.
I20260808 14:47:32.628803 19587 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2035f77d5cad423589f3742d6c2d7486: Neither blocks nor log segments found. Creating new log.
I20260808 14:47:32.629151 19587 log.cc:824] T 00000000000000000000000000000000 P 2035f77d5cad423589f3742d6c2d7486: Log is configured to *not* fsync() on all Append() calls
I20260808 14:47:32.630098 19587 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2035f77d5cad423589f3742d6c2d7486: No bootstrap required, opened a new log
I20260808 14:47:32.632824 19587 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2035f77d5cad423589f3742d6c2d7486 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89459175f2ed4000a8cbf64ec271b7a7" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 45827 } } peers { permanent_uuid: "2035f77d5cad423589f3742d6c2d7486" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 43455 } } peers { permanent_uuid: "5a81a8d3711d4f01822c789a3eb6fa46" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 42713 } }
I20260808 14:47:32.632995 19587 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2035f77d5cad423589f3742d6c2d7486 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:47:32.633033 19587 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2035f77d5cad423589f3742d6c2d7486 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2035f77d5cad423589f3742d6c2d7486, State: Initialized, Role: FOLLOWER
I20260808 14:47:32.633245 19587 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2035f77d5cad423589f3742d6c2d7486 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89459175f2ed4000a8cbf64ec271b7a7" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 45827 } } peers { permanent_uuid: "2035f77d5cad423589f3742d6c2d7486" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 43455 } } peers { permanent_uuid: "5a81a8d3711d4f01822c789a3eb6fa46" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 42713 } }
I20260808 14:47:32.633641 19763 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2035f77d5cad423589f3742d6c2d7486 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89459175f2ed4000a8cbf64ec271b7a7" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 45827 } } peers { permanent_uuid: "2035f77d5cad423589f3742d6c2d7486" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 43455 } } peers { permanent_uuid: "5a81a8d3711d4f01822c789a3eb6fa46" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 42713 } } }
I20260808 14:47:32.633694 19587 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2035f77d5cad423589f3742d6c2d7486 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:47:32.633785 19763 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2035f77d5cad423589f3742d6c2d7486 [sys.catalog]: This master's current role is: FOLLOWER
W20260808 14:47:32.635754 19779 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2035f77d5cad423589f3742d6c2d7486: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:47:32.635869 19779 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:47:32.637969 19487 master_runner.cc:263] No leader master found from master 2035f77d5cad423589f3742d6c2d7486
I20260808 14:47:32.638031 19487 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 14:47:32.644261 19763 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2035f77d5cad423589f3742d6c2d7486 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:47:32.644390 19763 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2035f77d5cad423589f3742d6c2d7486 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89459175f2ed4000a8cbf64ec271b7a7" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 45827 } } peers { permanent_uuid: "2035f77d5cad423589f3742d6c2d7486" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 43455 } } peers { permanent_uuid: "5a81a8d3711d4f01822c789a3eb6fa46" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 42713 } }
I20260808 14:47:32.644655 19763 leader_election.cc:288] T 00000000000000000000000000000000 P 2035f77d5cad423589f3742d6c2d7486 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89459175f2ed4000a8cbf64ec271b7a7 (127.30.214.190:45827), 5a81a8d3711d4f01822c789a3eb6fa46 (127.30.214.188:42713)
I20260808 14:47:32.644984 19434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2035f77d5cad423589f3742d6c2d7486" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89459175f2ed4000a8cbf64ec271b7a7" is_pre_election: true
I20260808 14:47:32.645155 19434 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 89459175f2ed4000a8cbf64ec271b7a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2035f77d5cad423589f3742d6c2d7486 in term 0.
I20260808 14:47:32.645620 19509 leader_election.cc:302] T 00000000000000000000000000000000 P 2035f77d5cad423589f3742d6c2d7486 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2035f77d5cad423589f3742d6c2d7486, 89459175f2ed4000a8cbf64ec271b7a7; no voters:
I20260808 14:47:32.646016 19656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2035f77d5cad423589f3742d6c2d7486" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a81a8d3711d4f01822c789a3eb6fa46" is_pre_election: true
I20260808 14:47:32.646170 19656 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 5a81a8d3711d4f01822c789a3eb6fa46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2035f77d5cad423589f3742d6c2d7486 in term 0.
I20260808 14:47:32.646505 19763 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2035f77d5cad423589f3742d6c2d7486 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:47:32.646569 19763 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2035f77d5cad423589f3742d6c2d7486 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:47:32.646595 19763 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2035f77d5cad423589f3742d6c2d7486 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:47:32.647586 19763 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2035f77d5cad423589f3742d6c2d7486 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89459175f2ed4000a8cbf64ec271b7a7" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 45827 } } peers { permanent_uuid: "2035f77d5cad423589f3742d6c2d7486" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 43455 } } peers { permanent_uuid: "5a81a8d3711d4f01822c789a3eb6fa46" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 42713 } }
I20260808 14:47:32.647722 19763 leader_election.cc:288] T 00000000000000000000000000000000 P 2035f77d5cad423589f3742d6c2d7486 [CANDIDATE]: Term 1 election: Requested vote from peers 89459175f2ed4000a8cbf64ec271b7a7 (127.30.214.190:45827), 5a81a8d3711d4f01822c789a3eb6fa46 (127.30.214.188:42713)
I20260808 14:47:32.648166 19434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2035f77d5cad423589f3742d6c2d7486" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89459175f2ed4000a8cbf64ec271b7a7"
I20260808 14:47:32.648265 19434 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 89459175f2ed4000a8cbf64ec271b7a7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:47:32.649652 19434 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 89459175f2ed4000a8cbf64ec271b7a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2035f77d5cad423589f3742d6c2d7486 in term 1.
I20260808 14:47:32.649884 19509 leader_election.cc:302] T 00000000000000000000000000000000 P 2035f77d5cad423589f3742d6c2d7486 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2035f77d5cad423589f3742d6c2d7486, 89459175f2ed4000a8cbf64ec271b7a7; no voters:
I20260808 14:47:32.650166 19656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2035f77d5cad423589f3742d6c2d7486" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a81a8d3711d4f01822c789a3eb6fa46"
I20260808 14:47:32.650254 19656 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5a81a8d3711d4f01822c789a3eb6fa46 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:47:32.651077 19656 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 5a81a8d3711d4f01822c789a3eb6fa46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2035f77d5cad423589f3742d6c2d7486 in term 1.
I20260808 14:47:32.652045 19763 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2035f77d5cad423589f3742d6c2d7486 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:47:32.652217 19763 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2035f77d5cad423589f3742d6c2d7486 [term 1 LEADER]: Becoming Leader. State: Replica: 2035f77d5cad423589f3742d6c2d7486, State: Running, Role: LEADER
I20260808 14:47:32.652320 19763 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2035f77d5cad423589f3742d6c2d7486 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89459175f2ed4000a8cbf64ec271b7a7" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 45827 } } peers { permanent_uuid: "2035f77d5cad423589f3742d6c2d7486" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 43455 } } peers { permanent_uuid: "5a81a8d3711d4f01822c789a3eb6fa46" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 42713 } }
I20260808 14:47:32.652705 19763 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2035f77d5cad423589f3742d6c2d7486 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2035f77d5cad423589f3742d6c2d7486. Latest consensus state: current_term: 1 leader_uuid: "2035f77d5cad423589f3742d6c2d7486" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89459175f2ed4000a8cbf64ec271b7a7" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 45827 } } peers { permanent_uuid: "2035f77d5cad423589f3742d6c2d7486" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 43455 } } peers { permanent_uuid: "5a81a8d3711d4f01822c789a3eb6fa46" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 42713 } } }
I20260808 14:47:32.652769 19763 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2035f77d5cad423589f3742d6c2d7486 [sys.catalog]: This master's current role is: LEADER
I20260808 14:47:32.653622 19785 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:47:32.653868 19785 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:47:32.655598 19656 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 5a81a8d3711d4f01822c789a3eb6fa46 [term 1 FOLLOWER]: Refusing update from remote peer 2035f77d5cad423589f3742d6c2d7486: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:47:32.656041 19782 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2035f77d5cad423589f3742d6c2d7486 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a81a8d3711d4f01822c789a3eb6fa46" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 42713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:47:32.657409 19711 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5a81a8d3711d4f01822c789a3eb6fa46 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2035f77d5cad423589f3742d6c2d7486. Latest consensus state: current_term: 1 leader_uuid: "2035f77d5cad423589f3742d6c2d7486" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89459175f2ed4000a8cbf64ec271b7a7" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 45827 } } peers { permanent_uuid: "2035f77d5cad423589f3742d6c2d7486" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 43455 } } peers { permanent_uuid: "5a81a8d3711d4f01822c789a3eb6fa46" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 42713 } } }
I20260808 14:47:32.657521 19711 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5a81a8d3711d4f01822c789a3eb6fa46 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:47:32.658022 19434 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 89459175f2ed4000a8cbf64ec271b7a7 [term 1 FOLLOWER]: Refusing update from remote peer 2035f77d5cad423589f3742d6c2d7486: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:47:32.658330 19782 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2035f77d5cad423589f3742d6c2d7486 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89459175f2ed4000a8cbf64ec271b7a7" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 45827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:47:32.659664 19738 sys_catalog.cc:455] T 00000000000000000000000000000000 P 89459175f2ed4000a8cbf64ec271b7a7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2035f77d5cad423589f3742d6c2d7486. Latest consensus state: current_term: 1 leader_uuid: "2035f77d5cad423589f3742d6c2d7486" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89459175f2ed4000a8cbf64ec271b7a7" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 45827 } } peers { permanent_uuid: "2035f77d5cad423589f3742d6c2d7486" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 43455 } } peers { permanent_uuid: "5a81a8d3711d4f01822c789a3eb6fa46" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 42713 } } }
I20260808 14:47:32.659765 19738 sys_catalog.cc:458] T 00000000000000000000000000000000 P 89459175f2ed4000a8cbf64ec271b7a7 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:47:32.661219 19782 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2035f77d5cad423589f3742d6c2d7486 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2035f77d5cad423589f3742d6c2d7486" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89459175f2ed4000a8cbf64ec271b7a7" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 45827 } } peers { permanent_uuid: "2035f77d5cad423589f3742d6c2d7486" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 43455 } } peers { permanent_uuid: "5a81a8d3711d4f01822c789a3eb6fa46" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 42713 } } }
I20260808 14:47:32.661324 19782 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2035f77d5cad423589f3742d6c2d7486 [sys.catalog]: This master's current role is: LEADER
I20260808 14:47:32.661840 19711 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5a81a8d3711d4f01822c789a3eb6fa46 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2035f77d5cad423589f3742d6c2d7486" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89459175f2ed4000a8cbf64ec271b7a7" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 45827 } } peers { permanent_uuid: "2035f77d5cad423589f3742d6c2d7486" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 43455 } } peers { permanent_uuid: "5a81a8d3711d4f01822c789a3eb6fa46" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 42713 } } }
I20260808 14:47:32.661948 19711 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5a81a8d3711d4f01822c789a3eb6fa46 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:47:32.662182 19786 mvcc.cc:205] Tried to move back new op lower bound from 7316277054074662912 to 7316277054064451584. Current Snapshot: MvccSnapshot[applied={T|T < 7316277054074662912}]
I20260808 14:47:32.662292 19789 mvcc.cc:205] Tried to move back new op lower bound from 7316277054074662912 to 7316277054064451584. Current Snapshot: MvccSnapshot[applied={T|T < 7316277054074662912}]
I20260808 14:47:32.663352 19763 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2035f77d5cad423589f3742d6c2d7486 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2035f77d5cad423589f3742d6c2d7486" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89459175f2ed4000a8cbf64ec271b7a7" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 45827 } } peers { permanent_uuid: "2035f77d5cad423589f3742d6c2d7486" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 43455 } } peers { permanent_uuid: "5a81a8d3711d4f01822c789a3eb6fa46" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 42713 } } }
I20260808 14:47:32.663444 19763 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2035f77d5cad423589f3742d6c2d7486 [sys.catalog]: This master's current role is: LEADER
I20260808 14:47:32.664259 19738 sys_catalog.cc:455] T 00000000000000000000000000000000 P 89459175f2ed4000a8cbf64ec271b7a7 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2035f77d5cad423589f3742d6c2d7486" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89459175f2ed4000a8cbf64ec271b7a7" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 45827 } } peers { permanent_uuid: "2035f77d5cad423589f3742d6c2d7486" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 43455 } } peers { permanent_uuid: "5a81a8d3711d4f01822c789a3eb6fa46" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 42713 } } }
I20260808 14:47:32.664347 19738 sys_catalog.cc:458] T 00000000000000000000000000000000 P 89459175f2ed4000a8cbf64ec271b7a7 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:47:32.664572 19791 mvcc.cc:205] Tried to move back new op lower bound from 7316277054074662912 to 7316277054064451584. Current Snapshot: MvccSnapshot[applied={T|T < 7316277054074662912}]
I20260808 14:47:32.665640 19785 catalog_manager.cc:1347] Generated new cluster ID: 98af415381434ac9b08d9ac21b0e4b11
I20260808 14:47:32.665700 19785 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:47:32.678385 19785 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:47:32.679250 19785 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:47:32.686180 19785 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2035f77d5cad423589f3742d6c2d7486: Generated new TSK 0
I20260808 14:47:32.686525 19785 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:47:33.577128 19735 catalog_manager.cc:1259] Loaded cluster ID: 98af415381434ac9b08d9ac21b0e4b11
I20260808 14:47:33.577211 19735 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 5a81a8d3711d4f01822c789a3eb6fa46: loading cluster ID for follower catalog manager: success
I20260808 14:47:33.578050 19735 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 5a81a8d3711d4f01822c789a3eb6fa46: acquiring CA information for follower catalog manager: success
I20260808 14:47:33.578344 19735 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 5a81a8d3711d4f01822c789a3eb6fa46: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 14:47:33.595834 19760 catalog_manager.cc:1259] Loaded cluster ID: 98af415381434ac9b08d9ac21b0e4b11
I20260808 14:47:33.595906 19760 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 89459175f2ed4000a8cbf64ec271b7a7: loading cluster ID for follower catalog manager: success
I20260808 14:47:33.596732 19760 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 89459175f2ed4000a8cbf64ec271b7a7: acquiring CA information for follower catalog manager: success
I20260808 14:47:33.597028 19760 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 89459175f2ed4000a8cbf64ec271b7a7: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 14:47:33.741328 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 19375
I20260808 14:47:33.754253 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 19487
I20260808 14:47:33.765101 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 19595
2026-08-08T14:47:33Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (2931 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200295877777-31578-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:47:33 dist-test-slave-42z9 krb5kdc[19813](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:47:33 dist-test-slave-42z9 krb5kdc[19813](info): set up 2 sockets
Aug 08 14:47:33 dist-test-slave-42z9 krb5kdc[19813](info): commencing operation
krb5kdc: starting...
W20260808 14:47:34.896003 31578 mini_kdc.cc:121] Time spent starting KDC: real 1.106s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Aug 08 14:47:34 dist-test-slave-42z9 krb5kdc[19813](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200454, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:47:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:47:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.214.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab.
Entry for principal kudu/127.30.214.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab.
I20260808 14:47:35.015436 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200295877777-31578-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200295877777-31578-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200295877777-31578-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:42143
--webserver_interface=127.30.214.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab
--principal=kudu/127.30.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:46701
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.214.190:42143
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:47:35.095873 19830 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:47:35.096089 19830 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:47:35.096110 19830 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:47:35.097242 19830 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:47:35.097283 19830 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:47:35.097296 19830 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:47:35.097309 19830 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:47:35.097354 19830 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:47:35.098882 19830 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:46701
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200295877777-31578-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200295877777-31578-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.214.190:42143
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab
--principal=kudu/127.30.214.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:42143
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19830
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200295877777-31578-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:47:35.099128 19830 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:47:35.099341 19830 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:47:35.104043 19840 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:47:35.104089 19843 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:47:35.104053 19841 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:47:35.104223 19830 server_base.cc:1034] running on GCE node
I20260808 14:47:35.104514 19830 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:47:35.104796 19830 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:47:35.105930 19830 hybrid_clock.cc:648] HybridClock initialized: now 1786200455105915 us; error 28 us; skew 500 ppm
Aug 08 14:47:35 dist-test-slave-42z9 krb5kdc[19813](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200455, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:47:35.108480 19830 init.cc:377] Logged in from keytab as kudu/127.30.214.190@KRBTEST.COM (short username kudu)
I20260808 14:47:35.108891 19830 webserver.cc:460] Webserver started at http://127.30.214.190:41029/ using document root <none> and password file <none>
I20260808 14:47:35.109112 19830 fs_manager.cc:359] Metadata directory not provided
I20260808 14:47:35.109160 19830 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:47:35.109285 19830 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:47:35.110390 19830 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200295877777-31578-0/minicluster-data/master-0/data/instance:
uuid: "443b27302a35443899760fd03e9c1c74"
format_stamp: "Formatted at 2026-08-08 14:47:35 on dist-test-slave-42z9"
server_key: "fa95aa04337d31835f7815e45faf521e"
server_key_iv: "615a858d041dfe060f590e47efec4206"
server_key_version: "encryptionkey@0"
I20260808 14:47:35.110726 19830 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200295877777-31578-0/minicluster-data/master-0/wal/instance:
uuid: "443b27302a35443899760fd03e9c1c74"
format_stamp: "Formatted at 2026-08-08 14:47:35 on dist-test-slave-42z9"
server_key: "fa95aa04337d31835f7815e45faf521e"
server_key_iv: "615a858d041dfe060f590e47efec4206"
server_key_version: "encryptionkey@0"
I20260808 14:47:35.111948 19830 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:47:35.112605 19857 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:47:35.112751 19830 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:47:35.112835 19830 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200295877777-31578-0/minicluster-data/master-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200295877777-31578-0/minicluster-data/master-0/wal
uuid: "443b27302a35443899760fd03e9c1c74"
format_stamp: "Formatted at 2026-08-08 14:47:35 on dist-test-slave-42z9"
server_key: "fa95aa04337d31835f7815e45faf521e"
server_key_iv: "615a858d041dfe060f590e47efec4206"
server_key_version: "encryptionkey@0"
I20260808 14:47:35.112897 19830 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200295877777-31578-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200295877777-31578-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200295877777-31578-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:47:35.152582 19830 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:47:35.155297 19830 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:47:35.155516 19830 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:47:35.160302 19830 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.190:42143
I20260808 14:47:35.160337 19935 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.190:42143 every 8 connection(s)
I20260808 14:47:35.160692 19830 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
I20260808 14:47:35.161603 19937 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:47:35.163918 19937 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 443b27302a35443899760fd03e9c1c74: Bootstrap starting.
I20260808 14:47:35.164520 19937 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 443b27302a35443899760fd03e9c1c74: Neither blocks nor log segments found. Creating new log.
I20260808 14:47:35.164796 19937 log.cc:824] T 00000000000000000000000000000000 P 443b27302a35443899760fd03e9c1c74: Log is configured to *not* fsync() on all Append() calls
I20260808 14:47:35.165498 19937 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 443b27302a35443899760fd03e9c1c74: No bootstrap required, opened a new log
I20260808 14:47:35.167073 19937 raft_consensus.cc:348] T 00000000000000000000000000000000 P 443b27302a35443899760fd03e9c1c74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "443b27302a35443899760fd03e9c1c74" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 42143 } }
I20260808 14:47:35.167212 19937 raft_consensus.cc:374] T 00000000000000000000000000000000 P 443b27302a35443899760fd03e9c1c74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:47:35.167234 19937 raft_consensus.cc:729] T 00000000000000000000000000000000 P 443b27302a35443899760fd03e9c1c74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 443b27302a35443899760fd03e9c1c74, State: Initialized, Role: FOLLOWER
I20260808 14:47:35.167377 19937 consensus_queue.cc:260] T 00000000000000000000000000000000 P 443b27302a35443899760fd03e9c1c74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "443b27302a35443899760fd03e9c1c74" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 42143 } }
I20260808 14:47:35.167438 19937 raft_consensus.cc:388] T 00000000000000000000000000000000 P 443b27302a35443899760fd03e9c1c74 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:47:35.167457 19937 raft_consensus.cc:482] T 00000000000000000000000000000000 P 443b27302a35443899760fd03e9c1c74 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:47:35.167486 19937 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 443b27302a35443899760fd03e9c1c74 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:47:35.168013 19937 raft_consensus.cc:504] T 00000000000000000000000000000000 P 443b27302a35443899760fd03e9c1c74 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "443b27302a35443899760fd03e9c1c74" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 42143 } }
I20260808 14:47:35.168103 19937 leader_election.cc:302] T 00000000000000000000000000000000 P 443b27302a35443899760fd03e9c1c74 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 443b27302a35443899760fd03e9c1c74; no voters:
I20260808 14:47:35.168264 19937 leader_election.cc:288] T 00000000000000000000000000000000 P 443b27302a35443899760fd03e9c1c74 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:47:35.168313 19943 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 443b27302a35443899760fd03e9c1c74 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:47:35.168501 19943 raft_consensus.cc:686] T 00000000000000000000000000000000 P 443b27302a35443899760fd03e9c1c74 [term 1 LEADER]: Becoming Leader. State: Replica: 443b27302a35443899760fd03e9c1c74, State: Running, Role: LEADER
I20260808 14:47:35.168510 19937 sys_catalog.cc:564] T 00000000000000000000000000000000 P 443b27302a35443899760fd03e9c1c74 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:47:35.168601 19943 consensus_queue.cc:237] T 00000000000000000000000000000000 P 443b27302a35443899760fd03e9c1c74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "443b27302a35443899760fd03e9c1c74" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 42143 } }
I20260808 14:47:35.169121 19944 sys_catalog.cc:455] T 00000000000000000000000000000000 P 443b27302a35443899760fd03e9c1c74 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "443b27302a35443899760fd03e9c1c74" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "443b27302a35443899760fd03e9c1c74" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 42143 } } }
I20260808 14:47:35.169207 19944 sys_catalog.cc:458] T 00000000000000000000000000000000 P 443b27302a35443899760fd03e9c1c74 [sys.catalog]: This master's current role is: LEADER
I20260808 14:47:35.169400 19945 sys_catalog.cc:455] T 00000000000000000000000000000000 P 443b27302a35443899760fd03e9c1c74 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 443b27302a35443899760fd03e9c1c74. Latest consensus state: current_term: 1 leader_uuid: "443b27302a35443899760fd03e9c1c74" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "443b27302a35443899760fd03e9c1c74" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 42143 } } }
I20260808 14:47:35.169561 19945 sys_catalog.cc:458] T 00000000000000000000000000000000 P 443b27302a35443899760fd03e9c1c74 [sys.catalog]: This master's current role is: LEADER
I20260808 14:47:35.169643 19955 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:47:35.170118 19955 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:47:35.170730 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 19830
I20260808 14:47:35.170826 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786200295877777-31578-0/minicluster-data/master-0/wal/instance
I20260808 14:47:35.170994 31578 external_mini_cluster.cc:1428] Setting key d0bf802e19571ba975523fce75857834
I20260808 14:47:35.172466 19955 catalog_manager.cc:1347] Generated new cluster ID: 604fd62b4380419cbc9b6e19ef344d65
I20260808 14:47:35.172526 19955 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 14:47:35 dist-test-slave-42z9 krb5kdc[19813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200454, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:47:35.180898 19969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:35.171435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55098 (local address 127.30.214.190:42143)
0808 14:47:35.171963 (+ 528us) server_negotiation.cc:206] Beginning negotiation
0808 14:47:35.171971 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:47:35.172002 (+ 31us) server_negotiation.cc:407] Connection header received
0808 14:47:35.172115 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:47:35.172122 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:47:35.172175 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:47:35.172329 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:47:35.172933 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:35.173904 (+ 971us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:35.174629 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:35.175057 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:35.175168 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:35.177348 (+ 2180us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:47:35.177352 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:47:35.177352 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:47:35.177364 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:47:35.178911 (+ 1547us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:35.179225 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:35.179228 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:35.179228 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:35.179380 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:35.179595 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:35.179595 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:35.179596 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:35.179928 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:47:35.180117 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0808 14:47:35.180571 (+ 454us) server_negotiation.cc:299] Negotiation successful
0808 14:47:35.180730 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":490,"thread_start_us":65,"threads_started":1}
I20260808 14:47:35.181857 31578 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:47:35.186329 19955 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:47:35.187289 19955 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:47:35.191938 19955 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 443b27302a35443899760fd03e9c1c74: Generated new TSK 0
I20260808 14:47:35.192138 19955 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:47:35.235481 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 19830
2026-08-08T14:47:35Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1473 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:47:35 dist-test-slave-42z9 krb5kdc[19974](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:47:35 dist-test-slave-42z9 krb5kdc[19974](info): set up 2 sockets
Aug 08 14:47:35 dist-test-slave-42z9 krb5kdc[19974](info): commencing operation
krb5kdc: starting...
W20260808 14:47:36.367697 31578 mini_kdc.cc:121] Time spent starting KDC: real 1.104s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Aug 08 14:47:36 dist-test-slave-42z9 krb5kdc[19974](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200456, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:47:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:47:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.214.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab.
Entry for principal kudu/127.30.214.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab.
I20260808 14:47:36.487614 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:38717
--webserver_interface=127.30.214.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab
--principal=kudu/127.30.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:34133
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.214.190:38717
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:47:36.570218 19994 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:47:36.570439 19994 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:47:36.570462 19994 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:47:36.571635 19994 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:47:36.571676 19994 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:47:36.571691 19994 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:47:36.571702 19994 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:47:36.571725 19994 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:47:36.573254 19994 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:34133
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.214.190:38717
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab
--principal=kudu/127.30.214.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:38717
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19994
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:47:36.573526 19994 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:47:36.573748 19994 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:47:36.578627 20000 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:47:36.578665 20004 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:47:36.578629 20002 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:47:36.578644 19994 server_base.cc:1034] running on GCE node
I20260808 14:47:36.579030 19994 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:47:36.579299 19994 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:47:36.580437 19994 hybrid_clock.cc:648] HybridClock initialized: now 1786200456580423 us; error 30 us; skew 500 ppm
Aug 08 14:47:36 dist-test-slave-42z9 krb5kdc[19974](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200456, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:47:36.588095 19994 init.cc:377] Logged in from keytab as kudu/127.30.214.190@KRBTEST.COM (short username kudu)
I20260808 14:47:36.588577 19994 webserver.cc:460] Webserver started at http://127.30.214.190:34327/ using document root <none> and password file <none>
I20260808 14:47:36.588805 19994 fs_manager.cc:359] Metadata directory not provided
I20260808 14:47:36.588855 19994 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:47:36.588979 19994 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:47:36.590101 19994 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/master-0/data/instance:
uuid: "97940778e9cb4bd8a14393fcbc4f9b20"
format_stamp: "Formatted at 2026-08-08 14:47:36 on dist-test-slave-42z9"
server_key: "90915863c18ae84b7e8c60b724262d66"
server_key_iv: "080b1e763b01888ab95345f9232f4bc0"
server_key_version: "encryptionkey@0"
I20260808 14:47:36.590430 19994 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/master-0/wal/instance:
uuid: "97940778e9cb4bd8a14393fcbc4f9b20"
format_stamp: "Formatted at 2026-08-08 14:47:36 on dist-test-slave-42z9"
server_key: "90915863c18ae84b7e8c60b724262d66"
server_key_iv: "080b1e763b01888ab95345f9232f4bc0"
server_key_version: "encryptionkey@0"
I20260808 14:47:36.591719 19994 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:47:36.592406 20013 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:47:36.592579 19994 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:47:36.592666 19994 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/master-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/master-0/wal
uuid: "97940778e9cb4bd8a14393fcbc4f9b20"
format_stamp: "Formatted at 2026-08-08 14:47:36 on dist-test-slave-42z9"
server_key: "90915863c18ae84b7e8c60b724262d66"
server_key_iv: "080b1e763b01888ab95345f9232f4bc0"
server_key_version: "encryptionkey@0"
I20260808 14:47:36.592731 19994 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:47:36.625042 19994 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:47:36.627306 19994 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:47:36.627455 19994 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:47:36.631635 19994 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.190:38717
I20260808 14:47:36.631675 20083 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.190:38717 every 8 connection(s)
I20260808 14:47:36.632023 19994 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
I20260808 14:47:36.633090 20084 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:47:36.633224 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 19994
I20260808 14:47:36.633314 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/master-0/wal/instance
I20260808 14:47:36.633527 31578 external_mini_cluster.cc:1428] Setting key babb7249eba0c26154a64a9d0e0c074c
I20260808 14:47:36.636438 20084 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 97940778e9cb4bd8a14393fcbc4f9b20: Bootstrap starting.
I20260808 14:47:36.637182 20084 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 97940778e9cb4bd8a14393fcbc4f9b20: Neither blocks nor log segments found. Creating new log.
I20260808 14:47:36.637523 20084 log.cc:824] T 00000000000000000000000000000000 P 97940778e9cb4bd8a14393fcbc4f9b20: Log is configured to *not* fsync() on all Append() calls
I20260808 14:47:36.638257 20084 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 97940778e9cb4bd8a14393fcbc4f9b20: No bootstrap required, opened a new log
Aug 08 14:47:36 dist-test-slave-42z9 krb5kdc[19974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200456, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:47:36.640640 20084 raft_consensus.cc:348] T 00000000000000000000000000000000 P 97940778e9cb4bd8a14393fcbc4f9b20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97940778e9cb4bd8a14393fcbc4f9b20" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 38717 } }
I20260808 14:47:36.640828 20084 raft_consensus.cc:374] T 00000000000000000000000000000000 P 97940778e9cb4bd8a14393fcbc4f9b20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:47:36.640870 20084 raft_consensus.cc:729] T 00000000000000000000000000000000 P 97940778e9cb4bd8a14393fcbc4f9b20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97940778e9cb4bd8a14393fcbc4f9b20, State: Initialized, Role: FOLLOWER
I20260808 14:47:36.641009 20084 consensus_queue.cc:260] T 00000000000000000000000000000000 P 97940778e9cb4bd8a14393fcbc4f9b20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97940778e9cb4bd8a14393fcbc4f9b20" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 38717 } }
I20260808 14:47:36.641086 20084 raft_consensus.cc:388] T 00000000000000000000000000000000 P 97940778e9cb4bd8a14393fcbc4f9b20 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:47:36.641108 20084 raft_consensus.cc:482] T 00000000000000000000000000000000 P 97940778e9cb4bd8a14393fcbc4f9b20 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:47:36.641153 20084 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 97940778e9cb4bd8a14393fcbc4f9b20 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:47:36.641773 20084 raft_consensus.cc:504] T 00000000000000000000000000000000 P 97940778e9cb4bd8a14393fcbc4f9b20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97940778e9cb4bd8a14393fcbc4f9b20" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 38717 } }
I20260808 14:47:36.641876 20084 leader_election.cc:302] T 00000000000000000000000000000000 P 97940778e9cb4bd8a14393fcbc4f9b20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 97940778e9cb4bd8a14393fcbc4f9b20; no voters:
I20260808 14:47:36.642047 20084 leader_election.cc:288] T 00000000000000000000000000000000 P 97940778e9cb4bd8a14393fcbc4f9b20 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:47:36.642096 20097 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 97940778e9cb4bd8a14393fcbc4f9b20 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:47:36.642238 20097 raft_consensus.cc:686] T 00000000000000000000000000000000 P 97940778e9cb4bd8a14393fcbc4f9b20 [term 1 LEADER]: Becoming Leader. State: Replica: 97940778e9cb4bd8a14393fcbc4f9b20, State: Running, Role: LEADER
I20260808 14:47:36.642345 20084 sys_catalog.cc:564] T 00000000000000000000000000000000 P 97940778e9cb4bd8a14393fcbc4f9b20 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:47:36.642344 20097 consensus_queue.cc:237] T 00000000000000000000000000000000 P 97940778e9cb4bd8a14393fcbc4f9b20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97940778e9cb4bd8a14393fcbc4f9b20" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 38717 } }
I20260808 14:47:36.642848 20098 sys_catalog.cc:455] T 00000000000000000000000000000000 P 97940778e9cb4bd8a14393fcbc4f9b20 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "97940778e9cb4bd8a14393fcbc4f9b20" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97940778e9cb4bd8a14393fcbc4f9b20" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 38717 } } }
I20260808 14:47:36.642930 20098 sys_catalog.cc:458] T 00000000000000000000000000000000 P 97940778e9cb4bd8a14393fcbc4f9b20 [sys.catalog]: This master's current role is: LEADER
I20260808 14:47:36.643134 20100 sys_catalog.cc:455] T 00000000000000000000000000000000 P 97940778e9cb4bd8a14393fcbc4f9b20 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 97940778e9cb4bd8a14393fcbc4f9b20. Latest consensus state: current_term: 1 leader_uuid: "97940778e9cb4bd8a14393fcbc4f9b20" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97940778e9cb4bd8a14393fcbc4f9b20" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 38717 } } }
I20260808 14:47:36.643252 20100 sys_catalog.cc:458] T 00000000000000000000000000000000 P 97940778e9cb4bd8a14393fcbc4f9b20 [sys.catalog]: This master's current role is: LEADER
I20260808 14:47:36.643407 20109 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:47:36.643997 20109 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:47:36.644665 20090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:36.634106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53620 (local address 127.30.214.190:38717)
0808 14:47:36.634292 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0808 14:47:36.634301 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:47:36.634329 (+ 28us) server_negotiation.cc:407] Connection header received
0808 14:47:36.634779 (+ 450us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:47:36.634786 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:47:36.634834 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:47:36.634957 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:47:36.635702 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:36.636613 (+ 911us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:36.637668 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:36.638200 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:36.638292 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:36.640942 (+ 2650us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:47:36.640947 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:47:36.640948 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:47:36.640961 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:47:36.642831 (+ 1870us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:36.643275 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:36.643278 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:36.643279 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:36.643389 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:36.643618 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:36.643619 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:36.643619 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:36.643925 (+ 306us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:47:36.644074 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0808 14:47:36.644216 (+ 142us) server_negotiation.cc:299] Negotiation successful
0808 14:47:36.644462 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":81,"threads_started":1}
I20260808 14:47:36.645766 20109 catalog_manager.cc:1347] Generated new cluster ID: a53b7c3ba2cb438c8425a3babc0ad873
I20260808 14:47:36.645819 20109 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:47:36.659780 20109 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:47:36.660519 20109 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:47:36.666951 20109 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 97940778e9cb4bd8a14393fcbc4f9b20: Generated new TSK 0
I20260808 14:47:36.667160 20109 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.214.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab.
Entry for principal kudu/127.30.214.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab.
I20260808 14:47:36.694082 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.129:0
--local_ip_for_outbound_sockets=127.30.214.129
--webserver_interface=127.30.214.129
--webserver_port=0
--tserver_master_addrs=127.30.214.190:38717
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab
--principal=kudu/127.30.214.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:34133
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:47:36.776628 20127 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:47:36.776829 20127 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:47:36.776858 20127 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:47:36.778031 20127 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:47:36.778072 20127 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:47:36.778100 20127 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.129
I20260808 14:47:36.779615 20127 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:34133
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab
--principal=kudu/127.30.214.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.214.129
--webserver_port=0
--tserver_master_addrs=127.30.214.190:38717
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20127
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.129
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:47:36.779843 20127 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:47:36.780063 20127 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:47:36.784857 20138 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:47:36.784986 20135 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:47:36.784966 20127 server_base.cc:1034] running on GCE node
W20260808 14:47:36.784883 20133 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:47:36.785291 20127 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:47:36.785578 20127 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:47:36.786718 20127 hybrid_clock.cc:648] HybridClock initialized: now 1786200456786708 us; error 31 us; skew 500 ppm
Aug 08 14:47:36 dist-test-slave-42z9 krb5kdc[19974](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200456, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:47:36.789232 20127 init.cc:377] Logged in from keytab as kudu/127.30.214.129@KRBTEST.COM (short username kudu)
I20260808 14:47:36.789688 20127 webserver.cc:460] Webserver started at http://127.30.214.129:35775/ using document root <none> and password file <none>
I20260808 14:47:36.789876 20127 fs_manager.cc:359] Metadata directory not provided
I20260808 14:47:36.789916 20127 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:47:36.790004 20127 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:47:36.790989 20127 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-0/data/instance:
uuid: "10c596e3a5ba4fe39a038d22df98111a"
format_stamp: "Formatted at 2026-08-08 14:47:36 on dist-test-slave-42z9"
server_key: "a466ba0016cc18752c7277fb05f3da7c"
server_key_iv: "275be272aa060975a69078a2595045cc"
server_key_version: "encryptionkey@0"
I20260808 14:47:36.791288 20127 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-0/wal/instance:
uuid: "10c596e3a5ba4fe39a038d22df98111a"
format_stamp: "Formatted at 2026-08-08 14:47:36 on dist-test-slave-42z9"
server_key: "a466ba0016cc18752c7277fb05f3da7c"
server_key_iv: "275be272aa060975a69078a2595045cc"
server_key_version: "encryptionkey@0"
I20260808 14:47:36.792477 20127 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:47:36.793133 20148 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:47:36.793294 20127 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:47:36.793380 20127 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-0/wal
uuid: "10c596e3a5ba4fe39a038d22df98111a"
format_stamp: "Formatted at 2026-08-08 14:47:36 on dist-test-slave-42z9"
server_key: "a466ba0016cc18752c7277fb05f3da7c"
server_key_iv: "275be272aa060975a69078a2595045cc"
server_key_version: "encryptionkey@0"
I20260808 14:47:36.793455 20127 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:47:36.805512 20127 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:47:36.807282 20127 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:47:36.807394 20127 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:47:36.807585 20127 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:47:36.807860 20127 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:47:36.807890 20127 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:47:36.807910 20127 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:47:36.807927 20127 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:47:36.813364 20127 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.129:42291
I20260808 14:47:36.813483 20314 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.129:42291 every 8 connection(s)
I20260808 14:47:36.813756 20127 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
Aug 08 14:47:36 dist-test-slave-42z9 krb5kdc[19974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200456, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.129@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:47:36.819913 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 20127
I20260808 14:47:36.820021 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-0/wal/instance
I20260808 14:47:36.820209 31578 external_mini_cluster.cc:1428] Setting key 8e4c902a3ce6325f06585dd12fd9f056
I20260808 14:47:36.822508 20090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:36.814464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.129:43251 (local address 127.30.214.190:38717)
0808 14:47:36.814524 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0808 14:47:36.814526 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:47:36.814725 (+ 199us) server_negotiation.cc:407] Connection header received
0808 14:47:36.815200 (+ 475us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:47:36.815201 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:47:36.815210 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:47:36.815264 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:47:36.816176 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:36.816676 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:36.817606 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:36.817797 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:36.817841 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:36.819803 (+ 1962us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:47:36.819805 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:47:36.819805 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:47:36.819813 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:47:36.821245 (+ 1432us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:36.821659 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:36.821660 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:36.821661 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:36.821726 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:36.821931 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:36.821931 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:36.821931 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:36.822051 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:47:36.822119 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 14:47:36.822322 (+ 203us) server_negotiation.cc:299] Negotiation successful
0808 14:47:36.822419 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 14:47:36.822592 20322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:36.814435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:38717 (local address 127.30.214.129:43251)
0808 14:47:36.814600 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:36.814642 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 14:47:36.815126 (+ 484us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:47:36.815318 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:47:36.815321 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:47:36.815885 (+ 564us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:47:36.816103 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:36.816108 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:36.816741 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:36.816742 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:36.817543 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:36.817546 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:36.817853 (+ 307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:36.817853 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:36.817945 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:36.818369 (+ 424us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:47:36.818377 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:47:36.819711 (+ 1334us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:47:36.821315 (+ 1604us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:47:36.821322 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:47:36.821324 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:47:36.821594 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:47:36.821784 (+ 190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:47:36.821785 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:47:36.821785 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:47:36.821880 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:47:36.822109 (+ 229us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:47:36.822111 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:47:36.822219 (+ 108us) client_negotiation.cc:769] Sending connection context
0808 14:47:36.822293 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 14:47:36.822412 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":77,"threads_started":1}
I20260808 14:47:36.823204 20315 heartbeater.cc:347] Connected to a master server at 127.30.214.190:38717
I20260808 14:47:36.823318 20315 heartbeater.cc:464] Registering TS with master...
I20260808 14:47:36.823523 20315 heartbeater.cc:511] Master 127.30.214.190:38717 requested a full tablet report, sending...
I20260808 14:47:36.824055 20033 ts_manager.cc:194] Registered new tserver with Master: 10c596e3a5ba4fe39a038d22df98111a (127.30.214.129:42291)
I20260808 14:47:36.824685 20033 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.214.129@KRBTEST.COM'} at 127.30.214.129:43251
WARNING: no policy specified for kudu/127.30.214.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab.
Entry for principal kudu/127.30.214.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab.
I20260808 14:47:36.845600 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.130:0
--local_ip_for_outbound_sockets=127.30.214.130
--webserver_interface=127.30.214.130
--webserver_port=0
--tserver_master_addrs=127.30.214.190:38717
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab
--principal=kudu/127.30.214.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:34133
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:47:36.927161 20330 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:47:36.927361 20330 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:47:36.927385 20330 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:47:36.928539 20330 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:47:36.928580 20330 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:47:36.928611 20330 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.130
I20260808 14:47:36.930102 20330 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:34133
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab
--principal=kudu/127.30.214.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.214.130
--webserver_port=0
--tserver_master_addrs=127.30.214.190:38717
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20330
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.130
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:47:36.930326 20330 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:47:36.930542 20330 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:47:36.935559 20337 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:47:36.935559 20336 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:47:36.935565 20343 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:47:36.935614 20330 server_base.cc:1034] running on GCE node
I20260808 14:47:36.936156 20330 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:47:36.936406 20330 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:47:36.937496 20330 hybrid_clock.cc:648] HybridClock initialized: now 1786200456937485 us; error 32 us; skew 500 ppm
Aug 08 14:47:36 dist-test-slave-42z9 krb5kdc[19974](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200456, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:47:36.939916 20330 init.cc:377] Logged in from keytab as kudu/127.30.214.130@KRBTEST.COM (short username kudu)
I20260808 14:47:36.940335 20330 webserver.cc:460] Webserver started at http://127.30.214.130:34961/ using document root <none> and password file <none>
I20260808 14:47:36.940508 20330 fs_manager.cc:359] Metadata directory not provided
I20260808 14:47:36.940546 20330 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:47:36.940636 20330 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:47:36.941658 20330 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-1/data/instance:
uuid: "d8babb5bfd404a14af9ba9ed23500a59"
format_stamp: "Formatted at 2026-08-08 14:47:36 on dist-test-slave-42z9"
server_key: "8eacc4305e5bb9943218e5ad84d42280"
server_key_iv: "28e454b6c592effb6d299fbee5698423"
server_key_version: "encryptionkey@0"
I20260808 14:47:36.941963 20330 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-1/wal/instance:
uuid: "d8babb5bfd404a14af9ba9ed23500a59"
format_stamp: "Formatted at 2026-08-08 14:47:36 on dist-test-slave-42z9"
server_key: "8eacc4305e5bb9943218e5ad84d42280"
server_key_iv: "28e454b6c592effb6d299fbee5698423"
server_key_version: "encryptionkey@0"
I20260808 14:47:36.943320 20330 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:47:36.943995 20352 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:47:36.944159 20330 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:47:36.944243 20330 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-1/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-1/wal
uuid: "d8babb5bfd404a14af9ba9ed23500a59"
format_stamp: "Formatted at 2026-08-08 14:47:36 on dist-test-slave-42z9"
server_key: "8eacc4305e5bb9943218e5ad84d42280"
server_key_iv: "28e454b6c592effb6d299fbee5698423"
server_key_version: "encryptionkey@0"
I20260808 14:47:36.944304 20330 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:47:36.966252 20330 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:47:36.968070 20330 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:47:36.968214 20330 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:47:36.968444 20330 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:47:36.968771 20330 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:47:36.968806 20330 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:47:36.968835 20330 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:47:36.968854 20330 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:47:36.974507 20330 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.130:35839
I20260808 14:47:36.974566 20503 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.130:35839 every 8 connection(s)
I20260808 14:47:36.974869 20330 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
Aug 08 14:47:36 dist-test-slave-42z9 krb5kdc[19974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200456, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.130@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:47:36.980916 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 20330
I20260808 14:47:36.981009 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-1/wal/instance
I20260808 14:47:36.981160 31578 external_mini_cluster.cc:1428] Setting key a486ee1a747193be1832cf87aefe08aa
I20260808 14:47:36.984033 20090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:36.975615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.130:47041 (local address 127.30.214.190:38717)
0808 14:47:36.975677 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 14:47:36.975678 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:47:36.975874 (+ 196us) server_negotiation.cc:407] Connection header received
0808 14:47:36.976397 (+ 523us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:47:36.976399 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:47:36.976411 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:47:36.976463 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:47:36.977419 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:36.977953 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:36.978908 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:36.979120 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:36.979177 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:36.981313 (+ 2136us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:47:36.981314 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:47:36.981315 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:47:36.981323 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:47:36.982655 (+ 1332us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:36.983044 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:36.983045 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:36.983045 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:36.983100 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:36.983325 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:36.983326 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:36.983326 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:36.983454 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:47:36.983523 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 14:47:36.983851 (+ 328us) server_negotiation.cc:299] Negotiation successful
0808 14:47:36.983942 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 14:47:36.984157 20508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:36.975606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:38717 (local address 127.30.214.130:47041)
0808 14:47:36.975751 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:36.975788 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 14:47:36.976289 (+ 501us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:47:36.976531 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:47:36.976535 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:47:36.977114 (+ 579us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:47:36.977311 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:36.977316 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:36.978045 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:36.978046 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:36.978824 (+ 778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:36.978826 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:36.979192 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:36.979193 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:36.979308 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:36.979832 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:47:36.979841 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:47:36.981230 (+ 1389us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:47:36.982732 (+ 1502us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:47:36.982739 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:47:36.982742 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:47:36.982975 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:47:36.983156 (+ 181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:47:36.983156 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:47:36.983157 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:47:36.983268 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:47:36.983535 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:47:36.983543 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:47:36.983724 (+ 181us) client_negotiation.cc:769] Sending connection context
0808 14:47:36.983820 (+ 96us) client_negotiation.cc:240] Negotiation successful
0808 14:47:36.983958 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":75,"threads_started":1}
I20260808 14:47:36.984639 20506 heartbeater.cc:347] Connected to a master server at 127.30.214.190:38717
I20260808 14:47:36.984733 20506 heartbeater.cc:464] Registering TS with master...
I20260808 14:47:36.984908 20506 heartbeater.cc:511] Master 127.30.214.190:38717 requested a full tablet report, sending...
I20260808 14:47:36.985265 20033 ts_manager.cc:194] Registered new tserver with Master: d8babb5bfd404a14af9ba9ed23500a59 (127.30.214.130:35839)
I20260808 14:47:36.985689 20033 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.214.130@KRBTEST.COM'} at 127.30.214.130:47041
WARNING: no policy specified for kudu/127.30.214.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab.
Entry for principal kudu/127.30.214.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab.
I20260808 14:47:37.007771 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.131:0
--local_ip_for_outbound_sockets=127.30.214.131
--webserver_interface=127.30.214.131
--webserver_port=0
--tserver_master_addrs=127.30.214.190:38717
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab
--principal=kudu/127.30.214.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:34133
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:47:37.089046 20516 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:47:37.089249 20516 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:47:37.089272 20516 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:47:37.090379 20516 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:47:37.090416 20516 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:47:37.090441 20516 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.131
I20260808 14:47:37.091831 20516 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:34133
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab
--principal=kudu/127.30.214.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.214.131
--webserver_port=0
--tserver_master_addrs=127.30.214.190:38717
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20516
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.131
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:47:37.092015 20516 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:47:37.092195 20516 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:47:37.097219 20526 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:47:37.097312 20516 server_base.cc:1034] running on GCE node
W20260808 14:47:37.097184 20521 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:47:37.097208 20523 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:47:37.097627 20516 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:47:37.097867 20516 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:47:37.099002 20516 hybrid_clock.cc:648] HybridClock initialized: now 1786200457098990 us; error 29 us; skew 500 ppm
Aug 08 14:47:37 dist-test-slave-42z9 krb5kdc[19974](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200457, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:47:37.101424 20516 init.cc:377] Logged in from keytab as kudu/127.30.214.131@KRBTEST.COM (short username kudu)
I20260808 14:47:37.101858 20516 webserver.cc:460] Webserver started at http://127.30.214.131:40255/ using document root <none> and password file <none>
I20260808 14:47:37.102056 20516 fs_manager.cc:359] Metadata directory not provided
I20260808 14:47:37.102104 20516 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:47:37.102228 20516 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:47:37.103291 20516 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-2/data/instance:
uuid: "1e60ec8293de4a4da360818ddf52171e"
format_stamp: "Formatted at 2026-08-08 14:47:37 on dist-test-slave-42z9"
server_key: "b2d706caa50f55913359ac6ee9cbbaf2"
server_key_iv: "36f49d83a780b10682f2fb7ac6f046cd"
server_key_version: "encryptionkey@0"
I20260808 14:47:37.103621 20516 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-2/wal/instance:
uuid: "1e60ec8293de4a4da360818ddf52171e"
format_stamp: "Formatted at 2026-08-08 14:47:37 on dist-test-slave-42z9"
server_key: "b2d706caa50f55913359ac6ee9cbbaf2"
server_key_iv: "36f49d83a780b10682f2fb7ac6f046cd"
server_key_version: "encryptionkey@0"
I20260808 14:47:37.104837 20516 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 14:47:37.105479 20537 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:47:37.105628 20516 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:47:37.105710 20516 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-2/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-2/wal
uuid: "1e60ec8293de4a4da360818ddf52171e"
format_stamp: "Formatted at 2026-08-08 14:47:37 on dist-test-slave-42z9"
server_key: "b2d706caa50f55913359ac6ee9cbbaf2"
server_key_iv: "36f49d83a780b10682f2fb7ac6f046cd"
server_key_version: "encryptionkey@0"
I20260808 14:47:37.105770 20516 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:47:37.118705 20516 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:47:37.120544 20516 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:47:37.120692 20516 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:47:37.120911 20516 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:47:37.121213 20516 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:47:37.121248 20516 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:47:37.121276 20516 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:47:37.121299 20516 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:47:37.127130 20516 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.131:35081
I20260808 14:47:37.127188 20706 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.131:35081 every 8 connection(s)
I20260808 14:47:37.127487 20516 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
Aug 08 14:47:37 dist-test-slave-42z9 krb5kdc[19974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200457, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.131@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:47:37.133299 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 20516
I20260808 14:47:37.133388 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-2/wal/instance
I20260808 14:47:37.133598 31578 external_mini_cluster.cc:1428] Setting key 98fd2ce08f257fbb19738644c3e190d8
I20260808 14:47:37.136148 20090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:37.128174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:43119 (local address 127.30.214.190:38717)
0808 14:47:37.128250 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0808 14:47:37.128253 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:47:37.128420 (+ 167us) server_negotiation.cc:407] Connection header received
0808 14:47:37.128924 (+ 504us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:47:37.128925 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:47:37.128935 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:47:37.128975 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:47:37.129916 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:37.130404 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:37.131364 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:37.131565 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:37.131611 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:37.133760 (+ 2149us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:47:37.133762 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:47:37.133763 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:47:37.133772 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:47:37.135123 (+ 1351us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:37.135467 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:37.135468 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:37.135468 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:37.135526 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:37.135694 (+ 168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:37.135695 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:37.135695 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:37.135787 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:47:37.135830 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 14:47:37.136022 (+ 192us) server_negotiation.cc:299] Negotiation successful
0808 14:47:37.136085 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 14:47:37.136322 20711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:37.128124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:38717 (local address 127.30.214.131:43119)
0808 14:47:37.128288 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:37.128331 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 14:47:37.128833 (+ 502us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:47:37.129030 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:47:37.129033 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:47:37.129655 (+ 622us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:47:37.129849 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:37.129854 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:37.130468 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:37.130468 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:37.131290 (+ 822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:37.131293 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:37.131620 (+ 327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:37.131621 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:37.131714 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:37.132192 (+ 478us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:47:37.132200 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:47:37.133671 (+ 1471us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:47:37.135188 (+ 1517us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:47:37.135195 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:47:37.135196 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:47:37.135409 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:47:37.135571 (+ 162us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:47:37.135572 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:47:37.135572 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:47:37.135656 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:47:37.135829 (+ 173us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:47:37.135832 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:47:37.135938 (+ 106us) client_negotiation.cc:769] Sending connection context
0808 14:47:37.136011 (+ 73us) client_negotiation.cc:240] Negotiation successful
0808 14:47:37.136131 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":80,"threads_started":1}
I20260808 14:47:37.136787 20709 heartbeater.cc:347] Connected to a master server at 127.30.214.190:38717
I20260808 14:47:37.136873 20709 heartbeater.cc:464] Registering TS with master...
I20260808 14:47:37.137020 20709 heartbeater.cc:511] Master 127.30.214.190:38717 requested a full tablet report, sending...
I20260808 14:47:37.137355 20033 ts_manager.cc:194] Registered new tserver with Master: 1e60ec8293de4a4da360818ddf52171e (127.30.214.131:35081)
I20260808 14:47:37.137749 20033 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.214.131@KRBTEST.COM'} at 127.30.214.131:43119
I20260808 14:47:37.145262 31578 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:47:37.152463 20090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:37.146597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53626 (local address 127.30.214.190:38717)
0808 14:47:37.146639 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 14:47:37.146641 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:47:37.146741 (+ 100us) server_negotiation.cc:407] Connection header received
0808 14:47:37.146805 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:47:37.146807 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:47:37.146818 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:47:37.146861 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:47:37.147417 (+ 556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:37.147910 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:37.148615 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:37.148800 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:37.148853 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:37.150004 (+ 1151us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:47:37.150005 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:47:37.150005 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:47:37.150013 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:47:37.151424 (+ 1411us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:37.151736 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:37.151737 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:37.151737 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:37.151794 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:37.151954 (+ 160us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:37.151955 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:37.151955 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:37.152103 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:47:37.152192 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 14:47:37.152299 (+ 107us) server_negotiation.cc:299] Negotiation successful
0808 14:47:37.152373 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 14:47:37.155081 20033 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53626:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:47:37.157303 20033 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:47:37.163841 20723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:37.159554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48428 (local address 127.30.214.131:35081)
0808 14:47:37.159964 (+ 410us) server_negotiation.cc:206] Beginning negotiation
0808 14:47:37.159967 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:47:37.159976 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:47:37.160015 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:47:37.160017 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:47:37.160032 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:47:37.160128 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:47:37.160313 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:37.161525 (+ 1212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:37.162654 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:37.163353 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:37.163424 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:37.163482 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 14:47:37.163706 (+ 224us) server_negotiation.cc:299] Negotiation successful
0808 14:47:37.163748 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":374,"thread_start_us":90,"threads_started":1}
I20260808 14:47:37.163836 20720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:37.159390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.131:35081 (local address 127.0.0.1:48428)
0808 14:47:37.159571 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:37.159611 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 14:47:37.159672 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:47:37.160199 (+ 527us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:47:37.160200 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:47:37.160202 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:47:37.160239 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:37.160240 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:37.161652 (+ 1412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:37.161654 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:37.162577 (+ 923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:37.162580 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:37.163521 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:37.163522 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:37.163588 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:37.163612 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 14:47:37.163673 (+ 61us) client_negotiation.cc:240] Negotiation successful
0808 14:47:37.163750 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"mutex_wait_us":30,"thread_start_us":71,"threads_started":1}
I20260808 14:47:37.163839 20722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:37.159480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46200 (local address 127.30.214.130:35839)
0808 14:47:37.159697 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0808 14:47:37.159702 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:47:37.159854 (+ 152us) server_negotiation.cc:407] Connection header received
0808 14:47:37.159903 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:47:37.159905 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:47:37.159922 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:47:37.160001 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:47:37.160199 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:37.161525 (+ 1326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:37.162835 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:37.163508 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:37.163572 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:37.163620 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0808 14:47:37.163713 (+ 93us) server_negotiation.cc:299] Negotiation successful
0808 14:47:37.163758 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":186,"thread_start_us":108,"threads_started":1}
I20260808 14:47:37.164155 20721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:37.159390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.130:35839 (local address 127.0.0.1:46200)
0808 14:47:37.159773 (+ 383us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:37.159782 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:47:37.159839 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:47:37.160019 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:47:37.160022 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:47:37.160024 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:47:37.160103 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:37.160105 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:37.161626 (+ 1521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:37.161628 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:37.162747 (+ 1119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:37.162749 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:37.163576 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:37.163577 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:37.163626 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:37.163629 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:47:37.164023 (+ 394us) client_negotiation.cc:240] Negotiation successful
0808 14:47:37.164083 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":372,"mutex_wait_us":32,"thread_start_us":72,"threads_started":1}
I20260808 14:47:37.164088 20724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:37.159599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.129:42291 (local address 127.0.0.1:51168)
0808 14:47:37.159792 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:37.159801 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:47:37.159839 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:47:37.160294 (+ 455us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:47:37.160295 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:47:37.160298 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:47:37.160357 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:37.160359 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:37.161270 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:37.161271 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:37.162758 (+ 1487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:37.162760 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:37.163511 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:37.163511 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:37.163590 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:37.163605 (+ 15us) client_negotiation.cc:769] Sending connection context
0808 14:47:37.163673 (+ 68us) client_negotiation.cc:240] Negotiation successful
0808 14:47:37.163748 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":183,"mutex_wait_us":63,"thread_start_us":53,"threads_started":1}
I20260808 14:47:37.164564 20726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:37.159792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51168 (local address 127.30.214.129:42291)
0808 14:47:37.160129 (+ 337us) server_negotiation.cc:206] Beginning negotiation
0808 14:47:37.160134 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:47:37.160144 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:47:37.160182 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:47:37.160184 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:47:37.160199 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:47:37.160430 (+ 231us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:47:37.160493 (+ 63us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:37.161170 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:37.162847 (+ 1677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:37.163339 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:37.163424 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:37.163480 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 14:47:37.163798 (+ 318us) server_negotiation.cc:299] Negotiation successful
0808 14:47:37.163842 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":301,"thread_start_us":74,"threads_started":1}
I20260808 14:47:37.164692 20612 tablet_service.cc:1467] Processing CreateTablet for tablet 19f63eec4f5d44bc84c775baa95a3d8b (DEFAULT_TABLE table=test-table [id=3de4366bb19348b3acd48c83b1bcedb4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:47:37.164815 20415 tablet_service.cc:1467] Processing CreateTablet for tablet 19f63eec4f5d44bc84c775baa95a3d8b (DEFAULT_TABLE table=test-table [id=3de4366bb19348b3acd48c83b1bcedb4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:47:37.165110 20415 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19f63eec4f5d44bc84c775baa95a3d8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:47:37.165110 20612 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19f63eec4f5d44bc84c775baa95a3d8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:47:37.165166 20224 tablet_service.cc:1467] Processing CreateTablet for tablet 19f63eec4f5d44bc84c775baa95a3d8b (DEFAULT_TABLE table=test-table [id=3de4366bb19348b3acd48c83b1bcedb4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:47:37.165544 20224 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19f63eec4f5d44bc84c775baa95a3d8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:47:37.168066 20728 tablet_bootstrap.cc:492] T 19f63eec4f5d44bc84c775baa95a3d8b P 10c596e3a5ba4fe39a038d22df98111a: Bootstrap starting.
I20260808 14:47:37.168476 20730 tablet_bootstrap.cc:492] T 19f63eec4f5d44bc84c775baa95a3d8b P 1e60ec8293de4a4da360818ddf52171e: Bootstrap starting.
I20260808 14:47:37.168668 20729 tablet_bootstrap.cc:492] T 19f63eec4f5d44bc84c775baa95a3d8b P d8babb5bfd404a14af9ba9ed23500a59: Bootstrap starting.
I20260808 14:47:37.169166 20730 tablet_bootstrap.cc:654] T 19f63eec4f5d44bc84c775baa95a3d8b P 1e60ec8293de4a4da360818ddf52171e: Neither blocks nor log segments found. Creating new log.
I20260808 14:47:37.169166 20728 tablet_bootstrap.cc:654] T 19f63eec4f5d44bc84c775baa95a3d8b P 10c596e3a5ba4fe39a038d22df98111a: Neither blocks nor log segments found. Creating new log.
I20260808 14:47:37.169217 20729 tablet_bootstrap.cc:654] T 19f63eec4f5d44bc84c775baa95a3d8b P d8babb5bfd404a14af9ba9ed23500a59: Neither blocks nor log segments found. Creating new log.
I20260808 14:47:37.169742 20729 log.cc:824] T 19f63eec4f5d44bc84c775baa95a3d8b P d8babb5bfd404a14af9ba9ed23500a59: Log is configured to *not* fsync() on all Append() calls
I20260808 14:47:37.169788 20730 log.cc:824] T 19f63eec4f5d44bc84c775baa95a3d8b P 1e60ec8293de4a4da360818ddf52171e: Log is configured to *not* fsync() on all Append() calls
I20260808 14:47:37.169802 20728 log.cc:824] T 19f63eec4f5d44bc84c775baa95a3d8b P 10c596e3a5ba4fe39a038d22df98111a: Log is configured to *not* fsync() on all Append() calls
I20260808 14:47:37.170529 20730 tablet_bootstrap.cc:492] T 19f63eec4f5d44bc84c775baa95a3d8b P 1e60ec8293de4a4da360818ddf52171e: No bootstrap required, opened a new log
I20260808 14:47:37.170523 20729 tablet_bootstrap.cc:492] T 19f63eec4f5d44bc84c775baa95a3d8b P d8babb5bfd404a14af9ba9ed23500a59: No bootstrap required, opened a new log
I20260808 14:47:37.170600 20729 ts_tablet_manager.cc:1397] T 19f63eec4f5d44bc84c775baa95a3d8b P d8babb5bfd404a14af9ba9ed23500a59: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:47:37.170600 20730 ts_tablet_manager.cc:1397] T 19f63eec4f5d44bc84c775baa95a3d8b P 1e60ec8293de4a4da360818ddf52171e: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260808 14:47:37.170632 20728 tablet_bootstrap.cc:492] T 19f63eec4f5d44bc84c775baa95a3d8b P 10c596e3a5ba4fe39a038d22df98111a: No bootstrap required, opened a new log
I20260808 14:47:37.170701 20728 ts_tablet_manager.cc:1397] T 19f63eec4f5d44bc84c775baa95a3d8b P 10c596e3a5ba4fe39a038d22df98111a: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 14:47:37.172191 20728 raft_consensus.cc:348] T 19f63eec4f5d44bc84c775baa95a3d8b P 10c596e3a5ba4fe39a038d22df98111a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e60ec8293de4a4da360818ddf52171e" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 35081 } } peers { permanent_uuid: "d8babb5bfd404a14af9ba9ed23500a59" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35839 } } peers { permanent_uuid: "10c596e3a5ba4fe39a038d22df98111a" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 42291 } }
I20260808 14:47:37.172324 20728 raft_consensus.cc:374] T 19f63eec4f5d44bc84c775baa95a3d8b P 10c596e3a5ba4fe39a038d22df98111a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:47:37.172355 20728 raft_consensus.cc:729] T 19f63eec4f5d44bc84c775baa95a3d8b P 10c596e3a5ba4fe39a038d22df98111a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c596e3a5ba4fe39a038d22df98111a, State: Initialized, Role: FOLLOWER
I20260808 14:47:37.172463 20728 consensus_queue.cc:260] T 19f63eec4f5d44bc84c775baa95a3d8b P 10c596e3a5ba4fe39a038d22df98111a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e60ec8293de4a4da360818ddf52171e" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 35081 } } peers { permanent_uuid: "d8babb5bfd404a14af9ba9ed23500a59" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35839 } } peers { permanent_uuid: "10c596e3a5ba4fe39a038d22df98111a" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 42291 } }
I20260808 14:47:37.172472 20729 raft_consensus.cc:348] T 19f63eec4f5d44bc84c775baa95a3d8b P d8babb5bfd404a14af9ba9ed23500a59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e60ec8293de4a4da360818ddf52171e" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 35081 } } peers { permanent_uuid: "d8babb5bfd404a14af9ba9ed23500a59" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35839 } } peers { permanent_uuid: "10c596e3a5ba4fe39a038d22df98111a" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 42291 } }
I20260808 14:47:37.172472 20730 raft_consensus.cc:348] T 19f63eec4f5d44bc84c775baa95a3d8b P 1e60ec8293de4a4da360818ddf52171e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e60ec8293de4a4da360818ddf52171e" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 35081 } } peers { permanent_uuid: "d8babb5bfd404a14af9ba9ed23500a59" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35839 } } peers { permanent_uuid: "10c596e3a5ba4fe39a038d22df98111a" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 42291 } }
I20260808 14:47:37.172631 20730 raft_consensus.cc:374] T 19f63eec4f5d44bc84c775baa95a3d8b P 1e60ec8293de4a4da360818ddf52171e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:47:37.172631 20729 raft_consensus.cc:374] T 19f63eec4f5d44bc84c775baa95a3d8b P d8babb5bfd404a14af9ba9ed23500a59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:47:37.172674 20730 raft_consensus.cc:729] T 19f63eec4f5d44bc84c775baa95a3d8b P 1e60ec8293de4a4da360818ddf52171e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e60ec8293de4a4da360818ddf52171e, State: Initialized, Role: FOLLOWER
I20260808 14:47:37.172674 20729 raft_consensus.cc:729] T 19f63eec4f5d44bc84c775baa95a3d8b P d8babb5bfd404a14af9ba9ed23500a59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8babb5bfd404a14af9ba9ed23500a59, State: Initialized, Role: FOLLOWER
I20260808 14:47:37.172734 20728 ts_tablet_manager.cc:1428] T 19f63eec4f5d44bc84c775baa95a3d8b P 10c596e3a5ba4fe39a038d22df98111a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:47:37.172787 20729 consensus_queue.cc:260] T 19f63eec4f5d44bc84c775baa95a3d8b P d8babb5bfd404a14af9ba9ed23500a59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e60ec8293de4a4da360818ddf52171e" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 35081 } } peers { permanent_uuid: "d8babb5bfd404a14af9ba9ed23500a59" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35839 } } peers { permanent_uuid: "10c596e3a5ba4fe39a038d22df98111a" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 42291 } }
I20260808 14:47:37.172883 20315 heartbeater.cc:503] Master 127.30.214.190:38717 was elected leader, sending a full tablet report...
I20260808 14:47:37.173060 20729 ts_tablet_manager.cc:1428] T 19f63eec4f5d44bc84c775baa95a3d8b P d8babb5bfd404a14af9ba9ed23500a59: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 14:47:37.173090 20506 heartbeater.cc:503] Master 127.30.214.190:38717 was elected leader, sending a full tablet report...
I20260808 14:47:37.172787 20730 consensus_queue.cc:260] T 19f63eec4f5d44bc84c775baa95a3d8b P 1e60ec8293de4a4da360818ddf52171e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e60ec8293de4a4da360818ddf52171e" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 35081 } } peers { permanent_uuid: "d8babb5bfd404a14af9ba9ed23500a59" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35839 } } peers { permanent_uuid: "10c596e3a5ba4fe39a038d22df98111a" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 42291 } }
I20260808 14:47:37.173553 20730 ts_tablet_manager.cc:1428] T 19f63eec4f5d44bc84c775baa95a3d8b P 1e60ec8293de4a4da360818ddf52171e: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260808 14:47:37.173578 20709 heartbeater.cc:503] Master 127.30.214.190:38717 was elected leader, sending a full tablet report...
I20260808 14:47:37.202567 20735 raft_consensus.cc:482] T 19f63eec4f5d44bc84c775baa95a3d8b P 10c596e3a5ba4fe39a038d22df98111a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:47:37.202692 20735 raft_consensus.cc:504] T 19f63eec4f5d44bc84c775baa95a3d8b P 10c596e3a5ba4fe39a038d22df98111a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e60ec8293de4a4da360818ddf52171e" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 35081 } } peers { permanent_uuid: "d8babb5bfd404a14af9ba9ed23500a59" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35839 } } peers { permanent_uuid: "10c596e3a5ba4fe39a038d22df98111a" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 42291 } }
I20260808 14:47:37.203066 20735 leader_election.cc:288] T 19f63eec4f5d44bc84c775baa95a3d8b P 10c596e3a5ba4fe39a038d22df98111a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e60ec8293de4a4da360818ddf52171e (127.30.214.131:35081), d8babb5bfd404a14af9ba9ed23500a59 (127.30.214.130:35839)
I20260808 14:47:37.205915 20723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:37.203308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.129:35015 (local address 127.30.214.131:35081)
0808 14:47:37.203364 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 14:47:37.203376 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 14:47:37.203385 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:47:37.203413 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:47:37.203414 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:47:37.203423 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:47:37.203477 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:47:37.203630 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:37.204099 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:37.205066 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:37.205551 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:37.205620 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:37.205629 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 14:47:37.205806 (+ 177us) server_negotiation.cc:299] Negotiation successful
0808 14:47:37.205847 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 14:47:37.205916 20322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:37.203225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.131:35081 (local address 127.30.214.129:35015)
0808 14:47:37.203278 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:37.203290 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:47:37.203337 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:47:37.203503 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:47:37.203504 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:47:37.203506 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:47:37.203572 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:37.203574 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:37.204175 (+ 601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:37.204176 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:37.204979 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:37.204981 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:37.205672 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:37.205673 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:37.205741 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:37.205745 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:47:37.205791 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 14:47:37.205837 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31,"mutex_wait_us":44}
I20260808 14:47:37.205978 20722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:37.203385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.129:48709 (local address 127.30.214.130:35839)
0808 14:47:37.203439 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 14:47:37.203441 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:47:37.203483 (+ 42us) server_negotiation.cc:407] Connection header received
0808 14:47:37.203542 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:47:37.203543 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:47:37.203560 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:47:37.203603 (+ 43us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:47:37.203753 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:37.204232 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:37.205154 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:37.205674 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:37.205739 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:37.205748 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 14:47:37.205879 (+ 131us) server_negotiation.cc:299] Negotiation successful
0808 14:47:37.205914 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 14:47:37.206192 20742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:37.203233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.130:35839 (local address 127.30.214.129:48709)
0808 14:47:37.203433 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:37.203442 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:47:37.203491 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:47:37.203625 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:47:37.203626 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:47:37.203627 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:47:37.203695 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:37.203697 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:37.204300 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:37.204301 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:37.205058 (+ 757us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:37.205060 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:37.205740 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:37.205741 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:37.205819 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:37.205823 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:47:37.205868 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 14:47:37.205907 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180,"mutex_wait_us":12,"thread_start_us":118,"threads_started":1}
I20260808 14:47:37.206331 20638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19f63eec4f5d44bc84c775baa95a3d8b" candidate_uuid: "10c596e3a5ba4fe39a038d22df98111a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e60ec8293de4a4da360818ddf52171e" is_pre_election: true
I20260808 14:47:37.206511 20638 raft_consensus.cc:2454] T 19f63eec4f5d44bc84c775baa95a3d8b P 1e60ec8293de4a4da360818ddf52171e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c596e3a5ba4fe39a038d22df98111a in term 0.
I20260808 14:47:37.206496 20443 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19f63eec4f5d44bc84c775baa95a3d8b" candidate_uuid: "10c596e3a5ba4fe39a038d22df98111a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8babb5bfd404a14af9ba9ed23500a59" is_pre_election: true
I20260808 14:47:37.206648 20443 raft_consensus.cc:2454] T 19f63eec4f5d44bc84c775baa95a3d8b P d8babb5bfd404a14af9ba9ed23500a59 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c596e3a5ba4fe39a038d22df98111a in term 0.
I20260808 14:47:37.206743 20153 leader_election.cc:302] T 19f63eec4f5d44bc84c775baa95a3d8b P 10c596e3a5ba4fe39a038d22df98111a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c596e3a5ba4fe39a038d22df98111a, 1e60ec8293de4a4da360818ddf52171e; no voters:
I20260808 14:47:37.206882 20735 raft_consensus.cc:2781] T 19f63eec4f5d44bc84c775baa95a3d8b P 10c596e3a5ba4fe39a038d22df98111a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:47:37.206955 20735 raft_consensus.cc:482] T 19f63eec4f5d44bc84c775baa95a3d8b P 10c596e3a5ba4fe39a038d22df98111a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:47:37.206979 20735 raft_consensus.cc:3037] T 19f63eec4f5d44bc84c775baa95a3d8b P 10c596e3a5ba4fe39a038d22df98111a [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:47:37.207695 20735 raft_consensus.cc:504] T 19f63eec4f5d44bc84c775baa95a3d8b P 10c596e3a5ba4fe39a038d22df98111a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e60ec8293de4a4da360818ddf52171e" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 35081 } } peers { permanent_uuid: "d8babb5bfd404a14af9ba9ed23500a59" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35839 } } peers { permanent_uuid: "10c596e3a5ba4fe39a038d22df98111a" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 42291 } }
I20260808 14:47:37.207823 20735 leader_election.cc:288] T 19f63eec4f5d44bc84c775baa95a3d8b P 10c596e3a5ba4fe39a038d22df98111a [CANDIDATE]: Term 1 election: Requested vote from peers 1e60ec8293de4a4da360818ddf52171e (127.30.214.131:35081), d8babb5bfd404a14af9ba9ed23500a59 (127.30.214.130:35839)
I20260808 14:47:37.207950 20638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19f63eec4f5d44bc84c775baa95a3d8b" candidate_uuid: "10c596e3a5ba4fe39a038d22df98111a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e60ec8293de4a4da360818ddf52171e"
I20260808 14:47:37.207996 20443 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19f63eec4f5d44bc84c775baa95a3d8b" candidate_uuid: "10c596e3a5ba4fe39a038d22df98111a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8babb5bfd404a14af9ba9ed23500a59"
I20260808 14:47:37.208035 20638 raft_consensus.cc:3037] T 19f63eec4f5d44bc84c775baa95a3d8b P 1e60ec8293de4a4da360818ddf52171e [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:47:37.208081 20443 raft_consensus.cc:3037] T 19f63eec4f5d44bc84c775baa95a3d8b P d8babb5bfd404a14af9ba9ed23500a59 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:47:37.208770 20443 raft_consensus.cc:2454] T 19f63eec4f5d44bc84c775baa95a3d8b P d8babb5bfd404a14af9ba9ed23500a59 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c596e3a5ba4fe39a038d22df98111a in term 1.
I20260808 14:47:37.208806 20638 raft_consensus.cc:2454] T 19f63eec4f5d44bc84c775baa95a3d8b P 1e60ec8293de4a4da360818ddf52171e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c596e3a5ba4fe39a038d22df98111a in term 1.
I20260808 14:47:37.208964 20153 leader_election.cc:302] T 19f63eec4f5d44bc84c775baa95a3d8b P 10c596e3a5ba4fe39a038d22df98111a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 10c596e3a5ba4fe39a038d22df98111a, 1e60ec8293de4a4da360818ddf52171e, d8babb5bfd404a14af9ba9ed23500a59; no voters:
I20260808 14:47:37.209064 20735 raft_consensus.cc:2781] T 19f63eec4f5d44bc84c775baa95a3d8b P 10c596e3a5ba4fe39a038d22df98111a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:47:37.209226 20735 raft_consensus.cc:686] T 19f63eec4f5d44bc84c775baa95a3d8b P 10c596e3a5ba4fe39a038d22df98111a [term 1 LEADER]: Becoming Leader. State: Replica: 10c596e3a5ba4fe39a038d22df98111a, State: Running, Role: LEADER
I20260808 14:47:37.209328 20735 consensus_queue.cc:237] T 19f63eec4f5d44bc84c775baa95a3d8b P 10c596e3a5ba4fe39a038d22df98111a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e60ec8293de4a4da360818ddf52171e" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 35081 } } peers { permanent_uuid: "d8babb5bfd404a14af9ba9ed23500a59" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35839 } } peers { permanent_uuid: "10c596e3a5ba4fe39a038d22df98111a" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 42291 } }
I20260808 14:47:37.210199 20033 catalog_manager.cc:5495] T 19f63eec4f5d44bc84c775baa95a3d8b P 10c596e3a5ba4fe39a038d22df98111a reported cstate change: term changed from 0 to 1, leader changed from <none> to 10c596e3a5ba4fe39a038d22df98111a (127.30.214.129). New cstate: current_term: 1 leader_uuid: "10c596e3a5ba4fe39a038d22df98111a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e60ec8293de4a4da360818ddf52171e" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 35081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8babb5bfd404a14af9ba9ed23500a59" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10c596e3a5ba4fe39a038d22df98111a" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 42291 } health_report { overall_health: HEALTHY } } }
I20260808 14:47:37.221606 20726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:37.219331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51172 (local address 127.30.214.129:42291)
0808 14:47:37.219397 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 14:47:37.219399 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:47:37.219424 (+ 25us) server_negotiation.cc:407] Connection header received
0808 14:47:37.219461 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:47:37.219462 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:47:37.219480 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:47:37.219536 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:47:37.219669 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:37.220135 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:37.220858 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:37.221051 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:37.221104 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:37.221262 (+ 158us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:47:37.221357 (+ 95us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:47:37.221428 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 14:47:37.221492 (+ 64us) server_negotiation.cc:299] Negotiation successful
0808 14:47:37.221512 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 14:47:37.223318 20638 raft_consensus.cc:1261] T 19f63eec4f5d44bc84c775baa95a3d8b P 1e60ec8293de4a4da360818ddf52171e [term 1 FOLLOWER]: Refusing update from remote peer 10c596e3a5ba4fe39a038d22df98111a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:47:37.223318 20443 raft_consensus.cc:1261] T 19f63eec4f5d44bc84c775baa95a3d8b P d8babb5bfd404a14af9ba9ed23500a59 [term 1 FOLLOWER]: Refusing update from remote peer 10c596e3a5ba4fe39a038d22df98111a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:47:37.223663 20744 consensus_queue.cc:1035] T 19f63eec4f5d44bc84c775baa95a3d8b P 10c596e3a5ba4fe39a038d22df98111a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8babb5bfd404a14af9ba9ed23500a59" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:47:37.223799 20735 consensus_queue.cc:1035] T 19f63eec4f5d44bc84c775baa95a3d8b P 10c596e3a5ba4fe39a038d22df98111a [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e60ec8293de4a4da360818ddf52171e" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 35081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 14:47:37.225399 20507 tablet.cc:2369] T 19f63eec4f5d44bc84c775baa95a3d8b P d8babb5bfd404a14af9ba9ed23500a59: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:47:37.226330 20749 mvcc.cc:205] Tried to move back new op lower bound from 7316277072784211968 to 7316277072730075136. Current Snapshot: MvccSnapshot[applied={T|T < 7316277072784211968}]
I20260808 14:47:37.227200 20752 mvcc.cc:205] Tried to move back new op lower bound from 7316277072784211968 to 7316277072730075136. Current Snapshot: MvccSnapshot[applied={T|T < 7316277072784211968 or (T in {7316277072784211968})}]
I20260808 14:47:37.228693 20032 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53626:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:47:37.228782 20032 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53626:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:47:37.229542 20032 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 97940778e9cb4bd8a14393fcbc4f9b20: Sending DeleteTablet for 3 replicas of tablet 19f63eec4f5d44bc84c775baa95a3d8b
I20260808 14:47:37.229893 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 20127
I20260808 14:47:37.229871 20224 tablet_service.cc:1514] Processing DeleteTablet for tablet 19f63eec4f5d44bc84c775baa95a3d8b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:47:37 UTC) from {username='kudu', principal='kudu/127.30.214.190@KRBTEST.COM'} at 127.0.0.1:51168
I20260808 14:47:37.229915 20612 tablet_service.cc:1514] Processing DeleteTablet for tablet 19f63eec4f5d44bc84c775baa95a3d8b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:47:37 UTC) from {username='kudu', principal='kudu/127.30.214.190@KRBTEST.COM'} at 127.0.0.1:48428
I20260808 14:47:37.230108 20415 tablet_service.cc:1514] Processing DeleteTablet for tablet 19f63eec4f5d44bc84c775baa95a3d8b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:47:37 UTC) from {username='kudu', principal='kudu/127.30.214.190@KRBTEST.COM'} at 127.0.0.1:46200
I20260808 14:47:37.237793 20763 tablet_replica.cc:330] T 19f63eec4f5d44bc84c775baa95a3d8b P d8babb5bfd404a14af9ba9ed23500a59: stopping tablet replica
I20260808 14:47:37.237950 20763 raft_consensus.cc:2229] T 19f63eec4f5d44bc84c775baa95a3d8b P d8babb5bfd404a14af9ba9ed23500a59 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:47:37.238075 20763 raft_consensus.cc:2258] T 19f63eec4f5d44bc84c775baa95a3d8b P d8babb5bfd404a14af9ba9ed23500a59 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:47:37.238241 20761 tablet_replica.cc:330] T 19f63eec4f5d44bc84c775baa95a3d8b P 1e60ec8293de4a4da360818ddf52171e: stopping tablet replica
I20260808 14:47:37.238337 20761 raft_consensus.cc:2229] T 19f63eec4f5d44bc84c775baa95a3d8b P 1e60ec8293de4a4da360818ddf52171e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:47:37.238428 20761 raft_consensus.cc:2258] T 19f63eec4f5d44bc84c775baa95a3d8b P 1e60ec8293de4a4da360818ddf52171e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:47:37.240914 20761 ts_tablet_manager.cc:1905] T 19f63eec4f5d44bc84c775baa95a3d8b P 1e60ec8293de4a4da360818ddf52171e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:47:37.242730 20761 ts_tablet_manager.cc:1918] T 19f63eec4f5d44bc84c775baa95a3d8b P 1e60ec8293de4a4da360818ddf52171e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:47:37.242834 20761 log.cc:1196] T 19f63eec4f5d44bc84c775baa95a3d8b P 1e60ec8293de4a4da360818ddf52171e: Deleting WAL directory at /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-2/wal/wals/19f63eec4f5d44bc84c775baa95a3d8b
I20260808 14:47:37.243105 20761 ts_tablet_manager.cc:1939] T 19f63eec4f5d44bc84c775baa95a3d8b P 1e60ec8293de4a4da360818ddf52171e: Deleting consensus metadata
I20260808 14:47:37.243289 20763 ts_tablet_manager.cc:1905] T 19f63eec4f5d44bc84c775baa95a3d8b P d8babb5bfd404a14af9ba9ed23500a59: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:47:37.243669 20016 catalog_manager.cc:4841] TS 1e60ec8293de4a4da360818ddf52171e (127.30.214.131:35081): tablet 19f63eec4f5d44bc84c775baa95a3d8b (table test-table [id=3de4366bb19348b3acd48c83b1bcedb4]) successfully deleted
I20260808 14:47:37.244673 20763 ts_tablet_manager.cc:1918] T 19f63eec4f5d44bc84c775baa95a3d8b P d8babb5bfd404a14af9ba9ed23500a59: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:47:37.244735 20763 log.cc:1196] T 19f63eec4f5d44bc84c775baa95a3d8b P d8babb5bfd404a14af9ba9ed23500a59: Deleting WAL directory at /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-1/wal/wals/19f63eec4f5d44bc84c775baa95a3d8b
I20260808 14:47:37.244920 20763 ts_tablet_manager.cc:1939] T 19f63eec4f5d44bc84c775baa95a3d8b P d8babb5bfd404a14af9ba9ed23500a59: Deleting consensus metadata
I20260808 14:47:37.245391 20015 catalog_manager.cc:4841] TS d8babb5bfd404a14af9ba9ed23500a59 (127.30.214.130:35839): tablet 19f63eec4f5d44bc84c775baa95a3d8b (table test-table [id=3de4366bb19348b3acd48c83b1bcedb4]) successfully deleted
W20260808 14:47:37.248279 20015 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.30.214.129:42291 (error 108)
I20260808 14:47:37.248541 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 20330
I20260808 14:47:37.248759 20724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:37.248648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.129:42291 (local address 127.0.0.1:51186)
0808 14:47:37.248700 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:37.248727 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.129:42291: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260808 14:47:37.250231 20015 catalog_manager.cc:4584] TS 10c596e3a5ba4fe39a038d22df98111a (127.30.214.129:42291): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 19f63eec4f5d44bc84c775baa95a3d8b: Network error: Client connection negotiation failed: client connection to 127.30.214.129:42291: connect: Connection refused (error 111)
I20260808 14:47:37.261214 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 20516
I20260808 14:47:37.269547 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 19994
I20260808 14:47:37.282630 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:38717
--webserver_interface=127.30.214.190
--webserver_port=34327
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab
--principal=kudu/127.30.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:34133
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.214.190:38717
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:47:37.364880 20768 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:47:37.365099 20768 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:47:37.365123 20768 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:47:37.366334 20768 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:47:37.366381 20768 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:47:37.366394 20768 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:47:37.366406 20768 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:47:37.366417 20768 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:47:37.367990 20768 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:34133
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.30.214.190:38717
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab
--principal=kudu/127.30.214.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:38717
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.214.190
--webserver_port=34327
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20768
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:47:37.368237 20768 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:47:37.368455 20768 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:47:37.377777 20777 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:47:37.377913 20768 server_base.cc:1034] running on GCE node
W20260808 14:47:37.377791 20776 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:47:37.377780 20779 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:47:37.378328 20768 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:47:37.378691 20768 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:47:37.379839 20768 hybrid_clock.cc:648] HybridClock initialized: now 1786200457379824 us; error 30 us; skew 500 ppm
Aug 08 14:47:37 dist-test-slave-42z9 krb5kdc[19974](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200457, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:47:37.382393 20768 init.cc:377] Logged in from keytab as kudu/127.30.214.190@KRBTEST.COM (short username kudu)
I20260808 14:47:37.382851 20768 webserver.cc:460] Webserver started at http://127.30.214.190:34327/ using document root <none> and password file <none>
I20260808 14:47:37.383080 20768 fs_manager.cc:359] Metadata directory not provided
I20260808 14:47:37.383144 20768 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:47:37.384505 20768 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:47:37.385123 20788 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:47:37.385285 20768 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:47:37.385372 20768 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/master-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/master-0/wal
uuid: "97940778e9cb4bd8a14393fcbc4f9b20"
format_stamp: "Formatted at 2026-08-08 14:47:36 on dist-test-slave-42z9"
server_key: "90915863c18ae84b7e8c60b724262d66"
server_key_iv: "080b1e763b01888ab95345f9232f4bc0"
server_key_version: "encryptionkey@0"
I20260808 14:47:37.385807 20768 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:47:37.412608 20768 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:47:37.414870 20768 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:47:37.415014 20768 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:47:37.419109 20768 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.190:38717
I20260808 14:47:37.419162 20868 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.190:38717 every 8 connection(s)
I20260808 14:47:37.419559 20768 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
I20260808 14:47:37.421260 20869 sys_catalog.cc:263] Verifying existing consensus state
I20260808 14:47:37.421970 20869 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 97940778e9cb4bd8a14393fcbc4f9b20: Bootstrap starting.
I20260808 14:47:37.428246 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 20768
I20260808 14:47:37.428531 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.129:42291
--local_ip_for_outbound_sockets=127.30.214.129
--tserver_master_addrs=127.30.214.190:38717
--webserver_port=35775
--webserver_interface=127.30.214.129
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab
--principal=kudu/127.30.214.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:34133
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:47:37.430576 20869 log.cc:824] T 00000000000000000000000000000000 P 97940778e9cb4bd8a14393fcbc4f9b20: Log is configured to *not* fsync() on all Append() calls
I20260808 14:47:37.432538 20869 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 97940778e9cb4bd8a14393fcbc4f9b20: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 14:47:37.432868 20869 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 97940778e9cb4bd8a14393fcbc4f9b20: Bootstrap complete.
I20260808 14:47:37.435065 20869 raft_consensus.cc:348] T 00000000000000000000000000000000 P 97940778e9cb4bd8a14393fcbc4f9b20 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97940778e9cb4bd8a14393fcbc4f9b20" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 38717 } }
I20260808 14:47:37.435292 20869 raft_consensus.cc:729] T 00000000000000000000000000000000 P 97940778e9cb4bd8a14393fcbc4f9b20 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97940778e9cb4bd8a14393fcbc4f9b20, State: Initialized, Role: FOLLOWER
I20260808 14:47:37.435441 20869 consensus_queue.cc:260] T 00000000000000000000000000000000 P 97940778e9cb4bd8a14393fcbc4f9b20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97940778e9cb4bd8a14393fcbc4f9b20" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 38717 } }
I20260808 14:47:37.435520 20869 raft_consensus.cc:388] T 00000000000000000000000000000000 P 97940778e9cb4bd8a14393fcbc4f9b20 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:47:37.435577 20869 raft_consensus.cc:482] T 00000000000000000000000000000000 P 97940778e9cb4bd8a14393fcbc4f9b20 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:47:37.435626 20869 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 97940778e9cb4bd8a14393fcbc4f9b20 [term 1 FOLLOWER]: Advancing to term 2
I20260808 14:47:37.436633 20869 raft_consensus.cc:504] T 00000000000000000000000000000000 P 97940778e9cb4bd8a14393fcbc4f9b20 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97940778e9cb4bd8a14393fcbc4f9b20" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 38717 } }
I20260808 14:47:37.436731 20869 leader_election.cc:302] T 00000000000000000000000000000000 P 97940778e9cb4bd8a14393fcbc4f9b20 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 97940778e9cb4bd8a14393fcbc4f9b20; no voters:
I20260808 14:47:37.436898 20869 leader_election.cc:288] T 00000000000000000000000000000000 P 97940778e9cb4bd8a14393fcbc4f9b20 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 14:47:37.436962 20875 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 97940778e9cb4bd8a14393fcbc4f9b20 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 14:47:37.437134 20875 raft_consensus.cc:686] T 00000000000000000000000000000000 P 97940778e9cb4bd8a14393fcbc4f9b20 [term 2 LEADER]: Becoming Leader. State: Replica: 97940778e9cb4bd8a14393fcbc4f9b20, State: Running, Role: LEADER
I20260808 14:47:37.437155 20869 sys_catalog.cc:564] T 00000000000000000000000000000000 P 97940778e9cb4bd8a14393fcbc4f9b20 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:47:37.437295 20875 consensus_queue.cc:237] T 00000000000000000000000000000000 P 97940778e9cb4bd8a14393fcbc4f9b20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97940778e9cb4bd8a14393fcbc4f9b20" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 38717 } }
I20260808 14:47:37.437740 20877 sys_catalog.cc:455] T 00000000000000000000000000000000 P 97940778e9cb4bd8a14393fcbc4f9b20 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "97940778e9cb4bd8a14393fcbc4f9b20" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97940778e9cb4bd8a14393fcbc4f9b20" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 38717 } } }
I20260808 14:47:37.437749 20879 sys_catalog.cc:455] T 00000000000000000000000000000000 P 97940778e9cb4bd8a14393fcbc4f9b20 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 97940778e9cb4bd8a14393fcbc4f9b20. Latest consensus state: current_term: 2 leader_uuid: "97940778e9cb4bd8a14393fcbc4f9b20" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97940778e9cb4bd8a14393fcbc4f9b20" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 38717 } } }
I20260808 14:47:37.437839 20877 sys_catalog.cc:458] T 00000000000000000000000000000000 P 97940778e9cb4bd8a14393fcbc4f9b20 [sys.catalog]: This master's current role is: LEADER
I20260808 14:47:37.437860 20879 sys_catalog.cc:458] T 00000000000000000000000000000000 P 97940778e9cb4bd8a14393fcbc4f9b20 [sys.catalog]: This master's current role is: LEADER
I20260808 14:47:37.438268 20888 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:47:37.439064 20888 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:47:37.439160 20888 catalog_manager.cc:1259] Loaded cluster ID: a53b7c3ba2cb438c8425a3babc0ad873
I20260808 14:47:37.439183 20888 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:47:37.439657 20888 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260808 14:47:37.444756 20888 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260808 14:47:37.447446 20888 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:47:37.447667 20888 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 97940778e9cb4bd8a14393fcbc4f9b20: Loaded TSK: 0
I20260808 14:47:37.447880 20888 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 14:47:37.515815 20872 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:47:37.516026 20872 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:47:37.516048 20872 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:47:37.517217 20872 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:47:37.517264 20872 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:47:37.517292 20872 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.129
I20260808 14:47:37.518822 20872 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:34133
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab
--principal=kudu/127.30.214.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.129:42291
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.214.129
--webserver_port=35775
--tserver_master_addrs=127.30.214.190:38717
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20872
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.129
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:47:37.519055 20872 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:47:37.519295 20872 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:47:37.524212 20911 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:47:37.524345 20913 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:47:37.524219 20916 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:47:37.524497 20872 server_base.cc:1034] running on GCE node
I20260808 14:47:37.524686 20872 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:47:37.524909 20872 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:47:37.526047 20872 hybrid_clock.cc:648] HybridClock initialized: now 1786200457526035 us; error 32 us; skew 500 ppm
Aug 08 14:47:37 dist-test-slave-42z9 krb5kdc[19974](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200457, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:47:37.528652 20872 init.cc:377] Logged in from keytab as kudu/127.30.214.129@KRBTEST.COM (short username kudu)
I20260808 14:47:37.529243 20872 webserver.cc:460] Webserver started at http://127.30.214.129:35775/ using document root <none> and password file <none>
I20260808 14:47:37.529548 20872 fs_manager.cc:359] Metadata directory not provided
I20260808 14:47:37.529630 20872 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:47:37.531384 20872 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 14:47:37.532133 20924 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:47:37.532303 20872 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:47:37.532404 20872 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-0/wal
uuid: "10c596e3a5ba4fe39a038d22df98111a"
format_stamp: "Formatted at 2026-08-08 14:47:36 on dist-test-slave-42z9"
server_key: "a466ba0016cc18752c7277fb05f3da7c"
server_key_iv: "275be272aa060975a69078a2595045cc"
server_key_version: "encryptionkey@0"
I20260808 14:47:37.532828 20872 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:47:37.552073 20872 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:47:37.554306 20872 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:47:37.554450 20872 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:47:37.554690 20872 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:47:37.555150 20934 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 14:47:37.556602 20872 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 14:47:37.556664 20872 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260808 14:47:37.556697 20872 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 14:47:37.557577 20872 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 14:47:37.557621 20872 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.001s sys 0.000s
I20260808 14:47:37.557683 20934 tablet_bootstrap.cc:492] T 19f63eec4f5d44bc84c775baa95a3d8b P 10c596e3a5ba4fe39a038d22df98111a: Bootstrap starting.
I20260808 14:47:37.564489 20872 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.129:42291
I20260808 14:47:37.564910 20872 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
I20260808 14:47:37.565665 21089 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.129:42291 every 8 connection(s)
I20260808 14:47:37.567840 20934 log.cc:824] T 19f63eec4f5d44bc84c775baa95a3d8b P 10c596e3a5ba4fe39a038d22df98111a: Log is configured to *not* fsync() on all Append() calls
I20260808 14:47:37.570369 20934 tablet_bootstrap.cc:492] T 19f63eec4f5d44bc84c775baa95a3d8b P 10c596e3a5ba4fe39a038d22df98111a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 14:47:37.570634 20934 tablet_bootstrap.cc:492] T 19f63eec4f5d44bc84c775baa95a3d8b P 10c596e3a5ba4fe39a038d22df98111a: Bootstrap complete.
I20260808 14:47:37.571463 20934 ts_tablet_manager.cc:1397] T 19f63eec4f5d44bc84c775baa95a3d8b P 10c596e3a5ba4fe39a038d22df98111a: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.010s
I20260808 14:47:37.572793 20934 raft_consensus.cc:348] T 19f63eec4f5d44bc84c775baa95a3d8b P 10c596e3a5ba4fe39a038d22df98111a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e60ec8293de4a4da360818ddf52171e" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 35081 } } peers { permanent_uuid: "d8babb5bfd404a14af9ba9ed23500a59" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35839 } } peers { permanent_uuid: "10c596e3a5ba4fe39a038d22df98111a" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 42291 } }
I20260808 14:47:37.573026 20934 raft_consensus.cc:729] T 19f63eec4f5d44bc84c775baa95a3d8b P 10c596e3a5ba4fe39a038d22df98111a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c596e3a5ba4fe39a038d22df98111a, State: Initialized, Role: FOLLOWER
I20260808 14:47:37.573180 20934 consensus_queue.cc:260] T 19f63eec4f5d44bc84c775baa95a3d8b P 10c596e3a5ba4fe39a038d22df98111a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e60ec8293de4a4da360818ddf52171e" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 35081 } } peers { permanent_uuid: "d8babb5bfd404a14af9ba9ed23500a59" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35839 } } peers { permanent_uuid: "10c596e3a5ba4fe39a038d22df98111a" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 42291 } }
I20260808 14:47:37.573513 20934 ts_tablet_manager.cc:1428] T 19f63eec4f5d44bc84c775baa95a3d8b P 10c596e3a5ba4fe39a038d22df98111a: Time spent starting tablet: real 0.002s user 0.003s sys 0.001s
I20260808 14:47:37.574503 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 20872
I20260808 14:47:37.574728 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.130:35839
--local_ip_for_outbound_sockets=127.30.214.130
--tserver_master_addrs=127.30.214.190:38717
--webserver_port=34961
--webserver_interface=127.30.214.130
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab
--principal=kudu/127.30.214.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:34133
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 14:47:37 dist-test-slave-42z9 krb5kdc[19974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200457, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.129@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:47:37.578616 21094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:37.565640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:38717 (local address 127.30.214.129:37107)
0808 14:47:37.568051 (+ 2411us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:37.568099 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 14:47:37.568728 (+ 629us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:47:37.569235 (+ 507us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:47:37.569239 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:47:37.569615 (+ 376us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:47:37.569886 (+ 271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:37.569892 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:37.571365 (+ 1473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:37.571366 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:37.572579 (+ 1213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:37.572582 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:37.573161 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:37.573162 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:37.573302 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:37.573829 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:47:37.573837 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:47:37.575277 (+ 1440us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:47:37.577009 (+ 1732us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:47:37.577018 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:47:37.577020 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:47:37.577327 (+ 307us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:47:37.577604 (+ 277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:47:37.577604 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:47:37.577605 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:47:37.577729 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:47:37.578154 (+ 425us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:47:37.578157 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:47:37.578265 (+ 108us) client_negotiation.cc:769] Sending connection context
0808 14:47:37.578342 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 14:47:37.578472 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2359,"thread_start_us":82,"threads_started":1}
I20260808 14:47:37.578737 21096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:37.566001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.129:37107 (local address 127.30.214.190:38717)
0808 14:47:37.566193 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0808 14:47:37.566203 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:47:37.568236 (+ 2033us) server_negotiation.cc:407] Connection header received
0808 14:47:37.568973 (+ 737us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:47:37.568981 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:47:37.569035 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:47:37.569175 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:47:37.570019 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:37.571275 (+ 1256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:37.572662 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:37.573057 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:37.573158 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:37.575380 (+ 2222us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:47:37.575385 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:47:37.575386 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:47:37.575398 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:47:37.576918 (+ 1520us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:37.577401 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:37.577404 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:37.577404 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:37.577535 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:37.577794 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:37.577794 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:37.577795 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:37.578090 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:47:37.578172 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 14:47:37.578416 (+ 244us) server_negotiation.cc:299] Negotiation successful
0808 14:47:37.578559 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":97,"threads_started":1}
I20260808 14:47:37.579325 21091 heartbeater.cc:347] Connected to a master server at 127.30.214.190:38717
I20260808 14:47:37.579447 21091 heartbeater.cc:464] Registering TS with master...
I20260808 14:47:37.579643 21091 heartbeater.cc:511] Master 127.30.214.190:38717 requested a full tablet report, sending...
I20260808 14:47:37.580525 20813 ts_manager.cc:194] Registered new tserver with Master: 10c596e3a5ba4fe39a038d22df98111a (127.30.214.129:42291)
I20260808 14:47:37.581589 20813 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.214.129@KRBTEST.COM'} at 127.30.214.129:37107
I20260808 14:47:37.582394 21091 heartbeater.cc:503] Master 127.30.214.190:38717 was elected leader, sending a full tablet report...
Aug 08 14:47:37 dist-test-slave-42z9 krb5kdc[19974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200457, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.190@KRBTEST.COM for kudu/127.30.214.129@KRBTEST.COM
I20260808 14:47:37.589178 21102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:37.581119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.129:42291 (local address 127.0.0.1:51198)
0808 14:47:37.581370 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:37.581406 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 14:47:37.581495 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:47:37.581768 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:47:37.581774 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:47:37.582126 (+ 352us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:47:37.582190 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:37.582193 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:37.583404 (+ 1211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:37.583405 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:37.583970 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:37.583972 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:37.584568 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:37.584568 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:37.584617 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:37.585099 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:47:37.585103 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:47:37.586379 (+ 1276us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:47:37.588131 (+ 1752us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:47:37.588137 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:47:37.588139 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:47:37.588330 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:47:37.588519 (+ 189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:47:37.588519 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:47:37.588520 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:47:37.588586 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:47:37.588871 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:47:37.588876 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:47:37.588925 (+ 49us) client_negotiation.cc:769] Sending connection context
0808 14:47:37.588996 (+ 71us) client_negotiation.cc:240] Negotiation successful
0808 14:47:37.589108 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":79,"threads_started":1}
I20260808 14:47:37.589226 21103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:37.581188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51198 (local address 127.30.214.129:42291)
0808 14:47:37.581551 (+ 363us) server_negotiation.cc:206] Beginning negotiation
0808 14:47:37.581556 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:47:37.581567 (+ 11us) server_negotiation.cc:407] Connection header received
0808 14:47:37.581604 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:47:37.581607 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:47:37.581622 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:47:37.581692 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:47:37.582283 (+ 591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:37.583320 (+ 1037us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:37.584049 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:37.584498 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:37.584574 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:37.586463 (+ 1889us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:47:37.586472 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:47:37.586472 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:47:37.586479 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:47:37.588056 (+ 1577us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:37.588398 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:37.588401 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:37.588402 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:37.588461 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:37.588638 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:37.588638 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:37.588639 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:37.588811 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:47:37.588882 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 14:47:37.589035 (+ 153us) server_negotiation.cc:299] Negotiation successful
0808 14:47:37.589131 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":325,"thread_start_us":74,"threads_started":1}
I20260808 14:47:37.589632 20995 tablet_service.cc:1514] Processing DeleteTablet for tablet 19f63eec4f5d44bc84c775baa95a3d8b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:47:37 UTC) from {username='kudu', principal='kudu/127.30.214.190@KRBTEST.COM'} at 127.0.0.1:51198
I20260808 14:47:37.590231 21104 tablet_replica.cc:330] stopping tablet replica
I20260808 14:47:37.590334 21104 raft_consensus.cc:2229] T 19f63eec4f5d44bc84c775baa95a3d8b P 10c596e3a5ba4fe39a038d22df98111a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:47:37.590405 21104 raft_consensus.cc:2258] T 19f63eec4f5d44bc84c775baa95a3d8b P 10c596e3a5ba4fe39a038d22df98111a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:47:37.590711 21104 ts_tablet_manager.cc:1905] T 19f63eec4f5d44bc84c775baa95a3d8b P 10c596e3a5ba4fe39a038d22df98111a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:47:37.592681 21104 ts_tablet_manager.cc:1918] T 19f63eec4f5d44bc84c775baa95a3d8b P 10c596e3a5ba4fe39a038d22df98111a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:47:37.592756 21104 log.cc:1196] T 19f63eec4f5d44bc84c775baa95a3d8b P 10c596e3a5ba4fe39a038d22df98111a: Deleting WAL directory at /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-0/wal/wals/19f63eec4f5d44bc84c775baa95a3d8b
I20260808 14:47:37.592958 21104 ts_tablet_manager.cc:1939] T 19f63eec4f5d44bc84c775baa95a3d8b P 10c596e3a5ba4fe39a038d22df98111a: Deleting consensus metadata
I20260808 14:47:37.593461 20790 catalog_manager.cc:4841] TS 10c596e3a5ba4fe39a038d22df98111a (127.30.214.129:42291): tablet 19f63eec4f5d44bc84c775baa95a3d8b (table test-table [id=3de4366bb19348b3acd48c83b1bcedb4]) successfully deleted
W20260808 14:47:37.659801 21101 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:47:37.660013 21101 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:47:37.660037 21101 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:47:37.661207 21101 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:47:37.661257 21101 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:47:37.661281 21101 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.130
I20260808 14:47:37.662855 21101 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:34133
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab
--principal=kudu/127.30.214.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.130:35839
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.214.130
--webserver_port=34961
--tserver_master_addrs=127.30.214.190:38717
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21101
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.130
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:47:37.663095 21101 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:47:37.663331 21101 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:47:37.668149 21111 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:47:37.668301 21101 server_base.cc:1034] running on GCE node
W20260808 14:47:37.668140 21113 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:47:37.668169 21116 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:47:37.668563 21101 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:47:37.668782 21101 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:47:37.669914 21101 hybrid_clock.cc:648] HybridClock initialized: now 1786200457669900 us; error 29 us; skew 500 ppm
Aug 08 14:47:37 dist-test-slave-42z9 krb5kdc[19974](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200457, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:47:37.672430 21101 init.cc:377] Logged in from keytab as kudu/127.30.214.130@KRBTEST.COM (short username kudu)
I20260808 14:47:37.672832 21101 webserver.cc:460] Webserver started at http://127.30.214.130:34961/ using document root <none> and password file <none>
I20260808 14:47:37.673017 21101 fs_manager.cc:359] Metadata directory not provided
I20260808 14:47:37.673070 21101 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:47:37.674396 21101 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:47:37.674958 21126 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:47:37.675115 21101 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:47:37.675194 21101 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-1/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-1/wal
uuid: "d8babb5bfd404a14af9ba9ed23500a59"
format_stamp: "Formatted at 2026-08-08 14:47:36 on dist-test-slave-42z9"
server_key: "8eacc4305e5bb9943218e5ad84d42280"
server_key_iv: "28e454b6c592effb6d299fbee5698423"
server_key_version: "encryptionkey@0"
I20260808 14:47:37.675518 21101 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:47:37.682181 21101 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:47:37.683846 21101 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:47:37.683962 21101 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:47:37.684144 21101 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:47:37.684401 21101 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:47:37.684438 21101 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:47:37.684458 21101 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:47:37.684474 21101 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:47:37.690064 21101 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.130:35839
I20260808 14:47:37.690133 21290 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.130:35839 every 8 connection(s)
I20260808 14:47:37.690438 21101 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
I20260808 14:47:37.691061 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 21101
I20260808 14:47:37.691298 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.131:35081
--local_ip_for_outbound_sockets=127.30.214.131
--tserver_master_addrs=127.30.214.190:38717
--webserver_port=40255
--webserver_interface=127.30.214.131
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab
--principal=kudu/127.30.214.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:34133
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 14:47:37 dist-test-slave-42z9 krb5kdc[19974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200457, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.130@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:47:37.700601 21096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:37.691163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.130:47261 (local address 127.30.214.190:38717)
0808 14:47:37.691213 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 14:47:37.691216 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:47:37.691433 (+ 217us) server_negotiation.cc:407] Connection header received
0808 14:47:37.691940 (+ 507us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:47:37.691942 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:47:37.691959 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:47:37.692007 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:47:37.693107 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:37.693682 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:37.695069 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:37.695291 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:37.695358 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:37.697911 (+ 2553us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:47:37.697912 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:47:37.697913 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:47:37.697920 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:47:37.699188 (+ 1268us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:37.699680 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:37.699680 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:37.699681 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:37.699727 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:37.699992 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:37.699992 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:37.699992 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:37.700091 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:47:37.700136 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 14:47:37.700460 (+ 324us) server_negotiation.cc:299] Negotiation successful
0808 14:47:37.700533 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 14:47:37.700887 21293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:37.691147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:38717 (local address 127.30.214.130:47261)
0808 14:47:37.691317 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:37.691359 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 14:47:37.691843 (+ 484us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:47:37.692099 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:47:37.692103 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:47:37.692684 (+ 581us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:47:37.692969 (+ 285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:37.692977 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:37.693775 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:37.693777 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:37.694952 (+ 1175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:37.694956 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:37.695383 (+ 427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:37.695384 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:37.695540 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:37.696130 (+ 590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:47:37.696141 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:47:37.697803 (+ 1662us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:47:37.699274 (+ 1471us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:47:37.699282 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:47:37.699285 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:47:37.699605 (+ 320us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:47:37.699782 (+ 177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:47:37.699782 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:47:37.699783 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:47:37.699931 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:47:37.700146 (+ 215us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:47:37.700153 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:47:37.700328 (+ 175us) client_negotiation.cc:769] Sending connection context
0808 14:47:37.700453 (+ 125us) client_negotiation.cc:240] Negotiation successful
0808 14:47:37.700637 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":97,"threads_started":1}
I20260808 14:47:37.701462 21291 heartbeater.cc:347] Connected to a master server at 127.30.214.190:38717
I20260808 14:47:37.701573 21291 heartbeater.cc:464] Registering TS with master...
I20260808 14:47:37.701786 21291 heartbeater.cc:511] Master 127.30.214.190:38717 requested a full tablet report, sending...
I20260808 14:47:37.702203 20813 ts_manager.cc:194] Registered new tserver with Master: d8babb5bfd404a14af9ba9ed23500a59 (127.30.214.130:35839)
I20260808 14:47:37.702574 20813 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.214.130@KRBTEST.COM'} at 127.30.214.130:47261
W20260808 14:47:37.776489 21294 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:47:37.776707 21294 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:47:37.776731 21294 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:47:37.777994 21294 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:47:37.778043 21294 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:47:37.778074 21294 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.131
I20260808 14:47:37.779656 21294 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:34133
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab
--principal=kudu/127.30.214.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.131:35081
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.214.131
--webserver_port=40255
--tserver_master_addrs=127.30.214.190:38717
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21294
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.131
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:47:37.779906 21294 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:47:37.780125 21294 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:47:37.785059 21302 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:47:37.785216 21294 server_base.cc:1034] running on GCE node
W20260808 14:47:37.785063 21304 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:47:37.785058 21307 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:47:37.785580 21294 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:47:37.785842 21294 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:47:37.786988 21294 hybrid_clock.cc:648] HybridClock initialized: now 1786200457786975 us; error 32 us; skew 500 ppm
Aug 08 14:47:37 dist-test-slave-42z9 krb5kdc[19974](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200457, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:47:37.789606 21294 init.cc:377] Logged in from keytab as kudu/127.30.214.131@KRBTEST.COM (short username kudu)
I20260808 14:47:37.790019 21294 webserver.cc:460] Webserver started at http://127.30.214.131:40255/ using document root <none> and password file <none>
I20260808 14:47:37.790220 21294 fs_manager.cc:359] Metadata directory not provided
I20260808 14:47:37.790275 21294 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:47:37.792157 21294 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:47:37.792765 21316 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:47:37.792927 21294 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 14:47:37.793013 21294 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-2/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-2/wal
uuid: "1e60ec8293de4a4da360818ddf52171e"
format_stamp: "Formatted at 2026-08-08 14:47:37 on dist-test-slave-42z9"
server_key: "b2d706caa50f55913359ac6ee9cbbaf2"
server_key_iv: "36f49d83a780b10682f2fb7ac6f046cd"
server_key_version: "encryptionkey@0"
I20260808 14:47:37.793367 21294 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:47:37.801383 21294 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:47:37.803472 21294 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:47:37.803593 21294 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:47:37.803776 21294 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:47:37.804025 21294 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:47:37.804055 21294 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:47:37.804076 21294 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:47:37.804093 21294 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:47:37.809839 21294 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.131:35081
I20260808 14:47:37.809906 21485 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.131:35081 every 8 connection(s)
I20260808 14:47:37.810237 21294 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
Aug 08 14:47:37 dist-test-slave-42z9 krb5kdc[19974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200457, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.131@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:47:37.817708 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 21294
I20260808 14:47:37.818846 21096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:37.810914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:44457 (local address 127.30.214.190:38717)
0808 14:47:37.810995 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0808 14:47:37.810998 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:47:37.811161 (+ 163us) server_negotiation.cc:407] Connection header received
0808 14:47:37.811644 (+ 483us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:47:37.811645 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:47:37.811655 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:47:37.811706 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:47:37.812666 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:37.813159 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:37.814148 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:37.814337 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:37.814384 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:37.816389 (+ 2005us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:47:37.816391 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:47:37.816391 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:47:37.816400 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:47:37.817494 (+ 1094us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:37.817884 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:37.817885 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:37.817885 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:37.817942 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:37.818220 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:37.818221 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:37.818222 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:37.818341 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:47:37.818398 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 14:47:37.818669 (+ 271us) server_negotiation.cc:299] Negotiation successful
0808 14:47:37.818760 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 14:47:37.819010 21490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:37.810890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:38717 (local address 127.30.214.131:44457)
0808 14:47:37.811040 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:37.811079 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 14:47:37.811564 (+ 485us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:47:37.811762 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:47:37.811765 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:47:37.812338 (+ 573us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:47:37.812528 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:37.812532 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:37.813233 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:37.813234 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:37.814075 (+ 841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:37.814077 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:37.814396 (+ 319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:37.814396 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:37.814506 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:37.814963 (+ 457us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:47:37.814971 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:47:37.816283 (+ 1312us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:47:37.817565 (+ 1282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:47:37.817572 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:47:37.817575 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:47:37.817815 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:47:37.817993 (+ 178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:47:37.817993 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:47:37.817994 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:47:37.818133 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:47:37.818397 (+ 264us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:47:37.818404 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:47:37.818538 (+ 134us) client_negotiation.cc:769] Sending connection context
0808 14:47:37.818636 (+ 98us) client_negotiation.cc:240] Negotiation successful
0808 14:47:37.818792 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":80,"threads_started":1}
I20260808 14:47:37.819425 21487 heartbeater.cc:347] Connected to a master server at 127.30.214.190:38717
I20260808 14:47:37.819514 21487 heartbeater.cc:464] Registering TS with master...
I20260808 14:47:37.819687 21487 heartbeater.cc:511] Master 127.30.214.190:38717 requested a full tablet report, sending...
I20260808 14:47:37.820068 20813 ts_manager.cc:194] Registered new tserver with Master: 1e60ec8293de4a4da360818ddf52171e (127.30.214.131:35081)
I20260808 14:47:37.820425 20813 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.214.131@KRBTEST.COM'} at 127.30.214.131:44457
I20260808 14:47:37.823840 21493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:37.818084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53640 (local address 127.30.214.190:38717)
0808 14:47:37.818199 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0808 14:47:37.818201 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:47:37.818233 (+ 32us) server_negotiation.cc:407] Connection header received
0808 14:47:37.818306 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:47:37.818306 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:47:37.818318 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:47:37.818371 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:47:37.818898 (+ 527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:37.819608 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:37.820370 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:37.820615 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:37.820668 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:37.821809 (+ 1141us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:47:37.821810 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:47:37.821810 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:47:37.821817 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:47:37.822857 (+ 1040us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:37.823152 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:37.823153 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:37.823153 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:37.823212 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:37.823378 (+ 166us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:37.823379 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:37.823379 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:37.823487 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:47:37.823640 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0808 14:47:37.823676 (+ 36us) server_negotiation.cc:299] Negotiation successful
0808 14:47:37.823752 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92,"thread_start_us":65,"threads_started":1}
I20260808 14:47:37.824494 31578 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:47:37.826869 21493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:37.824764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53654 (local address 127.30.214.190:38717)
0808 14:47:37.824820 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 14:47:37.824822 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:47:37.824889 (+ 67us) server_negotiation.cc:407] Connection header received
0808 14:47:37.824935 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:47:37.824936 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:47:37.824964 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:47:37.825014 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:47:37.825094 (+ 80us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:37.825593 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:37.826281 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:37.826476 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:37.826527 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:37.826633 (+ 106us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:47:37.826723 (+ 90us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:47:37.826776 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 14:47:37.826789 (+ 13us) server_negotiation.cc:299] Negotiation successful
0808 14:47:37.826805 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 14:47:37.827159 20813 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:53654:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:47:37.828727 20813 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:47:37.830879 20995 tablet_service.cc:1467] Processing CreateTablet for tablet 08c4f30e6915473e8336b9de00b22ba8 (DEFAULT_TABLE table=test-table [id=40f7545f0ca34f339c8e775858343ddf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:47:37.831085 20995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08c4f30e6915473e8336b9de00b22ba8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:47:37.832526 20934 tablet_bootstrap.cc:492] T 08c4f30e6915473e8336b9de00b22ba8 P 10c596e3a5ba4fe39a038d22df98111a: Bootstrap starting.
I20260808 14:47:37.832856 20934 tablet_bootstrap.cc:654] T 08c4f30e6915473e8336b9de00b22ba8 P 10c596e3a5ba4fe39a038d22df98111a: Neither blocks nor log segments found. Creating new log.
I20260808 14:47:37.833811 20934 tablet_bootstrap.cc:492] T 08c4f30e6915473e8336b9de00b22ba8 P 10c596e3a5ba4fe39a038d22df98111a: No bootstrap required, opened a new log
I20260808 14:47:37.833868 20934 ts_tablet_manager.cc:1397] T 08c4f30e6915473e8336b9de00b22ba8 P 10c596e3a5ba4fe39a038d22df98111a: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 14:47:37.834017 20934 raft_consensus.cc:348] T 08c4f30e6915473e8336b9de00b22ba8 P 10c596e3a5ba4fe39a038d22df98111a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e60ec8293de4a4da360818ddf52171e" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 35081 } } peers { permanent_uuid: "d8babb5bfd404a14af9ba9ed23500a59" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35839 } } peers { permanent_uuid: "10c596e3a5ba4fe39a038d22df98111a" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 42291 } }
I20260808 14:47:37.834086 20934 raft_consensus.cc:374] T 08c4f30e6915473e8336b9de00b22ba8 P 10c596e3a5ba4fe39a038d22df98111a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:47:37.834133 20934 raft_consensus.cc:729] T 08c4f30e6915473e8336b9de00b22ba8 P 10c596e3a5ba4fe39a038d22df98111a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c596e3a5ba4fe39a038d22df98111a, State: Initialized, Role: FOLLOWER
I20260808 14:47:37.834185 20934 consensus_queue.cc:260] T 08c4f30e6915473e8336b9de00b22ba8 P 10c596e3a5ba4fe39a038d22df98111a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e60ec8293de4a4da360818ddf52171e" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 35081 } } peers { permanent_uuid: "d8babb5bfd404a14af9ba9ed23500a59" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35839 } } peers { permanent_uuid: "10c596e3a5ba4fe39a038d22df98111a" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 42291 } }
I20260808 14:47:37.834281 20934 ts_tablet_manager.cc:1428] T 08c4f30e6915473e8336b9de00b22ba8 P 10c596e3a5ba4fe39a038d22df98111a: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 14:47:37.834342 21102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:37.830394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.131:35081 (local address 127.0.0.1:48440)
0808 14:47:37.830438 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:37.830451 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:47:37.830491 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:47:37.830883 (+ 392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:47:37.830884 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:47:37.830885 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:47:37.830925 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:37.830926 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:37.832052 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:37.832053 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:37.832956 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:37.832959 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:37.834036 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:37.834037 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:37.834114 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:37.834165 (+ 51us) client_negotiation.cc:769] Sending connection context
0808 14:47:37.834220 (+ 55us) client_negotiation.cc:240] Negotiation successful
0808 14:47:37.834275 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28,"mutex_wait_us":24}
I20260808 14:47:37.834558 21497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:37.830487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48440 (local address 127.30.214.131:35081)
0808 14:47:37.830720 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0808 14:47:37.830724 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:47:37.830735 (+ 11us) server_negotiation.cc:407] Connection header received
0808 14:47:37.830774 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:47:37.830776 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:47:37.830791 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:47:37.830869 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:47:37.830977 (+ 108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:37.831959 (+ 982us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:37.833060 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:37.833946 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:37.834009 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:37.834078 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 14:47:37.834431 (+ 353us) server_negotiation.cc:299] Negotiation successful
0808 14:47:37.834480 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":198,"thread_start_us":92,"threads_started":1}
I20260808 14:47:37.835232 21397 tablet_service.cc:1467] Processing CreateTablet for tablet 08c4f30e6915473e8336b9de00b22ba8 (DEFAULT_TABLE table=test-table [id=40f7545f0ca34f339c8e775858343ddf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:47:37.835585 21397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08c4f30e6915473e8336b9de00b22ba8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:47:37.836284 21495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:37.830455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.130:35839 (local address 127.0.0.1:46208)
0808 14:47:37.830622 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:37.830632 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:47:37.830678 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:47:37.832754 (+ 2076us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:47:37.832755 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:47:37.832757 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:47:37.832802 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:37.832803 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:37.834007 (+ 1204us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:37.834008 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:37.835244 (+ 1236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:37.835247 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:37.836067 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:37.836068 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:37.836133 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:37.836137 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:47:37.836183 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 14:47:37.836224 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":114,"threads_started":1}
I20260808 14:47:37.836571 21498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:37.830566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46208 (local address 127.30.214.130:35839)
0808 14:47:37.832597 (+ 2031us) server_negotiation.cc:206] Beginning negotiation
0808 14:47:37.832601 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:47:37.832612 (+ 11us) server_negotiation.cc:407] Connection header received
0808 14:47:37.832655 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:47:37.832657 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:47:37.832674 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:47:37.832751 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:47:37.832861 (+ 110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:37.833891 (+ 1030us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:37.835324 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:37.835912 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:37.835981 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:37.836035 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 14:47:37.836464 (+ 429us) server_negotiation.cc:299] Negotiation successful
0808 14:47:37.836510 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1974,"thread_start_us":108,"threads_started":1}
I20260808 14:47:37.837267 21192 tablet_service.cc:1467] Processing CreateTablet for tablet 08c4f30e6915473e8336b9de00b22ba8 (DEFAULT_TABLE table=test-table [id=40f7545f0ca34f339c8e775858343ddf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:47:37.837628 21192 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08c4f30e6915473e8336b9de00b22ba8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:47:37.838744 21500 tablet_bootstrap.cc:492] T 08c4f30e6915473e8336b9de00b22ba8 P 1e60ec8293de4a4da360818ddf52171e: Bootstrap starting.
I20260808 14:47:37.839506 21500 tablet_bootstrap.cc:654] T 08c4f30e6915473e8336b9de00b22ba8 P 1e60ec8293de4a4da360818ddf52171e: Neither blocks nor log segments found. Creating new log.
I20260808 14:47:37.840087 21500 log.cc:824] T 08c4f30e6915473e8336b9de00b22ba8 P 1e60ec8293de4a4da360818ddf52171e: Log is configured to *not* fsync() on all Append() calls
I20260808 14:47:37.840812 21502 tablet_bootstrap.cc:492] T 08c4f30e6915473e8336b9de00b22ba8 P d8babb5bfd404a14af9ba9ed23500a59: Bootstrap starting.
I20260808 14:47:37.840871 21500 tablet_bootstrap.cc:492] T 08c4f30e6915473e8336b9de00b22ba8 P 1e60ec8293de4a4da360818ddf52171e: No bootstrap required, opened a new log
I20260808 14:47:37.840945 21500 ts_tablet_manager.cc:1397] T 08c4f30e6915473e8336b9de00b22ba8 P 1e60ec8293de4a4da360818ddf52171e: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:47:37.841408 21502 tablet_bootstrap.cc:654] T 08c4f30e6915473e8336b9de00b22ba8 P d8babb5bfd404a14af9ba9ed23500a59: Neither blocks nor log segments found. Creating new log.
I20260808 14:47:37.841856 21502 log.cc:824] T 08c4f30e6915473e8336b9de00b22ba8 P d8babb5bfd404a14af9ba9ed23500a59: Log is configured to *not* fsync() on all Append() calls
I20260808 14:47:37.842619 21502 tablet_bootstrap.cc:492] T 08c4f30e6915473e8336b9de00b22ba8 P d8babb5bfd404a14af9ba9ed23500a59: No bootstrap required, opened a new log
I20260808 14:47:37.842511 21500 raft_consensus.cc:348] T 08c4f30e6915473e8336b9de00b22ba8 P 1e60ec8293de4a4da360818ddf52171e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e60ec8293de4a4da360818ddf52171e" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 35081 } } peers { permanent_uuid: "d8babb5bfd404a14af9ba9ed23500a59" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35839 } } peers { permanent_uuid: "10c596e3a5ba4fe39a038d22df98111a" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 42291 } }
I20260808 14:47:37.842667 21500 raft_consensus.cc:374] T 08c4f30e6915473e8336b9de00b22ba8 P 1e60ec8293de4a4da360818ddf52171e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:47:37.842693 21502 ts_tablet_manager.cc:1397] T 08c4f30e6915473e8336b9de00b22ba8 P d8babb5bfd404a14af9ba9ed23500a59: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260808 14:47:37.842711 21500 raft_consensus.cc:729] T 08c4f30e6915473e8336b9de00b22ba8 P 1e60ec8293de4a4da360818ddf52171e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e60ec8293de4a4da360818ddf52171e, State: Initialized, Role: FOLLOWER
I20260808 14:47:37.842839 21500 consensus_queue.cc:260] T 08c4f30e6915473e8336b9de00b22ba8 P 1e60ec8293de4a4da360818ddf52171e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e60ec8293de4a4da360818ddf52171e" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 35081 } } peers { permanent_uuid: "d8babb5bfd404a14af9ba9ed23500a59" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35839 } } peers { permanent_uuid: "10c596e3a5ba4fe39a038d22df98111a" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 42291 } }
I20260808 14:47:37.843151 21500 ts_tablet_manager.cc:1428] T 08c4f30e6915473e8336b9de00b22ba8 P 1e60ec8293de4a4da360818ddf52171e: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 14:47:37.843171 21487 heartbeater.cc:503] Master 127.30.214.190:38717 was elected leader, sending a full tablet report...
I20260808 14:47:37.844374 21502 raft_consensus.cc:348] T 08c4f30e6915473e8336b9de00b22ba8 P d8babb5bfd404a14af9ba9ed23500a59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e60ec8293de4a4da360818ddf52171e" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 35081 } } peers { permanent_uuid: "d8babb5bfd404a14af9ba9ed23500a59" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35839 } } peers { permanent_uuid: "10c596e3a5ba4fe39a038d22df98111a" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 42291 } }
I20260808 14:47:37.844511 21502 raft_consensus.cc:374] T 08c4f30e6915473e8336b9de00b22ba8 P d8babb5bfd404a14af9ba9ed23500a59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:47:37.844532 21502 raft_consensus.cc:729] T 08c4f30e6915473e8336b9de00b22ba8 P d8babb5bfd404a14af9ba9ed23500a59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8babb5bfd404a14af9ba9ed23500a59, State: Initialized, Role: FOLLOWER
I20260808 14:47:37.844640 21502 consensus_queue.cc:260] T 08c4f30e6915473e8336b9de00b22ba8 P d8babb5bfd404a14af9ba9ed23500a59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e60ec8293de4a4da360818ddf52171e" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 35081 } } peers { permanent_uuid: "d8babb5bfd404a14af9ba9ed23500a59" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35839 } } peers { permanent_uuid: "10c596e3a5ba4fe39a038d22df98111a" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 42291 } }
I20260808 14:47:37.844892 21502 ts_tablet_manager.cc:1428] T 08c4f30e6915473e8336b9de00b22ba8 P d8babb5bfd404a14af9ba9ed23500a59: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260808 14:47:37.844920 21291 heartbeater.cc:503] Master 127.30.214.190:38717 was elected leader, sending a full tablet report...
I20260808 14:47:37.931399 21507 raft_consensus.cc:482] T 08c4f30e6915473e8336b9de00b22ba8 P d8babb5bfd404a14af9ba9ed23500a59 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:47:37.931529 21507 raft_consensus.cc:504] T 08c4f30e6915473e8336b9de00b22ba8 P d8babb5bfd404a14af9ba9ed23500a59 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e60ec8293de4a4da360818ddf52171e" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 35081 } } peers { permanent_uuid: "d8babb5bfd404a14af9ba9ed23500a59" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35839 } } peers { permanent_uuid: "10c596e3a5ba4fe39a038d22df98111a" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 42291 } }
I20260808 14:47:37.931865 21507 leader_election.cc:288] T 08c4f30e6915473e8336b9de00b22ba8 P d8babb5bfd404a14af9ba9ed23500a59 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e60ec8293de4a4da360818ddf52171e (127.30.214.131:35081), 10c596e3a5ba4fe39a038d22df98111a (127.30.214.129:42291)
I20260808 14:47:37.935820 21103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:37.932256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.130:37971 (local address 127.30.214.129:42291)
0808 14:47:37.932310 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 14:47:37.932312 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:47:37.932322 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:47:37.932349 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:47:37.932350 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:47:37.932379 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:47:37.932453 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:47:37.932588 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:37.933311 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:37.934877 (+ 1566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:37.935504 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:37.935569 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:37.935649 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 14:47:37.935704 (+ 55us) server_negotiation.cc:299] Negotiation successful
0808 14:47:37.935748 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 14:47:37.935820 21497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:37.932182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.130:47479 (local address 127.30.214.131:35081)
0808 14:47:37.932310 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0808 14:47:37.932312 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:47:37.932320 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:47:37.932349 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:47:37.932350 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:47:37.932359 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:47:37.932408 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:47:37.932552 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:37.933312 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:37.934879 (+ 1567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:37.935462 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:37.935542 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:37.935554 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0808 14:47:37.935704 (+ 150us) server_negotiation.cc:299] Negotiation successful
0808 14:47:37.935746 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102}
I20260808 14:47:37.935853 21293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:37.932055 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.131:35081 (local address 127.30.214.130:47479)
0808 14:47:37.932109 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:37.932120 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:47:37.932171 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:47:37.932420 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:47:37.932421 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:47:37.932423 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:47:37.932499 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:37.932502 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:37.933472 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:37.933472 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:37.934765 (+ 1293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:37.934769 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:37.935552 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:37.935553 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:37.935639 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:37.935641 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 14:47:37.935691 (+ 50us) client_negotiation.cc:240] Negotiation successful
0808 14:47:37.935743 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33,"mutex_wait_us":37}
I20260808 14:47:37.935858 21508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:37.932076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.129:42291 (local address 127.30.214.130:37971)
0808 14:47:37.932245 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:37.932254 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:47:37.932307 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:47:37.932460 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:47:37.932461 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:47:37.932462 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:47:37.932524 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:37.932525 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:37.933463 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:37.933464 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:37.934765 (+ 1301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:37.934769 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:37.935571 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:37.935572 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:37.935635 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:37.935640 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 14:47:37.935697 (+ 57us) client_negotiation.cc:240] Negotiation successful
0808 14:47:37.935743 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"mutex_wait_us":53,"thread_start_us":116,"threads_started":1}
I20260808 14:47:37.936230 21422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08c4f30e6915473e8336b9de00b22ba8" candidate_uuid: "d8babb5bfd404a14af9ba9ed23500a59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e60ec8293de4a4da360818ddf52171e" is_pre_election: true
I20260808 14:47:37.936408 21422 raft_consensus.cc:2454] T 08c4f30e6915473e8336b9de00b22ba8 P 1e60ec8293de4a4da360818ddf52171e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8babb5bfd404a14af9ba9ed23500a59 in term 0.
I20260808 14:47:37.936728 21132 leader_election.cc:302] T 08c4f30e6915473e8336b9de00b22ba8 P d8babb5bfd404a14af9ba9ed23500a59 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e60ec8293de4a4da360818ddf52171e, d8babb5bfd404a14af9ba9ed23500a59; no voters:
I20260808 14:47:37.936738 21021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08c4f30e6915473e8336b9de00b22ba8" candidate_uuid: "d8babb5bfd404a14af9ba9ed23500a59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c596e3a5ba4fe39a038d22df98111a" is_pre_election: true
I20260808 14:47:37.936867 21021 raft_consensus.cc:2454] T 08c4f30e6915473e8336b9de00b22ba8 P 10c596e3a5ba4fe39a038d22df98111a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8babb5bfd404a14af9ba9ed23500a59 in term 0.
I20260808 14:47:37.936890 21507 raft_consensus.cc:2781] T 08c4f30e6915473e8336b9de00b22ba8 P d8babb5bfd404a14af9ba9ed23500a59 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:47:37.936969 21507 raft_consensus.cc:482] T 08c4f30e6915473e8336b9de00b22ba8 P d8babb5bfd404a14af9ba9ed23500a59 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:47:37.937016 21507 raft_consensus.cc:3037] T 08c4f30e6915473e8336b9de00b22ba8 P d8babb5bfd404a14af9ba9ed23500a59 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:47:37.937892 21507 raft_consensus.cc:504] T 08c4f30e6915473e8336b9de00b22ba8 P d8babb5bfd404a14af9ba9ed23500a59 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e60ec8293de4a4da360818ddf52171e" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 35081 } } peers { permanent_uuid: "d8babb5bfd404a14af9ba9ed23500a59" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35839 } } peers { permanent_uuid: "10c596e3a5ba4fe39a038d22df98111a" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 42291 } }
I20260808 14:47:37.938041 21507 leader_election.cc:288] T 08c4f30e6915473e8336b9de00b22ba8 P d8babb5bfd404a14af9ba9ed23500a59 [CANDIDATE]: Term 1 election: Requested vote from peers 1e60ec8293de4a4da360818ddf52171e (127.30.214.131:35081), 10c596e3a5ba4fe39a038d22df98111a (127.30.214.129:42291)
I20260808 14:47:37.938338 21422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08c4f30e6915473e8336b9de00b22ba8" candidate_uuid: "d8babb5bfd404a14af9ba9ed23500a59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e60ec8293de4a4da360818ddf52171e"
I20260808 14:47:37.938356 21021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08c4f30e6915473e8336b9de00b22ba8" candidate_uuid: "d8babb5bfd404a14af9ba9ed23500a59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10c596e3a5ba4fe39a038d22df98111a"
I20260808 14:47:37.938442 21021 raft_consensus.cc:3037] T 08c4f30e6915473e8336b9de00b22ba8 P 10c596e3a5ba4fe39a038d22df98111a [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:47:37.938436 21422 raft_consensus.cc:3037] T 08c4f30e6915473e8336b9de00b22ba8 P 1e60ec8293de4a4da360818ddf52171e [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:47:37.939158 21422 raft_consensus.cc:2454] T 08c4f30e6915473e8336b9de00b22ba8 P 1e60ec8293de4a4da360818ddf52171e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8babb5bfd404a14af9ba9ed23500a59 in term 1.
I20260808 14:47:37.939165 21021 raft_consensus.cc:2454] T 08c4f30e6915473e8336b9de00b22ba8 P 10c596e3a5ba4fe39a038d22df98111a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8babb5bfd404a14af9ba9ed23500a59 in term 1.
I20260808 14:47:37.939402 21132 leader_election.cc:302] T 08c4f30e6915473e8336b9de00b22ba8 P d8babb5bfd404a14af9ba9ed23500a59 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e60ec8293de4a4da360818ddf52171e, d8babb5bfd404a14af9ba9ed23500a59; no voters:
I20260808 14:47:37.939522 21507 raft_consensus.cc:2781] T 08c4f30e6915473e8336b9de00b22ba8 P d8babb5bfd404a14af9ba9ed23500a59 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:47:37.939720 21507 raft_consensus.cc:686] T 08c4f30e6915473e8336b9de00b22ba8 P d8babb5bfd404a14af9ba9ed23500a59 [term 1 LEADER]: Becoming Leader. State: Replica: d8babb5bfd404a14af9ba9ed23500a59, State: Running, Role: LEADER
I20260808 14:47:37.939816 21507 consensus_queue.cc:237] T 08c4f30e6915473e8336b9de00b22ba8 P d8babb5bfd404a14af9ba9ed23500a59 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e60ec8293de4a4da360818ddf52171e" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 35081 } } peers { permanent_uuid: "d8babb5bfd404a14af9ba9ed23500a59" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35839 } } peers { permanent_uuid: "10c596e3a5ba4fe39a038d22df98111a" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 42291 } }
I20260808 14:47:37.940661 20813 catalog_manager.cc:5495] T 08c4f30e6915473e8336b9de00b22ba8 P d8babb5bfd404a14af9ba9ed23500a59 reported cstate change: term changed from 0 to 1, leader changed from <none> to d8babb5bfd404a14af9ba9ed23500a59 (127.30.214.130). New cstate: current_term: 1 leader_uuid: "d8babb5bfd404a14af9ba9ed23500a59" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e60ec8293de4a4da360818ddf52171e" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 35081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8babb5bfd404a14af9ba9ed23500a59" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10c596e3a5ba4fe39a038d22df98111a" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 42291 } health_report { overall_health: UNKNOWN } } }
W20260808 14:47:37.940924 21292 tablet.cc:2369] T 08c4f30e6915473e8336b9de00b22ba8 P d8babb5bfd404a14af9ba9ed23500a59: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:47:37.949540 21498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:37.947325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46220 (local address 127.30.214.130:35839)
0808 14:47:37.947371 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 14:47:37.947373 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:47:37.947390 (+ 17us) server_negotiation.cc:407] Connection header received
0808 14:47:37.947419 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:47:37.947419 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:47:37.947435 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:47:37.947492 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:47:37.947587 (+ 95us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:37.948069 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:37.948770 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:37.948977 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:37.949032 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:37.949190 (+ 158us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:47:37.949290 (+ 100us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:47:37.949360 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 14:47:37.949388 (+ 28us) server_negotiation.cc:299] Negotiation successful
0808 14:47:37.949411 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 14:47:37.951234 21422 raft_consensus.cc:1261] T 08c4f30e6915473e8336b9de00b22ba8 P 1e60ec8293de4a4da360818ddf52171e [term 1 FOLLOWER]: Refusing update from remote peer d8babb5bfd404a14af9ba9ed23500a59: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:47:37.951313 21021 raft_consensus.cc:1261] T 08c4f30e6915473e8336b9de00b22ba8 P 10c596e3a5ba4fe39a038d22df98111a [term 1 FOLLOWER]: Refusing update from remote peer d8babb5bfd404a14af9ba9ed23500a59: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:47:37.951594 21509 consensus_queue.cc:1035] T 08c4f30e6915473e8336b9de00b22ba8 P d8babb5bfd404a14af9ba9ed23500a59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e60ec8293de4a4da360818ddf52171e" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 35081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:47:37.951730 21507 consensus_queue.cc:1035] T 08c4f30e6915473e8336b9de00b22ba8 P d8babb5bfd404a14af9ba9ed23500a59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10c596e3a5ba4fe39a038d22df98111a" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 42291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:47:37.954504 21512 mvcc.cc:205] Tried to move back new op lower bound from 7316277075765792768 to 7316277075722104832. Current Snapshot: MvccSnapshot[applied={T|T < 7316277075765792768}]
I20260808 14:47:37.956470 20809 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:53654:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:47:37.956586 20809 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:53654:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:47:37.957391 20809 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 97940778e9cb4bd8a14393fcbc4f9b20: Sending DeleteTablet for 3 replicas of tablet 08c4f30e6915473e8336b9de00b22ba8
I20260808 14:47:37.957731 21192 tablet_service.cc:1514] Processing DeleteTablet for tablet 08c4f30e6915473e8336b9de00b22ba8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:47:37 UTC) from {username='kudu', principal='kudu/127.30.214.190@KRBTEST.COM'} at 127.0.0.1:46208
I20260808 14:47:37.957778 20995 tablet_service.cc:1514] Processing DeleteTablet for tablet 08c4f30e6915473e8336b9de00b22ba8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:47:37 UTC) from {username='kudu', principal='kudu/127.30.214.190@KRBTEST.COM'} at 127.0.0.1:51198
I20260808 14:47:37.957798 21397 tablet_service.cc:1514] Processing DeleteTablet for tablet 08c4f30e6915473e8336b9de00b22ba8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:47:37 UTC) from {username='kudu', principal='kudu/127.30.214.190@KRBTEST.COM'} at 127.0.0.1:48440
I20260808 14:47:37.957870 21104 tablet_replica.cc:330] T 08c4f30e6915473e8336b9de00b22ba8 P 10c596e3a5ba4fe39a038d22df98111a: stopping tablet replica
I20260808 14:47:37.957927 21104 raft_consensus.cc:2229] T 08c4f30e6915473e8336b9de00b22ba8 P 10c596e3a5ba4fe39a038d22df98111a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:47:37.957945 21526 tablet_replica.cc:330] T 08c4f30e6915473e8336b9de00b22ba8 P d8babb5bfd404a14af9ba9ed23500a59: stopping tablet replica
I20260808 14:47:37.957985 21104 raft_consensus.cc:2258] T 08c4f30e6915473e8336b9de00b22ba8 P 10c596e3a5ba4fe39a038d22df98111a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:47:37.958033 21526 raft_consensus.cc:2229] T 08c4f30e6915473e8336b9de00b22ba8 P d8babb5bfd404a14af9ba9ed23500a59 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:47:37.958141 21526 raft_consensus.cc:2258] T 08c4f30e6915473e8336b9de00b22ba8 P d8babb5bfd404a14af9ba9ed23500a59 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:47:37.958189 21528 tablet_replica.cc:330] T 08c4f30e6915473e8336b9de00b22ba8 P 1e60ec8293de4a4da360818ddf52171e: stopping tablet replica
I20260808 14:47:37.958191 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 20872
I20260808 14:47:37.964466 21528 raft_consensus.cc:2229] T 08c4f30e6915473e8336b9de00b22ba8 P 1e60ec8293de4a4da360818ddf52171e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:47:37.964710 21528 raft_consensus.cc:2258] T 08c4f30e6915473e8336b9de00b22ba8 P 1e60ec8293de4a4da360818ddf52171e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:47:37.965502 21526 ts_tablet_manager.cc:1905] T 08c4f30e6915473e8336b9de00b22ba8 P d8babb5bfd404a14af9ba9ed23500a59: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:47:37.967173 21528 ts_tablet_manager.cc:1905] T 08c4f30e6915473e8336b9de00b22ba8 P 1e60ec8293de4a4da360818ddf52171e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:47:37.967221 21526 ts_tablet_manager.cc:1918] T 08c4f30e6915473e8336b9de00b22ba8 P d8babb5bfd404a14af9ba9ed23500a59: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:47:37.967293 21526 log.cc:1196] T 08c4f30e6915473e8336b9de00b22ba8 P d8babb5bfd404a14af9ba9ed23500a59: Deleting WAL directory at /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-1/wal/wals/08c4f30e6915473e8336b9de00b22ba8
I20260808 14:47:37.967624 21526 ts_tablet_manager.cc:1939] T 08c4f30e6915473e8336b9de00b22ba8 P d8babb5bfd404a14af9ba9ed23500a59: Deleting consensus metadata
I20260808 14:47:37.968122 20790 catalog_manager.cc:4841] TS d8babb5bfd404a14af9ba9ed23500a59 (127.30.214.130:35839): tablet 08c4f30e6915473e8336b9de00b22ba8 (table test-table [id=40f7545f0ca34f339c8e775858343ddf]) successfully deleted
I20260808 14:47:37.969096 21528 ts_tablet_manager.cc:1918] T 08c4f30e6915473e8336b9de00b22ba8 P 1e60ec8293de4a4da360818ddf52171e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:47:37.969179 21528 log.cc:1196] T 08c4f30e6915473e8336b9de00b22ba8 P 1e60ec8293de4a4da360818ddf52171e: Deleting WAL directory at /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-2/wal/wals/08c4f30e6915473e8336b9de00b22ba8
I20260808 14:47:37.969477 21528 ts_tablet_manager.cc:1939] T 08c4f30e6915473e8336b9de00b22ba8 P 1e60ec8293de4a4da360818ddf52171e: Deleting consensus metadata
I20260808 14:47:37.969942 20791 catalog_manager.cc:4841] TS 1e60ec8293de4a4da360818ddf52171e (127.30.214.131:35081): tablet 08c4f30e6915473e8336b9de00b22ba8 (table test-table [id=40f7545f0ca34f339c8e775858343ddf]) successfully deleted
W20260808 14:47:37.976905 20790 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.30.214.129:42291 (error 108)
I20260808 14:47:37.977198 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 21101
I20260808 14:47:37.979449 21495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:37.977331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.129:42291 (local address 127.0.0.1:51206)
0808 14:47:37.979300 (+ 1969us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:37.979404 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.129:42291: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1939}
W20260808 14:47:37.986394 20790 catalog_manager.cc:4584] TS 10c596e3a5ba4fe39a038d22df98111a (127.30.214.129:42291): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 08c4f30e6915473e8336b9de00b22ba8: Network error: Client connection negotiation failed: client connection to 127.30.214.129:42291: connect: Connection refused (error 111)
I20260808 14:47:37.991626 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 21294
I20260808 14:47:38.006065 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 20768
I20260808 14:47:38.017851 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:38717
--webserver_interface=127.30.214.190
--webserver_port=34327
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab
--principal=kudu/127.30.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:34133
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.214.190:38717
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:47:38.101744 21531 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:47:38.101974 21531 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:47:38.101997 21531 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:47:38.103202 21531 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:47:38.103250 21531 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:47:38.103263 21531 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:47:38.103276 21531 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:47:38.103288 21531 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:47:38.104900 21531 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:34133
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.214.190:38717
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab
--principal=kudu/127.30.214.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:38717
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.214.190
--webserver_port=34327
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21531
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:47:38.105165 21531 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:47:38.105388 21531 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:47:38.110453 21542 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:47:38.110605 21531 server_base.cc:1034] running on GCE node
W20260808 14:47:38.110555 21538 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:47:38.110453 21540 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:47:38.111033 21531 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:47:38.111321 21531 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:47:38.112457 21531 hybrid_clock.cc:648] HybridClock initialized: now 1786200458112450 us; error 29 us; skew 500 ppm
Aug 08 14:47:38 dist-test-slave-42z9 krb5kdc[19974](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200458, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:47:38.114966 21531 init.cc:377] Logged in from keytab as kudu/127.30.214.190@KRBTEST.COM (short username kudu)
I20260808 14:47:38.115403 21531 webserver.cc:460] Webserver started at http://127.30.214.190:34327/ using document root <none> and password file <none>
I20260808 14:47:38.115590 21531 fs_manager.cc:359] Metadata directory not provided
I20260808 14:47:38.115633 21531 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:47:38.116962 21531 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:47:38.117619 21553 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:47:38.117789 21531 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:47:38.117887 21531 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/master-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/master-0/wal
uuid: "97940778e9cb4bd8a14393fcbc4f9b20"
format_stamp: "Formatted at 2026-08-08 14:47:36 on dist-test-slave-42z9"
server_key: "90915863c18ae84b7e8c60b724262d66"
server_key_iv: "080b1e763b01888ab95345f9232f4bc0"
server_key_version: "encryptionkey@0"
I20260808 14:47:38.118242 21531 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:47:38.135015 21531 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:47:38.137250 21531 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:47:38.137387 21531 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:47:38.141402 21531 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.190:38717
I20260808 14:47:38.141489 21617 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.190:38717 every 8 connection(s)
I20260808 14:47:38.141865 21531 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
I20260808 14:47:38.143558 21619 sys_catalog.cc:263] Verifying existing consensus state
I20260808 14:47:38.143566 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 21531
I20260808 14:47:38.143860 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.129:42291
--local_ip_for_outbound_sockets=127.30.214.129
--tserver_master_addrs=127.30.214.190:38717
--webserver_port=35775
--webserver_interface=127.30.214.129
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab
--principal=kudu/127.30.214.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:34133
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:47:38.144474 21619 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 97940778e9cb4bd8a14393fcbc4f9b20: Bootstrap starting.
I20260808 14:47:38.153611 21619 log.cc:824] T 00000000000000000000000000000000 P 97940778e9cb4bd8a14393fcbc4f9b20: Log is configured to *not* fsync() on all Append() calls
I20260808 14:47:38.155853 21619 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 97940778e9cb4bd8a14393fcbc4f9b20: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 14:47:38.156147 21619 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 97940778e9cb4bd8a14393fcbc4f9b20: Bootstrap complete.
I20260808 14:47:38.158370 21619 raft_consensus.cc:348] T 00000000000000000000000000000000 P 97940778e9cb4bd8a14393fcbc4f9b20 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97940778e9cb4bd8a14393fcbc4f9b20" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 38717 } }
I20260808 14:47:38.158658 21619 raft_consensus.cc:729] T 00000000000000000000000000000000 P 97940778e9cb4bd8a14393fcbc4f9b20 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97940778e9cb4bd8a14393fcbc4f9b20, State: Initialized, Role: FOLLOWER
I20260808 14:47:38.158818 21619 consensus_queue.cc:260] T 00000000000000000000000000000000 P 97940778e9cb4bd8a14393fcbc4f9b20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97940778e9cb4bd8a14393fcbc4f9b20" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 38717 } }
I20260808 14:47:38.158895 21619 raft_consensus.cc:388] T 00000000000000000000000000000000 P 97940778e9cb4bd8a14393fcbc4f9b20 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:47:38.158946 21619 raft_consensus.cc:482] T 00000000000000000000000000000000 P 97940778e9cb4bd8a14393fcbc4f9b20 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:47:38.158993 21619 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 97940778e9cb4bd8a14393fcbc4f9b20 [term 2 FOLLOWER]: Advancing to term 3
I20260808 14:47:38.160008 21619 raft_consensus.cc:504] T 00000000000000000000000000000000 P 97940778e9cb4bd8a14393fcbc4f9b20 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97940778e9cb4bd8a14393fcbc4f9b20" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 38717 } }
I20260808 14:47:38.160109 21619 leader_election.cc:302] T 00000000000000000000000000000000 P 97940778e9cb4bd8a14393fcbc4f9b20 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 97940778e9cb4bd8a14393fcbc4f9b20; no voters:
I20260808 14:47:38.160282 21619 leader_election.cc:288] T 00000000000000000000000000000000 P 97940778e9cb4bd8a14393fcbc4f9b20 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260808 14:47:38.160331 21625 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 97940778e9cb4bd8a14393fcbc4f9b20 [term 3 FOLLOWER]: Leader election won for term 3
I20260808 14:47:38.160495 21625 raft_consensus.cc:686] T 00000000000000000000000000000000 P 97940778e9cb4bd8a14393fcbc4f9b20 [term 3 LEADER]: Becoming Leader. State: Replica: 97940778e9cb4bd8a14393fcbc4f9b20, State: Running, Role: LEADER
I20260808 14:47:38.160579 21619 sys_catalog.cc:564] T 00000000000000000000000000000000 P 97940778e9cb4bd8a14393fcbc4f9b20 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:47:38.160632 21625 consensus_queue.cc:237] T 00000000000000000000000000000000 P 97940778e9cb4bd8a14393fcbc4f9b20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97940778e9cb4bd8a14393fcbc4f9b20" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 38717 } }
I20260808 14:47:38.161109 21627 sys_catalog.cc:455] T 00000000000000000000000000000000 P 97940778e9cb4bd8a14393fcbc4f9b20 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 97940778e9cb4bd8a14393fcbc4f9b20. Latest consensus state: current_term: 3 leader_uuid: "97940778e9cb4bd8a14393fcbc4f9b20" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97940778e9cb4bd8a14393fcbc4f9b20" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 38717 } } }
I20260808 14:47:38.161157 21626 sys_catalog.cc:455] T 00000000000000000000000000000000 P 97940778e9cb4bd8a14393fcbc4f9b20 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "97940778e9cb4bd8a14393fcbc4f9b20" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97940778e9cb4bd8a14393fcbc4f9b20" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 38717 } } }
I20260808 14:47:38.161214 21627 sys_catalog.cc:458] T 00000000000000000000000000000000 P 97940778e9cb4bd8a14393fcbc4f9b20 [sys.catalog]: This master's current role is: LEADER
I20260808 14:47:38.161247 21626 sys_catalog.cc:458] T 00000000000000000000000000000000 P 97940778e9cb4bd8a14393fcbc4f9b20 [sys.catalog]: This master's current role is: LEADER
I20260808 14:47:38.161427 21631 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:47:38.162685 21631 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:47:38.162824 21631 catalog_manager.cc:1259] Loaded cluster ID: a53b7c3ba2cb438c8425a3babc0ad873
I20260808 14:47:38.162863 21631 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260808 14:47:38.163233 21631 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f28910b09ad google::LogMessage::Fail() at ??:0
@ 0x7f28910b388a google::LogMessage::SendToLog() at ??:0
@ 0x7f28910b04de google::LogMessage::Flush() at ??:0
@ 0x7f28910b1a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f2898fd10f1 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f2898fda8b9 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f2892f7e0d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f2892f73954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f2893dd76db start_thread at ??:0
@ 0x7f288fbae61f clone at ??:0
W20260808 14:47:38.242776 21622 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:47:38.242995 21622 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:47:38.243019 21622 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:47:38.244227 21622 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:47:38.244277 21622 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:47:38.244303 21622 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.129
I20260808 14:47:38.245887 21622 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:34133
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab
--principal=kudu/127.30.214.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.129:42291
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.214.129
--webserver_port=35775
--tserver_master_addrs=127.30.214.190:38717
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21622
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.129
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:47:38.246169 21622 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:47:38.246407 21622 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:47:38.251814 21669 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:47:38.251858 21622 server_base.cc:1034] running on GCE node
W20260808 14:47:38.251950 21676 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:47:38.251823 21670 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:47:38.252200 21622 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:47:38.252529 21622 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:47:38.253707 21622 hybrid_clock.cc:648] HybridClock initialized: now 1786200458253692 us; error 29 us; skew 500 ppm
Aug 08 14:47:38 dist-test-slave-42z9 krb5kdc[19974](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200458, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:47:38.256922 21622 init.cc:377] Logged in from keytab as kudu/127.30.214.129@KRBTEST.COM (short username kudu)
I20260808 14:47:38.257490 21622 webserver.cc:460] Webserver started at http://127.30.214.129:35775/ using document root <none> and password file <none>
I20260808 14:47:38.257741 21622 fs_manager.cc:359] Metadata directory not provided
I20260808 14:47:38.257802 21622 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:47:38.259591 21622 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 14:47:38.260376 21684 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:47:38.260546 21622 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:47:38.260649 21622 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-0/wal
uuid: "10c596e3a5ba4fe39a038d22df98111a"
format_stamp: "Formatted at 2026-08-08 14:47:36 on dist-test-slave-42z9"
server_key: "a466ba0016cc18752c7277fb05f3da7c"
server_key_iv: "275be272aa060975a69078a2595045cc"
server_key_version: "encryptionkey@0"
I20260808 14:47:38.261118 21622 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:47:38.286433 21622 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:47:38.288915 21622 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:47:38.289086 21622 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:47:38.289410 21622 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:47:38.289965 21693 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 14:47:38.291478 21622 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 14:47:38.291539 21622 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260808 14:47:38.291574 21622 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 14:47:38.292500 21622 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 14:47:38.292547 21622 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260808 14:47:38.292604 21693 tablet_bootstrap.cc:492] T 08c4f30e6915473e8336b9de00b22ba8 P 10c596e3a5ba4fe39a038d22df98111a: Bootstrap starting.
I20260808 14:47:38.299642 21622 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.129:42291
I20260808 14:47:38.299883 21866 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.129:42291 every 8 connection(s)
I20260808 14:47:38.300125 21622 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
I20260808 14:47:38.300643 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 21622
I20260808 14:47:38.300968 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.130:35839
--local_ip_for_outbound_sockets=127.30.214.130
--tserver_master_addrs=127.30.214.190:38717
--webserver_port=34961
--webserver_interface=127.30.214.130
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab
--principal=kudu/127.30.214.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:34133
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:47:38.303264 21693 log.cc:824] T 08c4f30e6915473e8336b9de00b22ba8 P 10c596e3a5ba4fe39a038d22df98111a: Log is configured to *not* fsync() on all Append() calls
I20260808 14:47:38.305711 21693 tablet_bootstrap.cc:492] T 08c4f30e6915473e8336b9de00b22ba8 P 10c596e3a5ba4fe39a038d22df98111a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 14:47:38.305995 21693 tablet_bootstrap.cc:492] T 08c4f30e6915473e8336b9de00b22ba8 P 10c596e3a5ba4fe39a038d22df98111a: Bootstrap complete.
I20260808 14:47:38.307065 21693 ts_tablet_manager.cc:1397] T 08c4f30e6915473e8336b9de00b22ba8 P 10c596e3a5ba4fe39a038d22df98111a: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.008s
I20260808 14:47:38.308611 21693 raft_consensus.cc:348] T 08c4f30e6915473e8336b9de00b22ba8 P 10c596e3a5ba4fe39a038d22df98111a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e60ec8293de4a4da360818ddf52171e" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 35081 } } peers { permanent_uuid: "d8babb5bfd404a14af9ba9ed23500a59" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35839 } } peers { permanent_uuid: "10c596e3a5ba4fe39a038d22df98111a" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 42291 } }
I20260808 14:47:38.308959 21693 raft_consensus.cc:729] T 08c4f30e6915473e8336b9de00b22ba8 P 10c596e3a5ba4fe39a038d22df98111a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c596e3a5ba4fe39a038d22df98111a, State: Initialized, Role: FOLLOWER
I20260808 14:47:38.309135 21693 consensus_queue.cc:260] T 08c4f30e6915473e8336b9de00b22ba8 P 10c596e3a5ba4fe39a038d22df98111a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e60ec8293de4a4da360818ddf52171e" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 35081 } } peers { permanent_uuid: "d8babb5bfd404a14af9ba9ed23500a59" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35839 } } peers { permanent_uuid: "10c596e3a5ba4fe39a038d22df98111a" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 42291 } }
I20260808 14:47:38.309480 21693 ts_tablet_manager.cc:1428] T 08c4f30e6915473e8336b9de00b22ba8 P 10c596e3a5ba4fe39a038d22df98111a: Time spent starting tablet: real 0.002s user 0.004s sys 0.000s
W20260808 14:47:38.363620 21874 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:47:38.301985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:38717 (local address 127.30.214.129:55769)
0808 14:47:38.302197 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:38.302253 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 14:47:38.302879 (+ 626us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:47:38.363402 (+ 60523us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:38717: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":99,"threads_started":1}
W20260808 14:47:38.363905 21867 heartbeater.cc:644] Failed to heartbeat to 127.30.214.190:38717 (0 consecutive failures): Network error: Failed to ping master at 127.30.214.190:38717: Client connection negotiation failed: client connection to 127.30.214.190:38717: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 14:47:38.364271 21874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:38.364148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:38717 (local address 127.30.214.129:45235)
0808 14:47:38.364204 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:38.364246 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:38717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260808 14:47:38.364571 21874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:38.364493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:38717 (local address 127.30.214.129:50799)
0808 14:47:38.364533 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:38.364554 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:38717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260808 14:47:38.364698 21867 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 14:47:38.389642 21877 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:47:38.389854 21877 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:47:38.389889 21877 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:47:38.391079 21877 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:47:38.391127 21877 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:47:38.391165 21877 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.130
I20260808 14:47:38.392704 21877 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:34133
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab
--principal=kudu/127.30.214.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.130:35839
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.214.130
--webserver_port=34961
--tserver_master_addrs=127.30.214.190:38717
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21877
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.130
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:47:38.392961 21877 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:47:38.393186 21877 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 14:47:38.398185 21877 server_base.cc:1034] running on GCE node
W20260808 14:47:38.398141 21893 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:47:38.398149 21891 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:47:38.398141 21895 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:47:38.398608 21877 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:47:38.398857 21877 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:47:38.400014 21877 hybrid_clock.cc:648] HybridClock initialized: now 1786200458399997 us; error 29 us; skew 500 ppm
Aug 08 14:47:38 dist-test-slave-42z9 krb5kdc[19974](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200458, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:47:38.402530 21877 init.cc:377] Logged in from keytab as kudu/127.30.214.130@KRBTEST.COM (short username kudu)
I20260808 14:47:38.402992 21877 webserver.cc:460] Webserver started at http://127.30.214.130:34961/ using document root <none> and password file <none>
I20260808 14:47:38.403179 21877 fs_manager.cc:359] Metadata directory not provided
I20260808 14:47:38.403220 21877 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:47:38.404470 21877 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:47:38.405004 21902 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:47:38.405174 21877 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:47:38.405248 21877 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-1/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-1/wal
uuid: "d8babb5bfd404a14af9ba9ed23500a59"
format_stamp: "Formatted at 2026-08-08 14:47:36 on dist-test-slave-42z9"
server_key: "8eacc4305e5bb9943218e5ad84d42280"
server_key_iv: "28e454b6c592effb6d299fbee5698423"
server_key_version: "encryptionkey@0"
I20260808 14:47:38.405647 21877 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:47:38.423509 21877 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:47:38.425319 21877 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:47:38.425479 21877 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:47:38.425720 21877 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:47:38.426038 21877 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:47:38.426080 21877 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:47:38.426111 21877 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:47:38.426133 21877 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:47:38.431820 21877 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.130:35839
I20260808 14:47:38.431890 22060 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.130:35839 every 8 connection(s)
I20260808 14:47:38.432226 21877 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
I20260808 14:47:38.433297 22064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:38.432904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:38717 (local address 127.30.214.130:39287)
0808 14:47:38.433071 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:38.433153 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:38717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":82,"threads_started":1}
W20260808 14:47:38.433722 22061 heartbeater.cc:644] Failed to heartbeat to 127.30.214.190:38717 (0 consecutive failures): Network error: Failed to ping master at 127.30.214.190:38717: Client connection negotiation failed: client connection to 127.30.214.190:38717: connect: Connection refused (error 111)
I20260808 14:47:38.434026 22064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:38.433904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:38717 (local address 127.30.214.130:56311)
0808 14:47:38.433978 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:38.434006 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:38717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260808 14:47:38.434381 22064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:38.434282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:38717 (local address 127.30.214.130:38587)
0808 14:47:38.434333 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:38.434359 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:38717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
W20260808 14:47:38.434487 22061 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 14:47:38.440320 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 21877
I20260808 14:47:38.440583 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.131:35081
--local_ip_for_outbound_sockets=127.30.214.131
--tserver_master_addrs=127.30.214.190:38717
--webserver_port=40255
--webserver_interface=127.30.214.131
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab
--principal=kudu/127.30.214.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:34133
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:47:38.524073 22065 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:47:38.524296 22065 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:47:38.524319 22065 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:47:38.525476 22065 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:47:38.525522 22065 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:47:38.525550 22065 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.131
I20260808 14:47:38.527020 22065 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:34133
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab
--principal=kudu/127.30.214.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.131:35081
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.214.131
--webserver_port=40255
--tserver_master_addrs=127.30.214.190:38717
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22065
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.131
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:47:38.527227 22065 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:47:38.527422 22065 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:47:38.532269 22072 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:47:38.532276 22076 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:47:38.532276 22071 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:47:38.532469 22065 server_base.cc:1034] running on GCE node
I20260808 14:47:38.532737 22065 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:47:38.532963 22065 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:47:38.534103 22065 hybrid_clock.cc:648] HybridClock initialized: now 1786200458534091 us; error 29 us; skew 500 ppm
Aug 08 14:47:38 dist-test-slave-42z9 krb5kdc[19974](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200458, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:47:38.536584 22065 init.cc:377] Logged in from keytab as kudu/127.30.214.131@KRBTEST.COM (short username kudu)
I20260808 14:47:38.537048 22065 webserver.cc:460] Webserver started at http://127.30.214.131:40255/ using document root <none> and password file <none>
I20260808 14:47:38.537269 22065 fs_manager.cc:359] Metadata directory not provided
I20260808 14:47:38.537318 22065 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:47:38.538749 22065 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:47:38.539294 22088 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:47:38.539451 22065 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:47:38.539532 22065 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-2/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-2/wal
uuid: "1e60ec8293de4a4da360818ddf52171e"
format_stamp: "Formatted at 2026-08-08 14:47:37 on dist-test-slave-42z9"
server_key: "b2d706caa50f55913359ac6ee9cbbaf2"
server_key_iv: "36f49d83a780b10682f2fb7ac6f046cd"
server_key_version: "encryptionkey@0"
I20260808 14:47:38.539875 22065 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:47:38.550453 22065 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:47:38.552287 22065 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:47:38.552423 22065 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:47:38.552630 22065 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:47:38.552919 22065 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:47:38.552953 22065 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:47:38.552981 22065 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:47:38.553006 22065 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:47:38.558856 22065 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.131:35081
I20260808 14:47:38.558899 22247 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.131:35081 every 8 connection(s)
I20260808 14:47:38.559250 22065 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
I20260808 14:47:38.560276 22250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:38.559915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:38717 (local address 127.30.214.131:36195)
0808 14:47:38.560057 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:38.560134 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:38717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":69,"threads_started":1}
W20260808 14:47:38.560653 22248 heartbeater.cc:644] Failed to heartbeat to 127.30.214.190:38717 (0 consecutive failures): Network error: Failed to ping master at 127.30.214.190:38717: Client connection negotiation failed: client connection to 127.30.214.190:38717: connect: Connection refused (error 111)
I20260808 14:47:38.560887 22250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:38.560810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:38717 (local address 127.30.214.131:46629)
0808 14:47:38.560846 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:38.560871 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:38717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
I20260808 14:47:38.561085 22250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:38.561027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:38717 (local address 127.30.214.131:50571)
0808 14:47:38.561056 (+ 29us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:38.561073 (+ 17us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:38717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
W20260808 14:47:38.561167 22248 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 14:47:38.566550 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 22065
I20260808 14:47:39.365355 22252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:39.365068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:38717 (local address 127.30.214.129:52949)
0808 14:47:39.365239 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:39.365286 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:38717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":79,"threads_started":1}
I20260808 14:47:39.435091 22254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:39.434840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:38717 (local address 127.30.214.130:46379)
0808 14:47:39.434982 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:39.435024 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:38717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":64,"threads_started":1}
I20260808 14:47:39.561748 22255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:39.561553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:38717 (local address 127.30.214.131:48209)
0808 14:47:39.561660 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:39.561695 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:38717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92,"thread_start_us":58,"threads_started":1}
I20260808 14:47:39.989342 22256 raft_consensus.cc:482] T 08c4f30e6915473e8336b9de00b22ba8 P 10c596e3a5ba4fe39a038d22df98111a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:47:39.989530 22256 raft_consensus.cc:504] T 08c4f30e6915473e8336b9de00b22ba8 P 10c596e3a5ba4fe39a038d22df98111a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e60ec8293de4a4da360818ddf52171e" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 35081 } } peers { permanent_uuid: "d8babb5bfd404a14af9ba9ed23500a59" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35839 } } peers { permanent_uuid: "10c596e3a5ba4fe39a038d22df98111a" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 42291 } }
I20260808 14:47:39.989845 22256 leader_election.cc:288] T 08c4f30e6915473e8336b9de00b22ba8 P 10c596e3a5ba4fe39a038d22df98111a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e60ec8293de4a4da360818ddf52171e (127.30.214.131:35081), d8babb5bfd404a14af9ba9ed23500a59 (127.30.214.130:35839)
Aug 08 14:47:39 dist-test-slave-42z9 krb5kdc[19974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200458, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.129@KRBTEST.COM for kudu/127.30.214.131@KRBTEST.COM
Aug 08 14:47:39 dist-test-slave-42z9 krb5kdc[19974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200458, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.129@KRBTEST.COM for kudu/127.30.214.130@KRBTEST.COM
I20260808 14:47:40.000104 22261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:39.990184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.129:33277 (local address 127.30.214.131:35081)
0808 14:47:39.990364 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0808 14:47:39.990377 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 14:47:39.990413 (+ 36us) server_negotiation.cc:407] Connection header received
0808 14:47:39.990867 (+ 454us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:47:39.990869 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:47:39.990909 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:47:39.991043 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:47:39.991803 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:39.992693 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:39.993746 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:39.994198 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:39.994304 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:39.996641 (+ 2337us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:47:39.996646 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:47:39.996646 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:47:39.996659 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:47:39.998460 (+ 1801us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:39.998910 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:39.998914 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:39.998914 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:39.999007 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:39.999235 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:39.999236 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:39.999237 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:39.999497 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:47:39.999572 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 14:47:39.999858 (+ 286us) server_negotiation.cc:299] Negotiation successful
0808 14:47:39.999988 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":54,"threads_started":1}
I20260808 14:47:40.000108 22259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:39.990170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.129:58009 (local address 127.30.214.130:35839)
0808 14:47:39.990367 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0808 14:47:39.990377 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:47:39.990398 (+ 21us) server_negotiation.cc:407] Connection header received
0808 14:47:39.990842 (+ 444us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:47:39.990844 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:47:39.990888 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:47:39.991016 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:47:39.991803 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:39.992674 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:39.993750 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:39.994169 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:39.994273 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:39.996949 (+ 2676us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:47:39.996952 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:47:39.996952 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:47:39.996963 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:47:39.998495 (+ 1532us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:39.998912 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:39.998916 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:39.998916 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:39.999007 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:39.999242 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:39.999243 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:39.999243 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:39.999497 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:47:39.999578 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 14:47:39.999857 (+ 279us) server_negotiation.cc:299] Negotiation successful
0808 14:47:39.999990 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":63,"threads_started":1}
I20260808 14:47:40.000139 22257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:39.990083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.130:35839 (local address 127.30.214.129:58009)
0808 14:47:39.990223 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:39.990233 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:47:39.990297 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:47:39.991098 (+ 801us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:47:39.991101 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:47:39.991481 (+ 380us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:47:39.991678 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:39.991684 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:39.992780 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:39.992781 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:39.993665 (+ 884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:39.993668 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:39.994370 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:39.994372 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:39.994475 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:39.995053 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:47:39.995058 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:47:39.996826 (+ 1768us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:47:39.998590 (+ 1764us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:47:39.998591 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:47:39.998591 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:47:39.998840 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:47:39.999069 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:47:39.999070 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:47:39.999070 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:47:39.999184 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:47:39.999566 (+ 382us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:47:39.999574 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:47:39.999701 (+ 127us) client_negotiation.cc:769] Sending connection context
0808 14:47:39.999791 (+ 90us) client_negotiation.cc:240] Negotiation successful
0808 14:47:40.000003 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"mutex_wait_us":46,"thread_start_us":59,"threads_started":1}
I20260808 14:47:40.000211 22258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:39.990064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.131:35081 (local address 127.30.214.129:33277)
0808 14:47:39.990195 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:39.990206 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:47:39.990267 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:47:39.991098 (+ 831us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:47:39.991101 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:47:39.991482 (+ 381us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:47:39.991678 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:39.991685 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:39.992784 (+ 1099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:39.992784 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:39.993665 (+ 881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:39.993668 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:39.994338 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:39.994339 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:39.994476 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:39.995000 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:47:39.995008 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:47:39.996522 (+ 1514us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:47:39.998541 (+ 2019us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:47:39.998549 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:47:39.998552 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:47:39.998835 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:47:39.999066 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:47:39.999066 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:47:39.999067 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:47:39.999181 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:47:39.999564 (+ 383us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:47:39.999571 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:47:39.999700 (+ 129us) client_negotiation.cc:769] Sending connection context
0808 14:47:39.999791 (+ 91us) client_negotiation.cc:240] Negotiation successful
0808 14:47:40.000077 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"mutex_wait_us":182,"thread_start_us":66,"threads_started":1}
W20260808 14:47:40.001586 21686 leader_election.cc:341] T 08c4f30e6915473e8336b9de00b22ba8 P 10c596e3a5ba4fe39a038d22df98111a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d8babb5bfd404a14af9ba9ed23500a59 (127.30.214.130:35839): Not found: Tablet not found: 08c4f30e6915473e8336b9de00b22ba8
W20260808 14:47:40.001693 21687 leader_election.cc:341] T 08c4f30e6915473e8336b9de00b22ba8 P 10c596e3a5ba4fe39a038d22df98111a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1e60ec8293de4a4da360818ddf52171e (127.30.214.131:35081): Not found: Tablet not found: 08c4f30e6915473e8336b9de00b22ba8
I20260808 14:47:40.001747 21687 leader_election.cc:302] T 08c4f30e6915473e8336b9de00b22ba8 P 10c596e3a5ba4fe39a038d22df98111a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c596e3a5ba4fe39a038d22df98111a; no voters: 1e60ec8293de4a4da360818ddf52171e, d8babb5bfd404a14af9ba9ed23500a59
I20260808 14:47:40.001843 22256 raft_consensus.cc:2726] T 08c4f30e6915473e8336b9de00b22ba8 P 10c596e3a5ba4fe39a038d22df98111a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 14:47:40.366087 22257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:40.365812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:38717 (local address 127.30.214.129:55461)
0808 14:47:40.365943 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:40.366025 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:38717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260808 14:47:40.436179 22263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:40.435730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:38717 (local address 127.30.214.130:48807)
0808 14:47:40.436034 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:40.436122 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:38717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":123,"threads_started":1}
I20260808 14:47:40.562423 22264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:40.562212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:38717 (local address 127.30.214.131:44559)
0808 14:47:40.562337 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:40.562380 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:38717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":68,"threads_started":1}
I20260808 14:47:41.366853 22265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:41.366607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:38717 (local address 127.30.214.129:39199)
0808 14:47:41.366751 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:41.366800 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:38717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":71,"threads_started":1}
I20260808 14:47:41.436985 22266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:41.436742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:38717 (local address 127.30.214.130:49743)
0808 14:47:41.436882 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:41.436929 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:38717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":71,"threads_started":1}
I20260808 14:47:41.563148 22268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:41.562918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:38717 (local address 127.30.214.131:56219)
0808 14:47:41.563055 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:41.563103 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:38717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":76,"threads_started":1}
I20260808 14:47:41.861310 22270 raft_consensus.cc:482] T 08c4f30e6915473e8336b9de00b22ba8 P 10c596e3a5ba4fe39a038d22df98111a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:47:41.861507 22270 raft_consensus.cc:504] T 08c4f30e6915473e8336b9de00b22ba8 P 10c596e3a5ba4fe39a038d22df98111a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e60ec8293de4a4da360818ddf52171e" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 35081 } } peers { permanent_uuid: "d8babb5bfd404a14af9ba9ed23500a59" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35839 } } peers { permanent_uuid: "10c596e3a5ba4fe39a038d22df98111a" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 42291 } }
I20260808 14:47:41.861783 22270 leader_election.cc:288] T 08c4f30e6915473e8336b9de00b22ba8 P 10c596e3a5ba4fe39a038d22df98111a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e60ec8293de4a4da360818ddf52171e (127.30.214.131:35081), d8babb5bfd404a14af9ba9ed23500a59 (127.30.214.130:35839)
W20260808 14:47:41.862412 21687 leader_election.cc:341] T 08c4f30e6915473e8336b9de00b22ba8 P 10c596e3a5ba4fe39a038d22df98111a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1e60ec8293de4a4da360818ddf52171e (127.30.214.131:35081): Not found: Tablet not found: 08c4f30e6915473e8336b9de00b22ba8
W20260808 14:47:41.862545 21686 leader_election.cc:341] T 08c4f30e6915473e8336b9de00b22ba8 P 10c596e3a5ba4fe39a038d22df98111a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d8babb5bfd404a14af9ba9ed23500a59 (127.30.214.130:35839): Not found: Tablet not found: 08c4f30e6915473e8336b9de00b22ba8
I20260808 14:47:41.862586 21686 leader_election.cc:302] T 08c4f30e6915473e8336b9de00b22ba8 P 10c596e3a5ba4fe39a038d22df98111a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c596e3a5ba4fe39a038d22df98111a; no voters: 1e60ec8293de4a4da360818ddf52171e, d8babb5bfd404a14af9ba9ed23500a59
I20260808 14:47:41.862669 22270 raft_consensus.cc:2726] T 08c4f30e6915473e8336b9de00b22ba8 P 10c596e3a5ba4fe39a038d22df98111a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 14:47:42.367564 22271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:42.367321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:38717 (local address 127.30.214.129:59701)
0808 14:47:42.367457 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:42.367503 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:38717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":63,"threads_started":1}
I20260808 14:47:42.437866 22273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:42.437549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:38717 (local address 127.30.214.130:42497)
0808 14:47:42.437743 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:42.437807 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:38717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":83,"threads_started":1}
I20260808 14:47:42.563849 22276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:42.563620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:38717 (local address 127.30.214.131:58149)
0808 14:47:42.563760 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:42.563803 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:38717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":81,"threads_started":1}
I20260808 14:47:43.368278 22277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:43.368063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:38717 (local address 127.30.214.129:59885)
0808 14:47:43.368196 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:43.368228 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:38717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":65,"threads_started":1}
I20260808 14:47:43.438663 22278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:43.438418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:38717 (local address 127.30.214.130:49797)
0808 14:47:43.438565 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:43.438614 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:38717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":83,"threads_started":1}
I20260808 14:47:43.564625 22279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:43.564353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:38717 (local address 127.30.214.131:37423)
0808 14:47:43.564529 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:43.564576 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:38717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":83,"threads_started":1}
I20260808 14:47:44.369048 22280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:44.368815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:38717 (local address 127.30.214.129:44599)
0808 14:47:44.368952 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:44.368998 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:38717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":67,"threads_started":1}
I20260808 14:47:44.439428 22283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:44.439158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:38717 (local address 127.30.214.130:45687)
0808 14:47:44.439316 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:44.439379 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:38717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":84,"threads_started":1}
I20260808 14:47:44.454586 22284 raft_consensus.cc:482] T 08c4f30e6915473e8336b9de00b22ba8 P 10c596e3a5ba4fe39a038d22df98111a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:47:44.454677 22284 raft_consensus.cc:504] T 08c4f30e6915473e8336b9de00b22ba8 P 10c596e3a5ba4fe39a038d22df98111a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e60ec8293de4a4da360818ddf52171e" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 35081 } } peers { permanent_uuid: "d8babb5bfd404a14af9ba9ed23500a59" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35839 } } peers { permanent_uuid: "10c596e3a5ba4fe39a038d22df98111a" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 42291 } }
I20260808 14:47:44.454861 22284 leader_election.cc:288] T 08c4f30e6915473e8336b9de00b22ba8 P 10c596e3a5ba4fe39a038d22df98111a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e60ec8293de4a4da360818ddf52171e (127.30.214.131:35081), d8babb5bfd404a14af9ba9ed23500a59 (127.30.214.130:35839)
W20260808 14:47:44.455253 21686 leader_election.cc:341] T 08c4f30e6915473e8336b9de00b22ba8 P 10c596e3a5ba4fe39a038d22df98111a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d8babb5bfd404a14af9ba9ed23500a59 (127.30.214.130:35839): Not found: Tablet not found: 08c4f30e6915473e8336b9de00b22ba8
W20260808 14:47:44.455353 21687 leader_election.cc:341] T 08c4f30e6915473e8336b9de00b22ba8 P 10c596e3a5ba4fe39a038d22df98111a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1e60ec8293de4a4da360818ddf52171e (127.30.214.131:35081): Not found: Tablet not found: 08c4f30e6915473e8336b9de00b22ba8
I20260808 14:47:44.455396 21687 leader_election.cc:302] T 08c4f30e6915473e8336b9de00b22ba8 P 10c596e3a5ba4fe39a038d22df98111a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c596e3a5ba4fe39a038d22df98111a; no voters: 1e60ec8293de4a4da360818ddf52171e, d8babb5bfd404a14af9ba9ed23500a59
I20260808 14:47:44.455482 22284 raft_consensus.cc:2726] T 08c4f30e6915473e8336b9de00b22ba8 P 10c596e3a5ba4fe39a038d22df98111a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 14:47:44.565377 22285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:44.565137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:38717 (local address 127.30.214.131:44957)
0808 14:47:44.565283 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:44.565329 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:38717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":84,"threads_started":1}
I20260808 14:47:45.369851 22287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:45.369584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:38717 (local address 127.30.214.129:34173)
0808 14:47:45.369750 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:45.369800 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:38717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":73,"threads_started":1}
I20260808 14:47:45.440236 22288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:45.439906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:38717 (local address 127.30.214.130:48627)
0808 14:47:45.440142 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:45.440190 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:38717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":86,"threads_started":1}
I20260808 14:47:45.566123 22289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:45.565880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:38717 (local address 127.30.214.131:60983)
0808 14:47:45.566030 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:45.566075 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:38717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":69,"threads_started":1}
I20260808 14:47:46.370757 22290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:46.370503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:38717 (local address 127.30.214.129:54735)
0808 14:47:46.370657 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:46.370707 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:38717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":76,"threads_started":1}
I20260808 14:47:46.441118 22291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:46.440804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:38717 (local address 127.30.214.130:60871)
0808 14:47:46.441017 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:46.441068 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:38717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":81,"threads_started":1}
I20260808 14:47:46.566856 22292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:46.566644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:38717 (local address 127.30.214.131:53193)
0808 14:47:46.566766 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:46.566813 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:38717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":62,"threads_started":1}
I20260808 14:47:47.371600 22293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:47.371327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:38717 (local address 127.30.214.129:56239)
0808 14:47:47.371498 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:47.371536 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:38717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":86,"threads_started":1}
I20260808 14:47:47.441952 22295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:47.441705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:38717 (local address 127.30.214.130:51727)
0808 14:47:47.441864 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:47.441903 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:38717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":76,"threads_started":1}
I20260808 14:47:47.567586 22296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:47.567345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:38717 (local address 127.30.214.131:50845)
0808 14:47:47.567487 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:47.567537 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:38717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":81,"threads_started":1}
I20260808 14:47:48.372467 22297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:48.372206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:38717 (local address 127.30.214.129:41753)
0808 14:47:48.372364 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:48.372414 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:38717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":76,"threads_started":1}
I20260808 14:47:48.442801 22298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:48.442549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:38717 (local address 127.30.214.130:47029)
0808 14:47:48.442711 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:48.442751 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:38717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":88,"threads_started":1}
I20260808 14:47:48.568305 22299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:48.568072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:38717 (local address 127.30.214.131:58369)
0808 14:47:48.568211 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:48.568258 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:38717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":66,"threads_started":1}
I20260808 14:47:48.909920 22300 raft_consensus.cc:482] T 08c4f30e6915473e8336b9de00b22ba8 P 10c596e3a5ba4fe39a038d22df98111a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:47:48.910029 22300 raft_consensus.cc:504] T 08c4f30e6915473e8336b9de00b22ba8 P 10c596e3a5ba4fe39a038d22df98111a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e60ec8293de4a4da360818ddf52171e" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 35081 } } peers { permanent_uuid: "d8babb5bfd404a14af9ba9ed23500a59" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35839 } } peers { permanent_uuid: "10c596e3a5ba4fe39a038d22df98111a" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 42291 } }
I20260808 14:47:48.910229 22300 leader_election.cc:288] T 08c4f30e6915473e8336b9de00b22ba8 P 10c596e3a5ba4fe39a038d22df98111a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e60ec8293de4a4da360818ddf52171e (127.30.214.131:35081), d8babb5bfd404a14af9ba9ed23500a59 (127.30.214.130:35839)
W20260808 14:47:48.910604 21686 leader_election.cc:341] T 08c4f30e6915473e8336b9de00b22ba8 P 10c596e3a5ba4fe39a038d22df98111a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d8babb5bfd404a14af9ba9ed23500a59 (127.30.214.130:35839): Not found: Tablet not found: 08c4f30e6915473e8336b9de00b22ba8
W20260808 14:47:48.910691 21687 leader_election.cc:341] T 08c4f30e6915473e8336b9de00b22ba8 P 10c596e3a5ba4fe39a038d22df98111a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1e60ec8293de4a4da360818ddf52171e (127.30.214.131:35081): Not found: Tablet not found: 08c4f30e6915473e8336b9de00b22ba8
I20260808 14:47:48.910750 21687 leader_election.cc:302] T 08c4f30e6915473e8336b9de00b22ba8 P 10c596e3a5ba4fe39a038d22df98111a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10c596e3a5ba4fe39a038d22df98111a; no voters: 1e60ec8293de4a4da360818ddf52171e, d8babb5bfd404a14af9ba9ed23500a59
I20260808 14:47:48.910808 22300 raft_consensus.cc:2726] T 08c4f30e6915473e8336b9de00b22ba8 P 10c596e3a5ba4fe39a038d22df98111a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 14:47:49.373157 22301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:49.372928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:38717 (local address 127.30.214.129:54687)
0808 14:47:49.373074 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:49.373108 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:38717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":86,"threads_started":1}
I20260808 14:47:49.443536 22302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:49.443246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:38717 (local address 127.30.214.130:60979)
0808 14:47:49.443412 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:49.443486 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:38717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":68,"threads_started":1}
I20260808 14:47:49.568998 22303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:49.568776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:38717 (local address 127.30.214.131:42267)
0808 14:47:49.568902 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:49.568947 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:38717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":69,"threads_started":1}
I20260808 14:47:50.373920 22305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:50.373682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:38717 (local address 127.30.214.129:55533)
0808 14:47:50.373813 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:50.373860 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:38717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":76,"threads_started":1}
I20260808 14:47:50.444263 22307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:50.444045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:38717 (local address 127.30.214.130:37927)
0808 14:47:50.444178 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:50.444215 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:38717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":66,"threads_started":1}
I20260808 14:47:50.569840 22308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:50.569603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:38717 (local address 127.30.214.131:43651)
0808 14:47:50.569740 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:50.569789 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:38717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":66,"threads_started":1}
I20260808 14:47:51.374536 22309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:51.374289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:38717 (local address 127.30.214.129:35993)
0808 14:47:51.374443 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:51.374485 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:38717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":65,"threads_started":1}
I20260808 14:47:51.445056 22310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:51.444798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:38717 (local address 127.30.214.130:45551)
0808 14:47:51.444947 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:51.444995 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:38717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":65,"threads_started":1}
I20260808 14:47:51.570593 22314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:51.570343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:38717 (local address 127.30.214.131:40571)
0808 14:47:51.570498 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:51.570545 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:38717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":67,"threads_started":1}
I20260808 14:47:52.375253 22316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:52.374986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:38717 (local address 127.30.214.129:37579)
0808 14:47:52.375160 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:52.375203 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:38717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":89,"threads_started":1}
I20260808 14:47:52.445837 22317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:52.445605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:38717 (local address 127.30.214.130:58443)
0808 14:47:52.445734 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:52.445786 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:38717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":64,"threads_started":1}
I20260808 14:47:52.571291 22318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:52.571046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:38717 (local address 127.30.214.131:41877)
0808 14:47:52.571196 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:52.571243 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:38717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":91,"threads_started":1}
I20260808 14:47:53.375962 22319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:53.375749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:38717 (local address 127.30.214.129:34481)
0808 14:47:53.375882 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:53.375914 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:38717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":80,"threads_started":1}
I20260808 14:47:53.446508 22321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:53.446298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:38717 (local address 127.30.214.130:57097)
0808 14:47:53.446424 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:53.446458 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:38717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":63,"threads_started":1}
I20260808 14:47:53.571723 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 21622
I20260808 14:47:53.575495 22324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:53.571832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:38717 (local address 127.30.214.131:50509)
0808 14:47:53.575364 (+ 3532us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:53.575438 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:38717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":3510,"thread_start_us":60,"threads_started":1}
I20260808 14:47:53.582440 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 21877
I20260808 14:47:53.589663 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 22065
2026-08-08T14:47:53Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (18353 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:47:53 dist-test-slave-42z9 krb5kdc[22329](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:47:53 dist-test-slave-42z9 krb5kdc[22329](info): set up 2 sockets
Aug 08 14:47:53 dist-test-slave-42z9 krb5kdc[22329](info): commencing operation
krb5kdc: starting...
W20260808 14:47:54.727370 31578 mini_kdc.cc:121] Time spent starting KDC: real 1.111s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Aug 08 14:47:54 dist-test-slave-42z9 krb5kdc[22329](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200474, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:47:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:47:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.214.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab.
Entry for principal kudu/127.30.214.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab.
I20260808 14:47:54.860682 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:40141
--webserver_interface=127.30.214.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab
--principal=kudu/127.30.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:43459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.214.190:40141
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:47:54.946269 22344 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:47:54.946506 22344 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:47:54.946539 22344 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:47:54.947768 22344 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 14:47:54.947824 22344 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 14:47:54.947847 22344 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 14:47:54.947862 22344 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:47:54.947880 22344 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:47:54.947897 22344 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:47:54.947921 22344 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:47:54.947940 22344 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:47:54.949599 22344 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:43459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.30.214.190:40141
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab
--principal=kudu/127.30.214.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:40141
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22344
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:47:54.949887 22344 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:47:54.950121 22344 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:47:54.955302 22350 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:47:54.955302 22351 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:47:54.955302 22354 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:47:54.955320 22344 server_base.cc:1034] running on GCE node
I20260808 14:47:54.955718 22344 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:47:54.955998 22344 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:47:54.957140 22344 hybrid_clock.cc:648] HybridClock initialized: now 1786200474957127 us; error 33 us; skew 500 ppm
Aug 08 14:47:54 dist-test-slave-42z9 krb5kdc[22329](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200474, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:47:54.959726 22344 init.cc:377] Logged in from keytab as kudu/127.30.214.190@KRBTEST.COM (short username kudu)
I20260808 14:47:54.960233 22344 webserver.cc:460] Webserver started at http://127.30.214.190:35789/ using document root <none> and password file <none>
I20260808 14:47:54.960455 22344 fs_manager.cc:359] Metadata directory not provided
I20260808 14:47:54.960507 22344 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:47:54.960644 22344 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:47:54.961800 22344 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/master-0/data/instance:
uuid: "f7d2284723d74dd7b9e1b0f3e3b1cc1c"
format_stamp: "Formatted at 2026-08-08 14:47:54 on dist-test-slave-42z9"
server_key: "0cd964ee2b125eab145ef233ec332fc5"
server_key_iv: "711aaed7aa510dc685ff21cd67bb81c3"
server_key_version: "encryptionkey@0"
I20260808 14:47:54.962152 22344 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/master-0/wal/instance:
uuid: "f7d2284723d74dd7b9e1b0f3e3b1cc1c"
format_stamp: "Formatted at 2026-08-08 14:47:54 on dist-test-slave-42z9"
server_key: "0cd964ee2b125eab145ef233ec332fc5"
server_key_iv: "711aaed7aa510dc685ff21cd67bb81c3"
server_key_version: "encryptionkey@0"
I20260808 14:47:54.963469 22344 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:47:54.964226 22362 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:47:54.964406 22344 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:47:54.964494 22344 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/master-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/master-0/wal
uuid: "f7d2284723d74dd7b9e1b0f3e3b1cc1c"
format_stamp: "Formatted at 2026-08-08 14:47:54 on dist-test-slave-42z9"
server_key: "0cd964ee2b125eab145ef233ec332fc5"
server_key_iv: "711aaed7aa510dc685ff21cd67bb81c3"
server_key_version: "encryptionkey@0"
I20260808 14:47:54.964563 22344 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:47:54.973742 22344 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:47:54.975622 22344 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:47:54.975773 22344 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:47:54.979930 22344 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.190:40141
I20260808 14:47:54.979976 22445 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.190:40141 every 8 connection(s)
I20260808 14:47:54.980331 22344 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
I20260808 14:47:54.981261 22447 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:47:54.983654 22447 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f7d2284723d74dd7b9e1b0f3e3b1cc1c: Bootstrap starting.
I20260808 14:47:54.984252 22447 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f7d2284723d74dd7b9e1b0f3e3b1cc1c: Neither blocks nor log segments found. Creating new log.
I20260808 14:47:54.984505 22447 log.cc:824] T 00000000000000000000000000000000 P f7d2284723d74dd7b9e1b0f3e3b1cc1c: Log is configured to *not* fsync() on all Append() calls
I20260808 14:47:54.985178 22447 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f7d2284723d74dd7b9e1b0f3e3b1cc1c: No bootstrap required, opened a new log
I20260808 14:47:54.986884 22447 raft_consensus.cc:348] T 00000000000000000000000000000000 P f7d2284723d74dd7b9e1b0f3e3b1cc1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7d2284723d74dd7b9e1b0f3e3b1cc1c" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 40141 } }
I20260808 14:47:54.987082 22447 raft_consensus.cc:374] T 00000000000000000000000000000000 P f7d2284723d74dd7b9e1b0f3e3b1cc1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:47:54.987118 22447 raft_consensus.cc:729] T 00000000000000000000000000000000 P f7d2284723d74dd7b9e1b0f3e3b1cc1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7d2284723d74dd7b9e1b0f3e3b1cc1c, State: Initialized, Role: FOLLOWER
I20260808 14:47:54.987279 22447 consensus_queue.cc:260] T 00000000000000000000000000000000 P f7d2284723d74dd7b9e1b0f3e3b1cc1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7d2284723d74dd7b9e1b0f3e3b1cc1c" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 40141 } }
I20260808 14:47:54.987361 22447 raft_consensus.cc:388] T 00000000000000000000000000000000 P f7d2284723d74dd7b9e1b0f3e3b1cc1c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:47:54.987396 22447 raft_consensus.cc:482] T 00000000000000000000000000000000 P f7d2284723d74dd7b9e1b0f3e3b1cc1c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:47:54.987444 22447 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f7d2284723d74dd7b9e1b0f3e3b1cc1c [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:47:54.988137 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 22344
I20260808 14:47:54.988206 22447 raft_consensus.cc:504] T 00000000000000000000000000000000 P f7d2284723d74dd7b9e1b0f3e3b1cc1c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7d2284723d74dd7b9e1b0f3e3b1cc1c" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 40141 } }
I20260808 14:47:54.988250 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/master-0/wal/instance
I20260808 14:47:54.988322 22447 leader_election.cc:302] T 00000000000000000000000000000000 P f7d2284723d74dd7b9e1b0f3e3b1cc1c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f7d2284723d74dd7b9e1b0f3e3b1cc1c; no voters:
I20260808 14:47:54.988437 31578 external_mini_cluster.cc:1428] Setting key 26f34ec4013874813e74d819c61905ef
I20260808 14:47:54.988536 22447 leader_election.cc:288] T 00000000000000000000000000000000 P f7d2284723d74dd7b9e1b0f3e3b1cc1c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:47:54.988725 22453 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f7d2284723d74dd7b9e1b0f3e3b1cc1c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:47:54.988822 22447 sys_catalog.cc:564] T 00000000000000000000000000000000 P f7d2284723d74dd7b9e1b0f3e3b1cc1c [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:47:54.988989 22453 raft_consensus.cc:686] T 00000000000000000000000000000000 P f7d2284723d74dd7b9e1b0f3e3b1cc1c [term 1 LEADER]: Becoming Leader. State: Replica: f7d2284723d74dd7b9e1b0f3e3b1cc1c, State: Running, Role: LEADER
I20260808 14:47:54.989169 22453 consensus_queue.cc:237] T 00000000000000000000000000000000 P f7d2284723d74dd7b9e1b0f3e3b1cc1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7d2284723d74dd7b9e1b0f3e3b1cc1c" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 40141 } }
I20260808 14:47:54.989612 22453 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7d2284723d74dd7b9e1b0f3e3b1cc1c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f7d2284723d74dd7b9e1b0f3e3b1cc1c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7d2284723d74dd7b9e1b0f3e3b1cc1c" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 40141 } } }
I20260808 14:47:54.989701 22453 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7d2284723d74dd7b9e1b0f3e3b1cc1c [sys.catalog]: This master's current role is: LEADER
I20260808 14:47:54.989861 22453 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7d2284723d74dd7b9e1b0f3e3b1cc1c [sys.catalog]: SysCatalogTable state changed. Reason: New leader f7d2284723d74dd7b9e1b0f3e3b1cc1c. Latest consensus state: current_term: 1 leader_uuid: "f7d2284723d74dd7b9e1b0f3e3b1cc1c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7d2284723d74dd7b9e1b0f3e3b1cc1c" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 40141 } } }
I20260808 14:47:54.989919 22453 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7d2284723d74dd7b9e1b0f3e3b1cc1c [sys.catalog]: This master's current role is: LEADER
I20260808 14:47:54.990025 22468 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:47:54.990654 22468 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:47:54.993130 22468 catalog_manager.cc:1347] Generated new cluster ID: 7cefac0c3be14a7ea82f936dc8062033
I20260808 14:47:54.993197 22468 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 14:47:54 dist-test-slave-42z9 krb5kdc[22329](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200474, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:47:54.999526 22458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:54.989156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48466 (local address 127.30.214.190:40141)
0808 14:47:54.990056 (+ 900us) server_negotiation.cc:206] Beginning negotiation
0808 14:47:54.990066 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:47:54.990105 (+ 39us) server_negotiation.cc:407] Connection header received
0808 14:47:54.990240 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:47:54.990247 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:47:54.990324 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:47:54.990557 (+ 233us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:47:54.991394 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:54.992500 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:54.993391 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:54.993869 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:54.993969 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:54.996254 (+ 2285us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:47:54.996259 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:47:54.996259 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:47:54.996274 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:47:54.998001 (+ 1727us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:54.998336 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:54.998339 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:54.998340 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:54.998437 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:54.998619 (+ 182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:54.998620 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:54.998621 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:54.998877 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:47:54.999011 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0808 14:47:54.999140 (+ 129us) server_negotiation.cc:299] Negotiation successful
0808 14:47:54.999293 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":833,"thread_start_us":69,"threads_started":1}
I20260808 14:47:55.022212 22468 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:47:55.022802 22468 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:47:55.027233 22468 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f7d2284723d74dd7b9e1b0f3e3b1cc1c: Generated new TSK 0
I20260808 14:47:55.027441 22468 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.214.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab.
Entry for principal kudu/127.30.214.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab.
I20260808 14:47:55.068578 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.129:0
--local_ip_for_outbound_sockets=127.30.214.129
--webserver_interface=127.30.214.129
--webserver_port=0
--tserver_master_addrs=127.30.214.190:40141
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab
--principal=kudu/127.30.214.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:43459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:47:55.155412 22483 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:47:55.155719 22483 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:47:55.155758 22483 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:47:55.157568 22483 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:47:55.157634 22483 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:47:55.157673 22483 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.129
I20260808 14:47:55.159942 22483 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:43459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab
--principal=kudu/127.30.214.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.214.129
--webserver_port=0
--tserver_master_addrs=127.30.214.190:40141
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22483
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.129
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:47:55.160238 22483 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:47:55.160494 22483 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:47:55.166492 22490 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:47:55.166514 22494 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:47:55.167088 22489 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:47:55.167039 22483 server_base.cc:1034] running on GCE node
I20260808 14:47:55.167294 22483 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:47:55.167560 22483 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:47:55.168879 22483 hybrid_clock.cc:648] HybridClock initialized: now 1786200475168847 us; error 33 us; skew 500 ppm
Aug 08 14:47:55 dist-test-slave-42z9 krb5kdc[22329](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200475, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:47:55.172106 22483 init.cc:377] Logged in from keytab as kudu/127.30.214.129@KRBTEST.COM (short username kudu)
I20260808 14:47:55.172731 22483 webserver.cc:460] Webserver started at http://127.30.214.129:43837/ using document root <none> and password file <none>
I20260808 14:47:55.172996 22483 fs_manager.cc:359] Metadata directory not provided
I20260808 14:47:55.173049 22483 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:47:55.173198 22483 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:47:55.174693 22483 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-0/data/instance:
uuid: "24be9ebf5aff4ed787fbfd57e4f7e633"
format_stamp: "Formatted at 2026-08-08 14:47:55 on dist-test-slave-42z9"
server_key: "c146464be7c83212c32cf0432cb63730"
server_key_iv: "703135265e862d7466370aa95f9b64df"
server_key_version: "encryptionkey@0"
I20260808 14:47:55.175096 22483 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-0/wal/instance:
uuid: "24be9ebf5aff4ed787fbfd57e4f7e633"
format_stamp: "Formatted at 2026-08-08 14:47:55 on dist-test-slave-42z9"
server_key: "c146464be7c83212c32cf0432cb63730"
server_key_iv: "703135265e862d7466370aa95f9b64df"
server_key_version: "encryptionkey@0"
I20260808 14:47:55.176817 22483 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260808 14:47:55.177870 22504 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:47:55.178130 22483 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:47:55.178238 22483 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-0/wal
uuid: "24be9ebf5aff4ed787fbfd57e4f7e633"
format_stamp: "Formatted at 2026-08-08 14:47:55 on dist-test-slave-42z9"
server_key: "c146464be7c83212c32cf0432cb63730"
server_key_iv: "703135265e862d7466370aa95f9b64df"
server_key_version: "encryptionkey@0"
I20260808 14:47:55.178324 22483 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:47:55.187134 22483 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:47:55.189165 22483 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:47:55.189358 22483 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:47:55.189632 22483 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:47:55.189963 22483 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:47:55.190007 22483 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:47:55.190038 22483 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:47:55.190062 22483 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:47:55.195706 22483 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.129:38613
I20260808 14:47:55.195777 22675 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.129:38613 every 8 connection(s)
I20260808 14:47:55.196084 22483 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
Aug 08 14:47:55 dist-test-slave-42z9 krb5kdc[22329](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200475, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.129@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:47:55.204753 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 22483
I20260808 14:47:55.204874 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-0/wal/instance
I20260808 14:47:55.205111 31578 external_mini_cluster.cc:1428] Setting key eb6c6c61cde21838e906da69069c1d1a
I20260808 14:47:55.207540 22458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:55.196888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.129:57081 (local address 127.30.214.190:40141)
0808 14:47:55.196995 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0808 14:47:55.196998 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:47:55.197314 (+ 316us) server_negotiation.cc:407] Connection header received
0808 14:47:55.197945 (+ 631us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:47:55.197947 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:47:55.198030 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:47:55.198115 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:47:55.199137 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:55.199667 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:55.200713 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:55.200936 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:55.200997 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:55.204170 (+ 3173us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:47:55.204171 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:47:55.204172 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:47:55.204180 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:47:55.205939 (+ 1759us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:55.206555 (+ 616us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:55.206556 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:55.206557 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:55.206631 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:55.206908 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:55.206909 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:55.206909 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:55.207017 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:47:55.207066 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 14:47:55.207379 (+ 313us) server_negotiation.cc:299] Negotiation successful
0808 14:47:55.207472 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 14:47:55.207803 22680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:55.196763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:40141 (local address 127.30.214.129:57081)
0808 14:47:55.197048 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:55.197121 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0808 14:47:55.197826 (+ 705us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:47:55.198185 (+ 359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:47:55.198188 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:47:55.198798 (+ 610us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:47:55.199012 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:55.199016 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:55.199744 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:55.199744 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:55.200569 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:55.200572 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:55.201106 (+ 534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:55.201108 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:55.201313 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:55.202062 (+ 749us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:47:55.202074 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:47:55.204051 (+ 1977us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:47:55.206068 (+ 2017us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:47:55.206081 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:47:55.206084 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:47:55.206449 (+ 365us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:47:55.206700 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:47:55.206700 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:47:55.206701 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:47:55.206850 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:47:55.207069 (+ 219us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:47:55.207075 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:47:55.207249 (+ 174us) client_negotiation.cc:769] Sending connection context
0808 14:47:55.207364 (+ 115us) client_negotiation.cc:240] Negotiation successful
0808 14:47:55.207565 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":80,"threads_started":1}
I20260808 14:47:55.208788 22677 heartbeater.cc:347] Connected to a master server at 127.30.214.190:40141
I20260808 14:47:55.208879 22677 heartbeater.cc:464] Registering TS with master...
I20260808 14:47:55.209066 22677 heartbeater.cc:511] Master 127.30.214.190:40141 requested a full tablet report, sending...
I20260808 14:47:55.209626 22384 ts_manager.cc:194] Registered new tserver with Master: 24be9ebf5aff4ed787fbfd57e4f7e633 (127.30.214.129:38613)
I20260808 14:47:55.210261 22384 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.214.129@KRBTEST.COM'} at 127.30.214.129:57081
WARNING: no policy specified for kudu/127.30.214.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab.
Entry for principal kudu/127.30.214.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab.
I20260808 14:47:55.235939 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.130:0
--local_ip_for_outbound_sockets=127.30.214.130
--webserver_interface=127.30.214.130
--webserver_port=0
--tserver_master_addrs=127.30.214.190:40141
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab
--principal=kudu/127.30.214.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:43459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:47:55.320205 22683 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:47:55.320434 22683 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:47:55.320459 22683 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:47:55.321699 22683 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:47:55.321745 22683 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:47:55.321772 22683 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.130
I20260808 14:47:55.323313 22683 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:43459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab
--principal=kudu/127.30.214.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.214.130
--webserver_port=0
--tserver_master_addrs=127.30.214.190:40141
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22683
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.130
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:47:55.323565 22683 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:47:55.323797 22683 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:47:55.329952 22690 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:47:55.329913 22695 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:47:55.330003 22683 server_base.cc:1034] running on GCE node
W20260808 14:47:55.329908 22689 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:47:55.330358 22683 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:47:55.330639 22683 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:47:55.331785 22683 hybrid_clock.cc:648] HybridClock initialized: now 1786200475331766 us; error 41 us; skew 500 ppm
Aug 08 14:47:55 dist-test-slave-42z9 krb5kdc[22329](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200475, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:47:55.334563 22683 init.cc:377] Logged in from keytab as kudu/127.30.214.130@KRBTEST.COM (short username kudu)
I20260808 14:47:55.335057 22683 webserver.cc:460] Webserver started at http://127.30.214.130:40757/ using document root <none> and password file <none>
I20260808 14:47:55.335299 22683 fs_manager.cc:359] Metadata directory not provided
I20260808 14:47:55.335345 22683 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:47:55.335477 22683 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:47:55.336558 22683 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-1/data/instance:
uuid: "78f732c786474630ad34b76d0a05800b"
format_stamp: "Formatted at 2026-08-08 14:47:55 on dist-test-slave-42z9"
server_key: "4ebe4bc2375ed3478a0e4f86dd51ba99"
server_key_iv: "eea12add0d25be48f5750b1356039067"
server_key_version: "encryptionkey@0"
I20260808 14:47:55.336902 22683 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-1/wal/instance:
uuid: "78f732c786474630ad34b76d0a05800b"
format_stamp: "Formatted at 2026-08-08 14:47:55 on dist-test-slave-42z9"
server_key: "4ebe4bc2375ed3478a0e4f86dd51ba99"
server_key_iv: "eea12add0d25be48f5750b1356039067"
server_key_version: "encryptionkey@0"
I20260808 14:47:55.338330 22683 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 14:47:55.339063 22705 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:47:55.339252 22683 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:47:55.339339 22683 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-1/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-1/wal
uuid: "78f732c786474630ad34b76d0a05800b"
format_stamp: "Formatted at 2026-08-08 14:47:55 on dist-test-slave-42z9"
server_key: "4ebe4bc2375ed3478a0e4f86dd51ba99"
server_key_iv: "eea12add0d25be48f5750b1356039067"
server_key_version: "encryptionkey@0"
I20260808 14:47:55.339417 22683 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:47:55.353212 22683 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:47:55.355453 22683 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:47:55.355584 22683 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:47:55.355810 22683 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:47:55.356101 22683 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:47:55.356132 22683 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:47:55.356154 22683 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:47:55.356171 22683 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:47:55.362205 22683 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.130:42365
I20260808 14:47:55.362287 22865 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.130:42365 every 8 connection(s)
I20260808 14:47:55.362597 22683 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
Aug 08 14:47:55 dist-test-slave-42z9 krb5kdc[22329](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200475, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.130@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:47:55.372380 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 22683
I20260808 14:47:55.372483 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-1/wal/instance
I20260808 14:47:55.372695 31578 external_mini_cluster.cc:1428] Setting key 649461e81d74f96da02465acf77b90b3
I20260808 14:47:55.372843 22458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:55.363329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.130:37495 (local address 127.30.214.190:40141)
0808 14:47:55.363385 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 14:47:55.363386 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:47:55.363595 (+ 209us) server_negotiation.cc:407] Connection header received
0808 14:47:55.364087 (+ 492us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:47:55.364088 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:47:55.364098 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:47:55.364162 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:47:55.365156 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:55.365732 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:55.366842 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:55.367041 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:55.367091 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:55.369845 (+ 2754us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:47:55.369848 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:47:55.369848 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:47:55.369858 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:47:55.371229 (+ 1371us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:55.371744 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:55.371745 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:55.371745 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:55.371806 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:55.372052 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:55.372053 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:55.372054 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:55.372195 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:47:55.372253 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 14:47:55.372638 (+ 385us) server_negotiation.cc:299] Negotiation successful
0808 14:47:55.372753 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 14:47:55.372936 22868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:55.363290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:40141 (local address 127.30.214.130:37495)
0808 14:47:55.363462 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:55.363514 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 14:47:55.364003 (+ 489us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:47:55.364240 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:47:55.364244 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:47:55.364858 (+ 614us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:47:55.365075 (+ 217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:55.365081 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:55.365801 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:55.365801 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:55.366756 (+ 955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:55.366759 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:55.367104 (+ 345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:55.367104 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:55.367229 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:55.367714 (+ 485us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:47:55.367723 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:47:55.369673 (+ 1950us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:47:55.371364 (+ 1691us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:47:55.371379 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:47:55.371381 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:47:55.371659 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:47:55.371869 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:47:55.371870 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:47:55.371870 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:47:55.371990 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:47:55.372257 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:47:55.372265 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:47:55.372413 (+ 148us) client_negotiation.cc:769] Sending connection context
0808 14:47:55.372527 (+ 114us) client_negotiation.cc:240] Negotiation successful
0808 14:47:55.372688 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":86,"threads_started":1}
I20260808 14:47:55.373487 22866 heartbeater.cc:347] Connected to a master server at 127.30.214.190:40141
I20260808 14:47:55.373585 22866 heartbeater.cc:464] Registering TS with master...
I20260808 14:47:55.373775 22866 heartbeater.cc:511] Master 127.30.214.190:40141 requested a full tablet report, sending...
I20260808 14:47:55.374199 22381 ts_manager.cc:194] Registered new tserver with Master: 78f732c786474630ad34b76d0a05800b (127.30.214.130:42365)
I20260808 14:47:55.374660 22381 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.214.130@KRBTEST.COM'} at 127.30.214.130:37495
WARNING: no policy specified for kudu/127.30.214.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab.
Entry for principal kudu/127.30.214.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab.
I20260808 14:47:55.403944 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.131:0
--local_ip_for_outbound_sockets=127.30.214.131
--webserver_interface=127.30.214.131
--webserver_port=0
--tserver_master_addrs=127.30.214.190:40141
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab
--principal=kudu/127.30.214.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:43459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:47:55.492995 22873 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:47:55.493217 22873 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:47:55.493243 22873 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:47:55.494485 22873 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:47:55.494536 22873 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:47:55.494565 22873 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.131
I20260808 14:47:55.496028 22873 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:43459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab
--principal=kudu/127.30.214.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.214.131
--webserver_port=0
--tserver_master_addrs=127.30.214.190:40141
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22873
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.131
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:47:55.496233 22873 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:47:55.496438 22873 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 14:47:55.501647 22873 server_base.cc:1034] running on GCE node
W20260808 14:47:55.501776 22883 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:47:55.501765 22881 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:47:55.501710 22879 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:47:55.502235 22873 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:47:55.502518 22873 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:47:55.503669 22873 hybrid_clock.cc:648] HybridClock initialized: now 1786200475503633 us; error 66 us; skew 500 ppm
Aug 08 14:47:55 dist-test-slave-42z9 krb5kdc[22329](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200475, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:47:55.506170 22873 init.cc:377] Logged in from keytab as kudu/127.30.214.131@KRBTEST.COM (short username kudu)
I20260808 14:47:55.506646 22873 webserver.cc:460] Webserver started at http://127.30.214.131:40853/ using document root <none> and password file <none>
I20260808 14:47:55.506855 22873 fs_manager.cc:359] Metadata directory not provided
I20260808 14:47:55.506902 22873 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:47:55.507032 22873 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:47:55.508087 22873 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-2/data/instance:
uuid: "091ccdf967d949c9a2b8b03fcd48258c"
format_stamp: "Formatted at 2026-08-08 14:47:55 on dist-test-slave-42z9"
server_key: "d630a513b439c1cd553942d9a74db351"
server_key_iv: "6fbc3bf5f1c25a791fc832b6b69bfa49"
server_key_version: "encryptionkey@0"
I20260808 14:47:55.508433 22873 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-2/wal/instance:
uuid: "091ccdf967d949c9a2b8b03fcd48258c"
format_stamp: "Formatted at 2026-08-08 14:47:55 on dist-test-slave-42z9"
server_key: "d630a513b439c1cd553942d9a74db351"
server_key_iv: "6fbc3bf5f1c25a791fc832b6b69bfa49"
server_key_version: "encryptionkey@0"
I20260808 14:47:55.509840 22873 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 14:47:55.510733 22893 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:47:55.510952 22873 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:47:55.511055 22873 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-2/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-2/wal
uuid: "091ccdf967d949c9a2b8b03fcd48258c"
format_stamp: "Formatted at 2026-08-08 14:47:55 on dist-test-slave-42z9"
server_key: "d630a513b439c1cd553942d9a74db351"
server_key_iv: "6fbc3bf5f1c25a791fc832b6b69bfa49"
server_key_version: "encryptionkey@0"
I20260808 14:47:55.511123 22873 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:47:55.530846 22873 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:47:55.532910 22873 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:47:55.533059 22873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:47:55.533303 22873 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:47:55.533648 22873 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:47:55.533684 22873 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:47:55.533713 22873 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:47:55.533742 22873 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:47:55.539695 22873 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.131:40261
I20260808 14:47:55.539750 23061 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.131:40261 every 8 connection(s)
I20260808 14:47:55.540071 22873 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
I20260808 14:47:55.541610 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 22873
I20260808 14:47:55.541728 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-2/wal/instance
I20260808 14:47:55.541960 31578 external_mini_cluster.cc:1428] Setting key fc1a8f399e13ebe77f1368f38d67997b
Aug 08 14:47:55 dist-test-slave-42z9 krb5kdc[22329](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200475, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.131@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:47:55.549861 22458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:55.540774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:40815 (local address 127.30.214.190:40141)
0808 14:47:55.540940 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0808 14:47:55.540943 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:47:55.541192 (+ 249us) server_negotiation.cc:407] Connection header received
0808 14:47:55.541760 (+ 568us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:47:55.541763 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:47:55.541785 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:47:55.541890 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:47:55.543093 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:55.543757 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:55.544773 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:55.544985 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:55.545049 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:55.547363 (+ 2314us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:47:55.547365 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:47:55.547366 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:47:55.547375 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:47:55.548492 (+ 1117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:55.548885 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:55.548886 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:55.548887 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:55.548962 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:55.549210 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:55.549212 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:55.549212 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:55.549358 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:47:55.549422 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 14:47:55.549710 (+ 288us) server_negotiation.cc:299] Negotiation successful
0808 14:47:55.549790 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
I20260808 14:47:55.550014 23067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:55.540736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:40141 (local address 127.30.214.131:40815)
0808 14:47:55.541036 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:55.541088 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 14:47:55.541631 (+ 543us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:47:55.541976 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:47:55.541980 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:47:55.542784 (+ 804us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:47:55.543000 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:55.543006 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:55.543841 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:55.543841 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:55.544676 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:55.544678 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:55.545069 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:55.545069 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:55.545172 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:55.545743 (+ 571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:47:55.545753 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:47:55.547246 (+ 1493us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:47:55.548567 (+ 1321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:47:55.548573 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:47:55.548576 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:47:55.548796 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:47:55.549022 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:47:55.549023 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:47:55.549023 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:47:55.549124 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:47:55.549417 (+ 293us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:47:55.549420 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:47:55.549593 (+ 173us) client_negotiation.cc:769] Sending connection context
0808 14:47:55.549680 (+ 87us) client_negotiation.cc:240] Negotiation successful
0808 14:47:55.549809 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":225,"threads_started":1}
I20260808 14:47:55.550516 23064 heartbeater.cc:347] Connected to a master server at 127.30.214.190:40141
I20260808 14:47:55.550604 23064 heartbeater.cc:464] Registering TS with master...
I20260808 14:47:55.550781 23064 heartbeater.cc:511] Master 127.30.214.190:40141 requested a full tablet report, sending...
I20260808 14:47:55.551137 22381 ts_manager.cc:194] Registered new tserver with Master: 091ccdf967d949c9a2b8b03fcd48258c (127.30.214.131:40261)
I20260808 14:47:55.551530 22381 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.214.131@KRBTEST.COM'} at 127.30.214.131:40815
I20260808 14:47:55.553960 31578 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:47:55.561479 22458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:55.555391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48474 (local address 127.30.214.190:40141)
0808 14:47:55.555441 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 14:47:55.555443 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:47:55.555600 (+ 157us) server_negotiation.cc:407] Connection header received
0808 14:47:55.555665 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:47:55.555666 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:47:55.555677 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:47:55.555721 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:47:55.556253 (+ 532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:55.556756 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:55.557493 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:55.557686 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:55.557743 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:55.558904 (+ 1161us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:47:55.558905 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:47:55.558905 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:47:55.558914 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:47:55.560332 (+ 1418us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:55.560658 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:55.560659 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:55.560660 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:55.560715 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:47:55.560873 (+ 158us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:47:55.560874 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:47:55.560874 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:47:55.561047 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:47:55.561140 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0808 14:47:55.561256 (+ 116us) server_negotiation.cc:299] Negotiation successful
0808 14:47:55.561346 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 14:47:55.563787 22381 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48474:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:47:55.565423 22381 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:47:55.572950 23084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:55.568435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.130:42365 (local address 127.0.0.1:59374)
0808 14:47:55.568746 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:55.568993 (+ 247us) client_negotiation.cc:174] Beginning negotiation
0808 14:47:55.569083 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:47:55.569386 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:47:55.569390 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:47:55.569393 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:47:55.569549 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:55.569552 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:55.570668 (+ 1116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:55.570669 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:55.571770 (+ 1101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:55.571773 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:55.572545 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:55.572545 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:55.572668 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:55.572687 (+ 19us) client_negotiation.cc:769] Sending connection context
0808 14:47:55.572778 (+ 91us) client_negotiation.cc:240] Negotiation successful
0808 14:47:55.572851 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":74,"threads_started":1}
I20260808 14:47:55.572983 23087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:55.568642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59374 (local address 127.30.214.130:42365)
0808 14:47:55.568927 (+ 285us) server_negotiation.cc:206] Beginning negotiation
0808 14:47:55.568933 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:47:55.569193 (+ 260us) server_negotiation.cc:407] Connection header received
0808 14:47:55.569247 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:47:55.569250 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:47:55.569269 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:47:55.569345 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:47:55.569667 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:55.570552 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:55.571871 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:55.572439 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:55.572534 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:55.572599 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 14:47:55.572810 (+ 211us) server_negotiation.cc:299] Negotiation successful
0808 14:47:55.572862 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":241,"thread_start_us":123,"threads_started":1}
I20260808 14:47:55.573545 23083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:55.568538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.131:40261 (local address 127.0.0.1:41856)
0808 14:47:55.568981 (+ 443us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:55.568993 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:47:55.569080 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:47:55.569805 (+ 725us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:47:55.569806 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:47:55.569810 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:47:55.569865 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:55.569868 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:55.571191 (+ 1323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:55.571192 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:55.572282 (+ 1090us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:55.572284 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:55.573267 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:55.573268 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:55.573330 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:55.573334 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:47:55.573379 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 14:47:55.573425 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":426,"thread_start_us":135,"threads_started":1}
I20260808 14:47:55.573863 23086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:55.568648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41856 (local address 127.30.214.131:40261)
0808 14:47:55.569466 (+ 818us) server_negotiation.cc:206] Beginning negotiation
0808 14:47:55.569472 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:47:55.569485 (+ 13us) server_negotiation.cc:407] Connection header received
0808 14:47:55.569532 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:47:55.569535 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:47:55.569554 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:47:55.569689 (+ 135us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:47:55.569979 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:55.571073 (+ 1094us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:55.572375 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:55.573090 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:55.573162 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:55.573230 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 14:47:55.573733 (+ 503us) server_negotiation.cc:299] Negotiation successful
0808 14:47:55.573785 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":745,"thread_start_us":118,"threads_started":1}
I20260808 14:47:55.574038 22777 tablet_service.cc:1467] Processing CreateTablet for tablet d35e3e3e04b54c70ac20e1040ac3cce8 (DEFAULT_TABLE table=test-table [id=5ee2f494797743ae9b90ab57194e78cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:47:55.574371 23088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:55.568805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.129:38613 (local address 127.0.0.1:37420)
0808 14:47:55.569206 (+ 401us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:55.569216 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:47:55.569281 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:47:55.569618 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:47:55.569619 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:47:55.569623 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:47:55.569709 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:55.569711 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:55.570996 (+ 1285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:55.570997 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:55.572242 (+ 1245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:55.572245 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:55.574082 (+ 1837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:55.574083 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:55.574171 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:55.574176 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 14:47:55.574242 (+ 66us) client_negotiation.cc:240] Negotiation successful
0808 14:47:55.574305 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":379,"thread_start_us":114,"threads_started":1}
I20260808 14:47:55.574456 22777 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d35e3e3e04b54c70ac20e1040ac3cce8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:47:55.574465 23090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:55.568919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37420 (local address 127.30.214.129:38613)
0808 14:47:55.569134 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0808 14:47:55.569139 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:47:55.569427 (+ 288us) server_negotiation.cc:407] Connection header received
0808 14:47:55.569501 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:47:55.569503 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:47:55.569518 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:47:55.569597 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:47:55.569774 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:55.570873 (+ 1099us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:55.572370 (+ 1497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:55.573570 (+ 1200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:55.573975 (+ 405us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:55.574048 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 14:47:55.574299 (+ 251us) server_negotiation.cc:299] Negotiation successful
0808 14:47:55.574382 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":183,"thread_start_us":111,"threads_started":1}
I20260808 14:47:55.575224 22584 tablet_service.cc:1467] Processing CreateTablet for tablet d35e3e3e04b54c70ac20e1040ac3cce8 (DEFAULT_TABLE table=test-table [id=5ee2f494797743ae9b90ab57194e78cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:47:55.575675 22584 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d35e3e3e04b54c70ac20e1040ac3cce8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:47:55.576277 22960 tablet_service.cc:1467] Processing CreateTablet for tablet d35e3e3e04b54c70ac20e1040ac3cce8 (DEFAULT_TABLE table=test-table [id=5ee2f494797743ae9b90ab57194e78cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:47:55.576663 22960 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d35e3e3e04b54c70ac20e1040ac3cce8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:47:55.577869 23092 tablet_bootstrap.cc:492] T d35e3e3e04b54c70ac20e1040ac3cce8 P 78f732c786474630ad34b76d0a05800b: Bootstrap starting.
I20260808 14:47:55.578788 23092 tablet_bootstrap.cc:654] T d35e3e3e04b54c70ac20e1040ac3cce8 P 78f732c786474630ad34b76d0a05800b: Neither blocks nor log segments found. Creating new log.
I20260808 14:47:55.579501 23092 log.cc:824] T d35e3e3e04b54c70ac20e1040ac3cce8 P 78f732c786474630ad34b76d0a05800b: Log is configured to *not* fsync() on all Append() calls
I20260808 14:47:55.579737 23093 tablet_bootstrap.cc:492] T d35e3e3e04b54c70ac20e1040ac3cce8 P 24be9ebf5aff4ed787fbfd57e4f7e633: Bootstrap starting.
I20260808 14:47:55.579952 23096 tablet_bootstrap.cc:492] T d35e3e3e04b54c70ac20e1040ac3cce8 P 091ccdf967d949c9a2b8b03fcd48258c: Bootstrap starting.
I20260808 14:47:55.580554 23092 tablet_bootstrap.cc:492] T d35e3e3e04b54c70ac20e1040ac3cce8 P 78f732c786474630ad34b76d0a05800b: No bootstrap required, opened a new log
I20260808 14:47:55.580648 23092 ts_tablet_manager.cc:1397] T d35e3e3e04b54c70ac20e1040ac3cce8 P 78f732c786474630ad34b76d0a05800b: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 14:47:55.580714 23096 tablet_bootstrap.cc:654] T d35e3e3e04b54c70ac20e1040ac3cce8 P 091ccdf967d949c9a2b8b03fcd48258c: Neither blocks nor log segments found. Creating new log.
I20260808 14:47:55.580744 23093 tablet_bootstrap.cc:654] T d35e3e3e04b54c70ac20e1040ac3cce8 P 24be9ebf5aff4ed787fbfd57e4f7e633: Neither blocks nor log segments found. Creating new log.
I20260808 14:47:55.581343 23096 log.cc:824] T d35e3e3e04b54c70ac20e1040ac3cce8 P 091ccdf967d949c9a2b8b03fcd48258c: Log is configured to *not* fsync() on all Append() calls
I20260808 14:47:55.581343 23093 log.cc:824] T d35e3e3e04b54c70ac20e1040ac3cce8 P 24be9ebf5aff4ed787fbfd57e4f7e633: Log is configured to *not* fsync() on all Append() calls
I20260808 14:47:55.582249 23093 tablet_bootstrap.cc:492] T d35e3e3e04b54c70ac20e1040ac3cce8 P 24be9ebf5aff4ed787fbfd57e4f7e633: No bootstrap required, opened a new log
I20260808 14:47:55.582345 23093 ts_tablet_manager.cc:1397] T d35e3e3e04b54c70ac20e1040ac3cce8 P 24be9ebf5aff4ed787fbfd57e4f7e633: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260808 14:47:55.582644 23096 tablet_bootstrap.cc:492] T d35e3e3e04b54c70ac20e1040ac3cce8 P 091ccdf967d949c9a2b8b03fcd48258c: No bootstrap required, opened a new log
I20260808 14:47:55.582720 23096 ts_tablet_manager.cc:1397] T d35e3e3e04b54c70ac20e1040ac3cce8 P 091ccdf967d949c9a2b8b03fcd48258c: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260808 14:47:55.582798 23092 raft_consensus.cc:348] T d35e3e3e04b54c70ac20e1040ac3cce8 P 78f732c786474630ad34b76d0a05800b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78f732c786474630ad34b76d0a05800b" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 42365 } } peers { permanent_uuid: "091ccdf967d949c9a2b8b03fcd48258c" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40261 } } peers { permanent_uuid: "24be9ebf5aff4ed787fbfd57e4f7e633" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38613 } }
I20260808 14:47:55.582984 23092 raft_consensus.cc:374] T d35e3e3e04b54c70ac20e1040ac3cce8 P 78f732c786474630ad34b76d0a05800b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:47:55.583030 23092 raft_consensus.cc:729] T d35e3e3e04b54c70ac20e1040ac3cce8 P 78f732c786474630ad34b76d0a05800b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78f732c786474630ad34b76d0a05800b, State: Initialized, Role: FOLLOWER
I20260808 14:47:55.583158 23092 consensus_queue.cc:260] T d35e3e3e04b54c70ac20e1040ac3cce8 P 78f732c786474630ad34b76d0a05800b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78f732c786474630ad34b76d0a05800b" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 42365 } } peers { permanent_uuid: "091ccdf967d949c9a2b8b03fcd48258c" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40261 } } peers { permanent_uuid: "24be9ebf5aff4ed787fbfd57e4f7e633" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38613 } }
I20260808 14:47:55.583514 23092 ts_tablet_manager.cc:1428] T d35e3e3e04b54c70ac20e1040ac3cce8 P 78f732c786474630ad34b76d0a05800b: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 14:47:55.583557 22866 heartbeater.cc:503] Master 127.30.214.190:40141 was elected leader, sending a full tablet report...
I20260808 14:47:55.584605 23096 raft_consensus.cc:348] T d35e3e3e04b54c70ac20e1040ac3cce8 P 091ccdf967d949c9a2b8b03fcd48258c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78f732c786474630ad34b76d0a05800b" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 42365 } } peers { permanent_uuid: "091ccdf967d949c9a2b8b03fcd48258c" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40261 } } peers { permanent_uuid: "24be9ebf5aff4ed787fbfd57e4f7e633" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38613 } }
I20260808 14:47:55.584810 23096 raft_consensus.cc:374] T d35e3e3e04b54c70ac20e1040ac3cce8 P 091ccdf967d949c9a2b8b03fcd48258c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:47:55.584859 23096 raft_consensus.cc:729] T d35e3e3e04b54c70ac20e1040ac3cce8 P 091ccdf967d949c9a2b8b03fcd48258c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 091ccdf967d949c9a2b8b03fcd48258c, State: Initialized, Role: FOLLOWER
I20260808 14:47:55.585047 23096 consensus_queue.cc:260] T d35e3e3e04b54c70ac20e1040ac3cce8 P 091ccdf967d949c9a2b8b03fcd48258c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78f732c786474630ad34b76d0a05800b" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 42365 } } peers { permanent_uuid: "091ccdf967d949c9a2b8b03fcd48258c" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40261 } } peers { permanent_uuid: "24be9ebf5aff4ed787fbfd57e4f7e633" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38613 } }
I20260808 14:47:55.585399 23096 ts_tablet_manager.cc:1428] T d35e3e3e04b54c70ac20e1040ac3cce8 P 091ccdf967d949c9a2b8b03fcd48258c: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260808 14:47:55.585431 23064 heartbeater.cc:503] Master 127.30.214.190:40141 was elected leader, sending a full tablet report...
I20260808 14:47:55.585387 23093 raft_consensus.cc:348] T d35e3e3e04b54c70ac20e1040ac3cce8 P 24be9ebf5aff4ed787fbfd57e4f7e633 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78f732c786474630ad34b76d0a05800b" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 42365 } } peers { permanent_uuid: "091ccdf967d949c9a2b8b03fcd48258c" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40261 } } peers { permanent_uuid: "24be9ebf5aff4ed787fbfd57e4f7e633" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38613 } }
I20260808 14:47:55.585603 23093 raft_consensus.cc:374] T d35e3e3e04b54c70ac20e1040ac3cce8 P 24be9ebf5aff4ed787fbfd57e4f7e633 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:47:55.585650 23093 raft_consensus.cc:729] T d35e3e3e04b54c70ac20e1040ac3cce8 P 24be9ebf5aff4ed787fbfd57e4f7e633 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24be9ebf5aff4ed787fbfd57e4f7e633, State: Initialized, Role: FOLLOWER
I20260808 14:47:55.585762 23093 consensus_queue.cc:260] T d35e3e3e04b54c70ac20e1040ac3cce8 P 24be9ebf5aff4ed787fbfd57e4f7e633 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78f732c786474630ad34b76d0a05800b" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 42365 } } peers { permanent_uuid: "091ccdf967d949c9a2b8b03fcd48258c" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40261 } } peers { permanent_uuid: "24be9ebf5aff4ed787fbfd57e4f7e633" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38613 } }
I20260808 14:47:55.586102 22677 heartbeater.cc:503] Master 127.30.214.190:40141 was elected leader, sending a full tablet report...
I20260808 14:47:55.586232 23102 raft_consensus.cc:482] T d35e3e3e04b54c70ac20e1040ac3cce8 P 78f732c786474630ad34b76d0a05800b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:47:55.586326 23102 raft_consensus.cc:504] T d35e3e3e04b54c70ac20e1040ac3cce8 P 78f732c786474630ad34b76d0a05800b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78f732c786474630ad34b76d0a05800b" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 42365 } } peers { permanent_uuid: "091ccdf967d949c9a2b8b03fcd48258c" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40261 } } peers { permanent_uuid: "24be9ebf5aff4ed787fbfd57e4f7e633" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38613 } }
I20260808 14:47:55.586040 23093 ts_tablet_manager.cc:1428] T d35e3e3e04b54c70ac20e1040ac3cce8 P 24be9ebf5aff4ed787fbfd57e4f7e633: Time spent starting tablet: real 0.004s user 0.002s sys 0.001s
I20260808 14:47:55.586728 23102 leader_election.cc:288] T d35e3e3e04b54c70ac20e1040ac3cce8 P 78f732c786474630ad34b76d0a05800b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 091ccdf967d949c9a2b8b03fcd48258c (127.30.214.131:40261), 24be9ebf5aff4ed787fbfd57e4f7e633 (127.30.214.129:38613)
I20260808 14:47:55.589823 23086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:55.587169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.130:39989 (local address 127.30.214.131:40261)
0808 14:47:55.587225 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 14:47:55.587227 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:47:55.587234 (+ 7us) server_negotiation.cc:407] Connection header received
0808 14:47:55.587257 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:47:55.587258 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:47:55.587267 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:47:55.587323 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:47:55.587533 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:55.588055 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:55.589024 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:55.589492 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:55.589562 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:55.589573 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0808 14:47:55.589717 (+ 144us) server_negotiation.cc:299] Negotiation successful
0808 14:47:55.589751 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 14:47:55.589823 22868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:55.586865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.131:40261 (local address 127.30.214.130:39989)
0808 14:47:55.587149 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:55.587159 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:47:55.587197 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:47:55.587356 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:47:55.587357 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:47:55.587359 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:47:55.587460 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:55.587463 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:55.588131 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:55.588131 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:55.588929 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:55.588931 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:55.589562 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:55.589563 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:55.589655 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:55.589659 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:47:55.589705 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 14:47:55.589750 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":267}
I20260808 14:47:55.589941 23090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:55.587041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.130:55483 (local address 127.30.214.129:38613)
0808 14:47:55.587088 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 14:47:55.587090 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:47:55.587353 (+ 263us) server_negotiation.cc:407] Connection header received
0808 14:47:55.587415 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:47:55.587416 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:47:55.587426 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:47:55.587499 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:47:55.587646 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:55.588165 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:55.589119 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:55.589581 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:55.589644 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:55.589654 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 14:47:55.589836 (+ 182us) server_negotiation.cc:299] Negotiation successful
0808 14:47:55.589879 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 14:47:55.590126 23108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:55.586973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.129:38613 (local address 127.30.214.130:55483)
0808 14:47:55.587281 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:55.587289 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 14:47:55.587339 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:47:55.587499 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:47:55.587500 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:47:55.587501 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:47:55.587583 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:55.587585 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:55.588239 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:55.588239 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:55.589034 (+ 795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:47:55.589037 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:47:55.589654 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:47:55.589654 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:47:55.589747 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:55.589752 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 14:47:55.590014 (+ 262us) client_negotiation.cc:240] Negotiation successful
0808 14:47:55.590056 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":295,"thread_start_us":93,"threads_started":1}
I20260808 14:47:55.590198 22992 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d35e3e3e04b54c70ac20e1040ac3cce8" candidate_uuid: "78f732c786474630ad34b76d0a05800b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "091ccdf967d949c9a2b8b03fcd48258c" is_pre_election: true
I20260808 14:47:55.590372 22992 raft_consensus.cc:2454] T d35e3e3e04b54c70ac20e1040ac3cce8 P 091ccdf967d949c9a2b8b03fcd48258c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 78f732c786474630ad34b76d0a05800b in term 0.
I20260808 14:47:55.590453 22611 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d35e3e3e04b54c70ac20e1040ac3cce8" candidate_uuid: "78f732c786474630ad34b76d0a05800b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24be9ebf5aff4ed787fbfd57e4f7e633" is_pre_election: true
I20260808 14:47:55.590581 22611 raft_consensus.cc:2454] T d35e3e3e04b54c70ac20e1040ac3cce8 P 24be9ebf5aff4ed787fbfd57e4f7e633 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 78f732c786474630ad34b76d0a05800b in term 0.
I20260808 14:47:55.590618 22707 leader_election.cc:302] T d35e3e3e04b54c70ac20e1040ac3cce8 P 78f732c786474630ad34b76d0a05800b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 091ccdf967d949c9a2b8b03fcd48258c, 78f732c786474630ad34b76d0a05800b; no voters:
I20260808 14:47:55.590750 23102 raft_consensus.cc:2781] T d35e3e3e04b54c70ac20e1040ac3cce8 P 78f732c786474630ad34b76d0a05800b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:47:55.590826 23102 raft_consensus.cc:482] T d35e3e3e04b54c70ac20e1040ac3cce8 P 78f732c786474630ad34b76d0a05800b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:47:55.590854 23102 raft_consensus.cc:3037] T d35e3e3e04b54c70ac20e1040ac3cce8 P 78f732c786474630ad34b76d0a05800b [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:47:55.591591 23102 raft_consensus.cc:504] T d35e3e3e04b54c70ac20e1040ac3cce8 P 78f732c786474630ad34b76d0a05800b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78f732c786474630ad34b76d0a05800b" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 42365 } } peers { permanent_uuid: "091ccdf967d949c9a2b8b03fcd48258c" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40261 } } peers { permanent_uuid: "24be9ebf5aff4ed787fbfd57e4f7e633" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38613 } }
I20260808 14:47:55.591704 23102 leader_election.cc:288] T d35e3e3e04b54c70ac20e1040ac3cce8 P 78f732c786474630ad34b76d0a05800b [CANDIDATE]: Term 1 election: Requested vote from peers 091ccdf967d949c9a2b8b03fcd48258c (127.30.214.131:40261), 24be9ebf5aff4ed787fbfd57e4f7e633 (127.30.214.129:38613)
I20260808 14:47:55.591881 22992 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d35e3e3e04b54c70ac20e1040ac3cce8" candidate_uuid: "78f732c786474630ad34b76d0a05800b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "091ccdf967d949c9a2b8b03fcd48258c"
I20260808 14:47:55.591928 22611 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d35e3e3e04b54c70ac20e1040ac3cce8" candidate_uuid: "78f732c786474630ad34b76d0a05800b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24be9ebf5aff4ed787fbfd57e4f7e633"
I20260808 14:47:55.591964 22992 raft_consensus.cc:3037] T d35e3e3e04b54c70ac20e1040ac3cce8 P 091ccdf967d949c9a2b8b03fcd48258c [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:47:55.591993 22611 raft_consensus.cc:3037] T d35e3e3e04b54c70ac20e1040ac3cce8 P 24be9ebf5aff4ed787fbfd57e4f7e633 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:47:55.592677 22992 raft_consensus.cc:2454] T d35e3e3e04b54c70ac20e1040ac3cce8 P 091ccdf967d949c9a2b8b03fcd48258c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78f732c786474630ad34b76d0a05800b in term 1.
I20260808 14:47:55.592734 22611 raft_consensus.cc:2454] T d35e3e3e04b54c70ac20e1040ac3cce8 P 24be9ebf5aff4ed787fbfd57e4f7e633 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78f732c786474630ad34b76d0a05800b in term 1.
I20260808 14:47:55.592854 22707 leader_election.cc:302] T d35e3e3e04b54c70ac20e1040ac3cce8 P 78f732c786474630ad34b76d0a05800b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 091ccdf967d949c9a2b8b03fcd48258c, 78f732c786474630ad34b76d0a05800b; no voters:
I20260808 14:47:55.592939 23102 raft_consensus.cc:2781] T d35e3e3e04b54c70ac20e1040ac3cce8 P 78f732c786474630ad34b76d0a05800b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:47:55.593135 23102 raft_consensus.cc:686] T d35e3e3e04b54c70ac20e1040ac3cce8 P 78f732c786474630ad34b76d0a05800b [term 1 LEADER]: Becoming Leader. State: Replica: 78f732c786474630ad34b76d0a05800b, State: Running, Role: LEADER
I20260808 14:47:55.593223 23102 consensus_queue.cc:237] T d35e3e3e04b54c70ac20e1040ac3cce8 P 78f732c786474630ad34b76d0a05800b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78f732c786474630ad34b76d0a05800b" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 42365 } } peers { permanent_uuid: "091ccdf967d949c9a2b8b03fcd48258c" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40261 } } peers { permanent_uuid: "24be9ebf5aff4ed787fbfd57e4f7e633" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38613 } }
I20260808 14:47:55.594063 22381 catalog_manager.cc:5495] T d35e3e3e04b54c70ac20e1040ac3cce8 P 78f732c786474630ad34b76d0a05800b reported cstate change: term changed from 0 to 1, leader changed from <none> to 78f732c786474630ad34b76d0a05800b (127.30.214.130). New cstate: current_term: 1 leader_uuid: "78f732c786474630ad34b76d0a05800b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78f732c786474630ad34b76d0a05800b" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 42365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "091ccdf967d949c9a2b8b03fcd48258c" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40261 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24be9ebf5aff4ed787fbfd57e4f7e633" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38613 } health_report { overall_health: UNKNOWN } } }
I20260808 14:47:55.601784 23087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:55.599055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59390 (local address 127.30.214.130:42365)
0808 14:47:55.599114 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0808 14:47:55.599116 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:47:55.599132 (+ 16us) server_negotiation.cc:407] Connection header received
0808 14:47:55.599185 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:47:55.599186 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:47:55.599302 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:47:55.599406 (+ 104us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:47:55.599778 (+ 372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:55.600250 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:55.601051 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:47:55.601226 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:47:55.601268 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:47:55.601384 (+ 116us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:47:55.601559 (+ 175us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:47:55.601626 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 14:47:55.601702 (+ 76us) server_negotiation.cc:299] Negotiation successful
0808 14:47:55.601722 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 14:47:55.603609 22611 raft_consensus.cc:1261] T d35e3e3e04b54c70ac20e1040ac3cce8 P 24be9ebf5aff4ed787fbfd57e4f7e633 [term 1 FOLLOWER]: Refusing update from remote peer 78f732c786474630ad34b76d0a05800b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:47:55.603609 22992 raft_consensus.cc:1261] T d35e3e3e04b54c70ac20e1040ac3cce8 P 091ccdf967d949c9a2b8b03fcd48258c [term 1 FOLLOWER]: Refusing update from remote peer 78f732c786474630ad34b76d0a05800b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:47:55.603987 23110 consensus_queue.cc:1035] T d35e3e3e04b54c70ac20e1040ac3cce8 P 78f732c786474630ad34b76d0a05800b [LEADER]: Connected to new peer: Peer: permanent_uuid: "091ccdf967d949c9a2b8b03fcd48258c" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:47:55.604112 23102 consensus_queue.cc:1035] T d35e3e3e04b54c70ac20e1040ac3cce8 P 78f732c786474630ad34b76d0a05800b [LEADER]: Connected to new peer: Peer: permanent_uuid: "24be9ebf5aff4ed787fbfd57e4f7e633" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:47:55.607041 23115 mvcc.cc:205] Tried to move back new op lower bound from 7316277148069670912 to 7316277148030472192. Current Snapshot: MvccSnapshot[applied={T|T < 7316277148069670912}]
I20260808 14:47:55.609050 22384 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48474:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:47:55.609143 22384 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48474:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:47:55.609859 22384 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f7d2284723d74dd7b9e1b0f3e3b1cc1c: Sending DeleteTablet for 3 replicas of tablet d35e3e3e04b54c70ac20e1040ac3cce8
I20260808 14:47:55.610180 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 22483
I20260808 14:47:55.610163 22777 tablet_service.cc:1514] Processing DeleteTablet for tablet d35e3e3e04b54c70ac20e1040ac3cce8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:47:55 UTC) from {username='kudu', principal='kudu/127.30.214.190@KRBTEST.COM'} at 127.0.0.1:59374
I20260808 14:47:55.610280 22960 tablet_service.cc:1514] Processing DeleteTablet for tablet d35e3e3e04b54c70ac20e1040ac3cce8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:47:55 UTC) from {username='kudu', principal='kudu/127.30.214.190@KRBTEST.COM'} at 127.0.0.1:41856
I20260808 14:47:55.622957 23130 tablet_replica.cc:330] T d35e3e3e04b54c70ac20e1040ac3cce8 P 78f732c786474630ad34b76d0a05800b: stopping tablet replica
I20260808 14:47:55.623220 23130 raft_consensus.cc:2229] T d35e3e3e04b54c70ac20e1040ac3cce8 P 78f732c786474630ad34b76d0a05800b [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:47:55.623433 23130 raft_consensus.cc:2258] T d35e3e3e04b54c70ac20e1040ac3cce8 P 78f732c786474630ad34b76d0a05800b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:47:55.624481 23131 tablet_replica.cc:330] T d35e3e3e04b54c70ac20e1040ac3cce8 P 091ccdf967d949c9a2b8b03fcd48258c: stopping tablet replica
I20260808 14:47:55.624588 23131 raft_consensus.cc:2229] T d35e3e3e04b54c70ac20e1040ac3cce8 P 091ccdf967d949c9a2b8b03fcd48258c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:47:55.624671 23131 raft_consensus.cc:2258] T d35e3e3e04b54c70ac20e1040ac3cce8 P 091ccdf967d949c9a2b8b03fcd48258c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:47:55.626698 23130 ts_tablet_manager.cc:1905] T d35e3e3e04b54c70ac20e1040ac3cce8 P 78f732c786474630ad34b76d0a05800b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:47:55.628475 23130 ts_tablet_manager.cc:1918] T d35e3e3e04b54c70ac20e1040ac3cce8 P 78f732c786474630ad34b76d0a05800b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:47:55.628559 23130 log.cc:1196] T d35e3e3e04b54c70ac20e1040ac3cce8 P 78f732c786474630ad34b76d0a05800b: Deleting WAL directory at /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-1/wal/wals/d35e3e3e04b54c70ac20e1040ac3cce8
I20260808 14:47:55.628784 23130 ts_tablet_manager.cc:1939] T d35e3e3e04b54c70ac20e1040ac3cce8 P 78f732c786474630ad34b76d0a05800b: Deleting consensus metadata
I20260808 14:47:55.629390 22365 catalog_manager.cc:4841] TS 78f732c786474630ad34b76d0a05800b (127.30.214.130:42365): tablet d35e3e3e04b54c70ac20e1040ac3cce8 (table test-table [id=5ee2f494797743ae9b90ab57194e78cb]) successfully deleted
I20260808 14:47:55.630841 23131 ts_tablet_manager.cc:1905] T d35e3e3e04b54c70ac20e1040ac3cce8 P 091ccdf967d949c9a2b8b03fcd48258c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:47:55.632743 23131 ts_tablet_manager.cc:1918] T d35e3e3e04b54c70ac20e1040ac3cce8 P 091ccdf967d949c9a2b8b03fcd48258c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:47:55.632824 23131 log.cc:1196] T d35e3e3e04b54c70ac20e1040ac3cce8 P 091ccdf967d949c9a2b8b03fcd48258c: Deleting WAL directory at /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-2/wal/wals/d35e3e3e04b54c70ac20e1040ac3cce8
I20260808 14:47:55.633121 23131 ts_tablet_manager.cc:1939] T d35e3e3e04b54c70ac20e1040ac3cce8 P 091ccdf967d949c9a2b8b03fcd48258c: Deleting consensus metadata
I20260808 14:47:55.633849 22364 catalog_manager.cc:4841] TS 091ccdf967d949c9a2b8b03fcd48258c (127.30.214.131:40261): tablet d35e3e3e04b54c70ac20e1040ac3cce8 (table test-table [id=5ee2f494797743ae9b90ab57194e78cb]) successfully deleted
W20260808 14:47:55.634909 22364 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.30.214.129:38613 (error 108)
I20260808 14:47:55.635155 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 22683
I20260808 14:47:55.642825 23088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:47:55.642609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.129:38613 (local address 127.0.0.1:37426)
0808 14:47:55.642696 (+ 87us) negotiation.cc:107] Waiting for socket to connect
0808 14:47:55.642770 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.129:38613: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260808 14:47:55.643021 22364 catalog_manager.cc:4584] TS 24be9ebf5aff4ed787fbfd57e4f7e633 (127.30.214.129:38613): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d35e3e3e04b54c70ac20e1040ac3cce8: Network error: Client connection negotiation failed: client connection to 127.30.214.129:38613: connect: Connection refused (error 111)
I20260808 14:47:55.652617 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 22873
I20260808 14:47:55.667145 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 22344
I20260808 14:48:15.682915 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:40141
--webserver_interface=127.30.214.190
--webserver_port=35789
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab
--principal=kudu/127.30.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:43459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.214.190:40141
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:48:15.767189 23133 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:48:15.767397 23133 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:48:15.767421 23133 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:48:15.768565 23133 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 14:48:15.768604 23133 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 14:48:15.768616 23133 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 14:48:15.768627 23133 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:48:15.768638 23133 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:48:15.768656 23133 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:48:15.768667 23133 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:48:15.768678 23133 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:48:15.770238 23133 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:43459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.30.214.190:40141
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab
--principal=kudu/127.30.214.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:40141
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.214.190
--webserver_port=35789
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23133
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:48:15.770447 23133 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:48:15.770639 23133 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:48:15.779834 23143 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:48:15.779879 23142 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:48:15.779937 23133 server_base.cc:1034] running on GCE node
W20260808 14:48:15.779834 23146 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:48:15.780344 23133 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:48:15.780666 23133 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:48:15.781803 23133 hybrid_clock.cc:648] HybridClock initialized: now 1786200495781785 us; error 38 us; skew 500 ppm
Aug 08 14:48:15 dist-test-slave-42z9 krb5kdc[22329](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200495, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:48:15.787544 23133 init.cc:377] Logged in from keytab as kudu/127.30.214.190@KRBTEST.COM (short username kudu)
I20260808 14:48:15.788057 23133 webserver.cc:460] Webserver started at http://127.30.214.190:35789/ using document root <none> and password file <none>
I20260808 14:48:15.788295 23133 fs_manager.cc:359] Metadata directory not provided
I20260808 14:48:15.788359 23133 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:48:15.789798 23133 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:48:15.790530 23156 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:48:15.790729 23133 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:48:15.790829 23133 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/master-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/master-0/wal
uuid: "f7d2284723d74dd7b9e1b0f3e3b1cc1c"
format_stamp: "Formatted at 2026-08-08 14:47:54 on dist-test-slave-42z9"
server_key: "0cd964ee2b125eab145ef233ec332fc5"
server_key_iv: "711aaed7aa510dc685ff21cd67bb81c3"
server_key_version: "encryptionkey@0"
I20260808 14:48:15.791241 23133 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:48:15.808175 23133 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:48:15.810196 23133 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:48:15.810346 23133 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:48:15.814383 23133 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.190:40141
I20260808 14:48:15.814435 23246 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.190:40141 every 8 connection(s)
I20260808 14:48:15.814968 23133 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
I20260808 14:48:15.816546 23247 sys_catalog.cc:263] Verifying existing consensus state
I20260808 14:48:15.817219 23247 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f7d2284723d74dd7b9e1b0f3e3b1cc1c: Bootstrap starting.
I20260808 14:48:15.819259 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 23133
I20260808 14:48:15.819610 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.129:38613
--local_ip_for_outbound_sockets=127.30.214.129
--tserver_master_addrs=127.30.214.190:40141
--webserver_port=43837
--webserver_interface=127.30.214.129
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab
--principal=kudu/127.30.214.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:43459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:48:15.826361 23247 log.cc:824] T 00000000000000000000000000000000 P f7d2284723d74dd7b9e1b0f3e3b1cc1c: Log is configured to *not* fsync() on all Append() calls
I20260808 14:48:15.828277 23247 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f7d2284723d74dd7b9e1b0f3e3b1cc1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 14:48:15.828645 23247 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f7d2284723d74dd7b9e1b0f3e3b1cc1c: Bootstrap complete.
I20260808 14:48:15.830881 23247 raft_consensus.cc:348] T 00000000000000000000000000000000 P f7d2284723d74dd7b9e1b0f3e3b1cc1c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7d2284723d74dd7b9e1b0f3e3b1cc1c" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 40141 } }
I20260808 14:48:15.831121 23247 raft_consensus.cc:729] T 00000000000000000000000000000000 P f7d2284723d74dd7b9e1b0f3e3b1cc1c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7d2284723d74dd7b9e1b0f3e3b1cc1c, State: Initialized, Role: FOLLOWER
I20260808 14:48:15.831269 23247 consensus_queue.cc:260] T 00000000000000000000000000000000 P f7d2284723d74dd7b9e1b0f3e3b1cc1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7d2284723d74dd7b9e1b0f3e3b1cc1c" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 40141 } }
I20260808 14:48:15.831332 23247 raft_consensus.cc:388] T 00000000000000000000000000000000 P f7d2284723d74dd7b9e1b0f3e3b1cc1c [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:48:15.831378 23247 raft_consensus.cc:482] T 00000000000000000000000000000000 P f7d2284723d74dd7b9e1b0f3e3b1cc1c [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:48:15.831427 23247 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f7d2284723d74dd7b9e1b0f3e3b1cc1c [term 1 FOLLOWER]: Advancing to term 2
I20260808 14:48:15.832459 23247 raft_consensus.cc:504] T 00000000000000000000000000000000 P f7d2284723d74dd7b9e1b0f3e3b1cc1c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7d2284723d74dd7b9e1b0f3e3b1cc1c" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 40141 } }
I20260808 14:48:15.832556 23247 leader_election.cc:302] T 00000000000000000000000000000000 P f7d2284723d74dd7b9e1b0f3e3b1cc1c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f7d2284723d74dd7b9e1b0f3e3b1cc1c; no voters:
I20260808 14:48:15.832724 23247 leader_election.cc:288] T 00000000000000000000000000000000 P f7d2284723d74dd7b9e1b0f3e3b1cc1c [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 14:48:15.832778 23257 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f7d2284723d74dd7b9e1b0f3e3b1cc1c [term 2 FOLLOWER]: Leader election won for term 2
I20260808 14:48:15.832907 23257 raft_consensus.cc:686] T 00000000000000000000000000000000 P f7d2284723d74dd7b9e1b0f3e3b1cc1c [term 2 LEADER]: Becoming Leader. State: Replica: f7d2284723d74dd7b9e1b0f3e3b1cc1c, State: Running, Role: LEADER
I20260808 14:48:15.833017 23247 sys_catalog.cc:564] T 00000000000000000000000000000000 P f7d2284723d74dd7b9e1b0f3e3b1cc1c [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:48:15.832995 23257 consensus_queue.cc:237] T 00000000000000000000000000000000 P f7d2284723d74dd7b9e1b0f3e3b1cc1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7d2284723d74dd7b9e1b0f3e3b1cc1c" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 40141 } }
I20260808 14:48:15.833321 23257 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7d2284723d74dd7b9e1b0f3e3b1cc1c [sys.catalog]: SysCatalogTable state changed. Reason: New leader f7d2284723d74dd7b9e1b0f3e3b1cc1c. Latest consensus state: current_term: 2 leader_uuid: "f7d2284723d74dd7b9e1b0f3e3b1cc1c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7d2284723d74dd7b9e1b0f3e3b1cc1c" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 40141 } } }
I20260808 14:48:15.833462 23257 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7d2284723d74dd7b9e1b0f3e3b1cc1c [sys.catalog]: This master's current role is: LEADER
I20260808 14:48:15.833328 23260 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7d2284723d74dd7b9e1b0f3e3b1cc1c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "f7d2284723d74dd7b9e1b0f3e3b1cc1c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7d2284723d74dd7b9e1b0f3e3b1cc1c" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 40141 } } }
I20260808 14:48:15.833655 23260 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7d2284723d74dd7b9e1b0f3e3b1cc1c [sys.catalog]: This master's current role is: LEADER
I20260808 14:48:15.834221 23265 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:48:15.835003 23265 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:48:15.835125 23265 catalog_manager.cc:1259] Loaded cluster ID: 7cefac0c3be14a7ea82f936dc8062033
I20260808 14:48:15.835162 23265 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:48:15.836380 23265 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:48:15.836585 23265 catalog_manager.cc:5879] T 00000000000000000000000000000000 P f7d2284723d74dd7b9e1b0f3e3b1cc1c: Loaded TSK: 0
I20260808 14:48:15.848654 23265 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f7d2284723d74dd7b9e1b0f3e3b1cc1c: Generated new TSK 1
I20260808 14:48:15.848768 23265 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 14:48:15.907723 23254 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:48:15.907935 23254 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:48:15.907958 23254 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:48:15.909164 23254 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:48:15.909211 23254 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:48:15.909238 23254 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.129
I20260808 14:48:15.910811 23254 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:43459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab
--principal=kudu/127.30.214.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.129:38613
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.214.129
--webserver_port=43837
--tserver_master_addrs=127.30.214.190:40141
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23254
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.129
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:48:15.911059 23254 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:48:15.911311 23254 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:48:15.916608 23296 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:48:15.916692 23298 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:48:15.916949 23291 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:48:15.917218 23254 server_base.cc:1034] running on GCE node
I20260808 14:48:15.917413 23254 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:48:15.917683 23254 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:48:15.918848 23254 hybrid_clock.cc:648] HybridClock initialized: now 1786200495918832 us; error 34 us; skew 500 ppm
Aug 08 14:48:15 dist-test-slave-42z9 krb5kdc[22329](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200495, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:48:15.921324 23254 init.cc:377] Logged in from keytab as kudu/127.30.214.129@KRBTEST.COM (short username kudu)
I20260808 14:48:15.921818 23254 webserver.cc:460] Webserver started at http://127.30.214.129:43837/ using document root <none> and password file <none>
I20260808 14:48:15.922048 23254 fs_manager.cc:359] Metadata directory not provided
I20260808 14:48:15.922109 23254 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:48:15.923434 23254 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:48:15.924041 23309 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:48:15.924189 23254 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:48:15.924268 23254 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-0/wal
uuid: "24be9ebf5aff4ed787fbfd57e4f7e633"
format_stamp: "Formatted at 2026-08-08 14:47:55 on dist-test-slave-42z9"
server_key: "c146464be7c83212c32cf0432cb63730"
server_key_iv: "703135265e862d7466370aa95f9b64df"
server_key_version: "encryptionkey@0"
I20260808 14:48:15.924610 23254 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:48:15.936971 23254 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:48:15.939059 23254 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:48:15.939196 23254 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:48:15.939421 23254 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:48:15.939877 23320 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 14:48:15.941296 23254 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 14:48:15.941349 23254 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260808 14:48:15.941372 23254 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 14:48:15.942057 23254 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 14:48:15.942103 23254 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260808 14:48:15.942164 23320 tablet_bootstrap.cc:492] T d35e3e3e04b54c70ac20e1040ac3cce8 P 24be9ebf5aff4ed787fbfd57e4f7e633: Bootstrap starting.
I20260808 14:48:15.949383 23254 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.129:38613
I20260808 14:48:15.949579 23476 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.129:38613 every 8 connection(s)
I20260808 14:48:15.949930 23254 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
I20260808 14:48:15.954311 23320 log.cc:824] T d35e3e3e04b54c70ac20e1040ac3cce8 P 24be9ebf5aff4ed787fbfd57e4f7e633: Log is configured to *not* fsync() on all Append() calls
I20260808 14:48:15.955889 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 23254
I20260808 14:48:15.956179 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.130:42365
--local_ip_for_outbound_sockets=127.30.214.130
--tserver_master_addrs=127.30.214.190:40141
--webserver_port=40757
--webserver_interface=127.30.214.130
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab
--principal=kudu/127.30.214.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:43459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:48:15.956959 23320 tablet_bootstrap.cc:492] T d35e3e3e04b54c70ac20e1040ac3cce8 P 24be9ebf5aff4ed787fbfd57e4f7e633: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 14:48:15.957227 23320 tablet_bootstrap.cc:492] T d35e3e3e04b54c70ac20e1040ac3cce8 P 24be9ebf5aff4ed787fbfd57e4f7e633: Bootstrap complete.
I20260808 14:48:15.958298 23320 ts_tablet_manager.cc:1397] T d35e3e3e04b54c70ac20e1040ac3cce8 P 24be9ebf5aff4ed787fbfd57e4f7e633: Time spent bootstrapping tablet: real 0.016s user 0.000s sys 0.015s
I20260808 14:48:15.959582 23320 raft_consensus.cc:348] T d35e3e3e04b54c70ac20e1040ac3cce8 P 24be9ebf5aff4ed787fbfd57e4f7e633 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78f732c786474630ad34b76d0a05800b" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 42365 } } peers { permanent_uuid: "091ccdf967d949c9a2b8b03fcd48258c" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40261 } } peers { permanent_uuid: "24be9ebf5aff4ed787fbfd57e4f7e633" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38613 } }
I20260808 14:48:15.959863 23320 raft_consensus.cc:729] T d35e3e3e04b54c70ac20e1040ac3cce8 P 24be9ebf5aff4ed787fbfd57e4f7e633 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24be9ebf5aff4ed787fbfd57e4f7e633, State: Initialized, Role: FOLLOWER
I20260808 14:48:15.960032 23320 consensus_queue.cc:260] T d35e3e3e04b54c70ac20e1040ac3cce8 P 24be9ebf5aff4ed787fbfd57e4f7e633 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78f732c786474630ad34b76d0a05800b" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 42365 } } peers { permanent_uuid: "091ccdf967d949c9a2b8b03fcd48258c" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40261 } } peers { permanent_uuid: "24be9ebf5aff4ed787fbfd57e4f7e633" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38613 } }
I20260808 14:48:15.960306 23320 ts_tablet_manager.cc:1428] T d35e3e3e04b54c70ac20e1040ac3cce8 P 24be9ebf5aff4ed787fbfd57e4f7e633: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
Aug 08 14:48:15 dist-test-slave-42z9 krb5kdc[22329](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200495, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.129@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:48:15.965363 23487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:15.950753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.129:36273 (local address 127.30.214.190:40141)
0808 14:48:15.952313 (+ 1560us) server_negotiation.cc:206] Beginning negotiation
0808 14:48:15.952325 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 14:48:15.952378 (+ 53us) server_negotiation.cc:407] Connection header received
0808 14:48:15.952551 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:48:15.952561 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:48:15.952622 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:48:15.952796 (+ 174us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:48:15.953664 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:15.954947 (+ 1283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:15.958205 (+ 3258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:15.958805 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:15.958940 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:15.961554 (+ 2614us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:48:15.961558 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:48:15.961558 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:48:15.961570 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:48:15.963386 (+ 1816us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:48:15.963902 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:48:15.963905 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:48:15.963906 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:48:15.964026 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:48:15.964312 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:48:15.964312 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:48:15.964312 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:48:15.964596 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:48:15.964675 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 14:48:15.965045 (+ 370us) server_negotiation.cc:299] Negotiation successful
0808 14:48:15.965182 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1500,"thread_start_us":96,"threads_started":1}
I20260808 14:48:15.965386 23483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:15.950647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:40141 (local address 127.30.214.129:36273)
0808 14:48:15.950850 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:15.950899 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 14:48:15.952060 (+ 1161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:48:15.952858 (+ 798us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:48:15.952863 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:48:15.953227 (+ 364us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:48:15.953518 (+ 291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:15.953525 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:15.955094 (+ 1569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:15.955095 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:15.956478 (+ 1383us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:15.956482 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:15.958933 (+ 2451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:15.958935 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:15.959091 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:15.959704 (+ 613us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:48:15.959714 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:48:15.961415 (+ 1701us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:48:15.963487 (+ 2072us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:48:15.963496 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:48:15.963499 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:48:15.963807 (+ 308us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:48:15.964100 (+ 293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:48:15.964100 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:48:15.964101 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:48:15.964243 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:48:15.964669 (+ 426us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:48:15.964676 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:48:15.964858 (+ 182us) client_negotiation.cc:769] Sending connection context
0808 14:48:15.964985 (+ 127us) client_negotiation.cc:240] Negotiation successful
0808 14:48:15.965174 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":99,"threads_started":1}
I20260808 14:48:15.966531 23477 heartbeater.cc:347] Connected to a master server at 127.30.214.190:40141
I20260808 14:48:15.966645 23477 heartbeater.cc:464] Registering TS with master...
I20260808 14:48:15.966858 23477 heartbeater.cc:511] Master 127.30.214.190:40141 requested a full tablet report, sending...
I20260808 14:48:15.967619 23193 ts_manager.cc:194] Registered new tserver with Master: 24be9ebf5aff4ed787fbfd57e4f7e633 (127.30.214.129:38613)
I20260808 14:48:15.968627 23193 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.214.129@KRBTEST.COM'} at 127.30.214.129:36273
I20260808 14:48:15.969691 23477 heartbeater.cc:503] Master 127.30.214.190:40141 was elected leader, sending a full tablet report...
Aug 08 14:48:15 dist-test-slave-42z9 krb5kdc[22329](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200495, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.190@KRBTEST.COM for kudu/127.30.214.129@KRBTEST.COM
I20260808 14:48:15.976410 23494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:15.968314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39836 (local address 127.30.214.129:38613)
0808 14:48:15.968497 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0808 14:48:15.968501 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:48:15.968597 (+ 96us) server_negotiation.cc:407] Connection header received
0808 14:48:15.968691 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:48:15.968694 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:48:15.968709 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:48:15.968786 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:48:15.969310 (+ 524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:15.970135 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:15.971276 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:15.971563 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:15.971618 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:15.973800 (+ 2182us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:48:15.973808 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:48:15.973808 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:48:15.973815 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:48:15.975227 (+ 1412us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:48:15.975636 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:48:15.975638 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:48:15.975638 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:48:15.975690 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:48:15.975855 (+ 165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:48:15.975855 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:48:15.975855 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:48:15.975986 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:48:15.976076 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 14:48:15.976258 (+ 182us) server_negotiation.cc:299] Negotiation successful
0808 14:48:15.976343 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":96,"threads_started":1}
I20260808 14:48:15.976450 23493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:15.968239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.129:38613 (local address 127.0.0.1:39836)
0808 14:48:15.968481 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:15.968516 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 14:48:15.968602 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:48:15.968854 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:48:15.968859 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:48:15.969183 (+ 324us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:48:15.969231 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:15.969234 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:15.970252 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:15.970253 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:15.971190 (+ 937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:15.971193 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:15.971631 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:15.971631 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:15.971708 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:15.972157 (+ 449us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:48:15.972161 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:48:15.973695 (+ 1534us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:48:15.975299 (+ 1604us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:48:15.975305 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:48:15.975308 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:48:15.975562 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:48:15.975741 (+ 179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:48:15.975741 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:48:15.975742 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:48:15.975805 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:48:15.976052 (+ 247us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:48:15.976060 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:48:15.976121 (+ 61us) client_negotiation.cc:769] Sending connection context
0808 14:48:15.976210 (+ 89us) client_negotiation.cc:240] Negotiation successful
0808 14:48:15.976342 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":98,"threads_started":1}
I20260808 14:48:15.976888 23382 tablet_service.cc:1514] Processing DeleteTablet for tablet d35e3e3e04b54c70ac20e1040ac3cce8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:47:55 UTC) from {username='kudu', principal='kudu/127.30.214.190@KRBTEST.COM'} at 127.0.0.1:39836
I20260808 14:48:15.977571 23496 tablet_replica.cc:330] stopping tablet replica
I20260808 14:48:15.977687 23496 raft_consensus.cc:2229] T d35e3e3e04b54c70ac20e1040ac3cce8 P 24be9ebf5aff4ed787fbfd57e4f7e633 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:48:15.977756 23496 raft_consensus.cc:2258] T d35e3e3e04b54c70ac20e1040ac3cce8 P 24be9ebf5aff4ed787fbfd57e4f7e633 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:48:15.978073 23496 ts_tablet_manager.cc:1905] T d35e3e3e04b54c70ac20e1040ac3cce8 P 24be9ebf5aff4ed787fbfd57e4f7e633: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:48:15.980397 23496 ts_tablet_manager.cc:1918] T d35e3e3e04b54c70ac20e1040ac3cce8 P 24be9ebf5aff4ed787fbfd57e4f7e633: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:48:15.980479 23496 log.cc:1196] T d35e3e3e04b54c70ac20e1040ac3cce8 P 24be9ebf5aff4ed787fbfd57e4f7e633: Deleting WAL directory at /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-0/wal/wals/d35e3e3e04b54c70ac20e1040ac3cce8
I20260808 14:48:15.980702 23496 ts_tablet_manager.cc:1939] T d35e3e3e04b54c70ac20e1040ac3cce8 P 24be9ebf5aff4ed787fbfd57e4f7e633: Deleting consensus metadata
I20260808 14:48:15.981210 23158 catalog_manager.cc:4841] TS 24be9ebf5aff4ed787fbfd57e4f7e633 (127.30.214.129:38613): tablet d35e3e3e04b54c70ac20e1040ac3cce8 (table test-table [id=5ee2f494797743ae9b90ab57194e78cb]) successfully deleted
W20260808 14:48:16.046252 23491 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:48:16.046473 23491 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:48:16.046497 23491 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:48:16.047610 23491 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:48:16.047646 23491 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:48:16.047670 23491 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.130
I20260808 14:48:16.049114 23491 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:43459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab
--principal=kudu/127.30.214.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.130:42365
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.214.130
--webserver_port=40757
--tserver_master_addrs=127.30.214.190:40141
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23491
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.130
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:48:16.049312 23491 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:48:16.049531 23491 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:48:16.054423 23502 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:48:16.054555 23491 server_base.cc:1034] running on GCE node
W20260808 14:48:16.054433 23503 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:48:16.054680 23505 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:48:16.054898 23491 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:48:16.055193 23491 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:48:16.056354 23491 hybrid_clock.cc:648] HybridClock initialized: now 1786200496056342 us; error 42 us; skew 500 ppm
Aug 08 14:48:16 dist-test-slave-42z9 krb5kdc[22329](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200496, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:48:16.059049 23491 init.cc:377] Logged in from keytab as kudu/127.30.214.130@KRBTEST.COM (short username kudu)
I20260808 14:48:16.059502 23491 webserver.cc:460] Webserver started at http://127.30.214.130:40757/ using document root <none> and password file <none>
I20260808 14:48:16.059752 23491 fs_manager.cc:359] Metadata directory not provided
I20260808 14:48:16.059821 23491 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:48:16.061290 23491 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:48:16.061969 23525 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:48:16.062143 23491 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 14:48:16.062228 23491 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-1/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-1/wal
uuid: "78f732c786474630ad34b76d0a05800b"
format_stamp: "Formatted at 2026-08-08 14:47:55 on dist-test-slave-42z9"
server_key: "4ebe4bc2375ed3478a0e4f86dd51ba99"
server_key_iv: "eea12add0d25be48f5750b1356039067"
server_key_version: "encryptionkey@0"
I20260808 14:48:16.062582 23491 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:48:16.073237 23491 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:48:16.075390 23491 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:48:16.075538 23491 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:48:16.075767 23491 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:48:16.076061 23491 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:48:16.076094 23491 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:48:16.076123 23491 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:48:16.076148 23491 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:48:16.081919 23491 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.130:42365
I20260808 14:48:16.081967 23689 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.130:42365 every 8 connection(s)
I20260808 14:48:16.082299 23491 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
I20260808 14:48:16.084856 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 23491
I20260808 14:48:16.085119 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.131:40261
--local_ip_for_outbound_sockets=127.30.214.131
--tserver_master_addrs=127.30.214.190:40141
--webserver_port=40853
--webserver_interface=127.30.214.131
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab
--principal=kudu/127.30.214.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:43459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 14:48:16 dist-test-slave-42z9 krb5kdc[22329](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200496, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.130@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:48:16.092157 23487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:16.082965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.130:59751 (local address 127.30.214.190:40141)
0808 14:48:16.083018 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 14:48:16.083020 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:48:16.083216 (+ 196us) server_negotiation.cc:407] Connection header received
0808 14:48:16.083727 (+ 511us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:48:16.083728 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:48:16.083745 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:48:16.083799 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:48:16.084765 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:16.085352 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:16.086687 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:16.086892 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:16.086974 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:16.089348 (+ 2374us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:48:16.089349 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:48:16.089350 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:48:16.089357 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:48:16.090739 (+ 1382us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:48:16.091231 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:48:16.091232 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:48:16.091232 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:48:16.091282 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:48:16.091540 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:48:16.091540 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:48:16.091540 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:48:16.091641 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:48:16.091685 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 14:48:16.092010 (+ 325us) server_negotiation.cc:299] Negotiation successful
0808 14:48:16.092089 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 14:48:16.092404 23692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:16.082944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:40141 (local address 127.30.214.130:59751)
0808 14:48:16.083102 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:16.083137 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 14:48:16.083629 (+ 492us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:48:16.083878 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:48:16.083882 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:48:16.084458 (+ 576us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:48:16.084656 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:16.084662 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:16.085471 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:16.085472 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:16.086578 (+ 1106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:16.086580 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:16.087003 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:16.087004 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:16.087142 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:16.087642 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:48:16.087650 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:48:16.089249 (+ 1599us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:48:16.090825 (+ 1576us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:48:16.090834 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:48:16.090837 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:48:16.091156 (+ 319us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:48:16.091336 (+ 180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:48:16.091337 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:48:16.091337 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:48:16.091476 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:48:16.091694 (+ 218us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:48:16.091699 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:48:16.091868 (+ 169us) client_negotiation.cc:769] Sending connection context
0808 14:48:16.092000 (+ 132us) client_negotiation.cc:240] Negotiation successful
0808 14:48:16.092172 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":78,"threads_started":1}
I20260808 14:48:16.092952 23690 heartbeater.cc:347] Connected to a master server at 127.30.214.190:40141
I20260808 14:48:16.093065 23690 heartbeater.cc:464] Registering TS with master...
I20260808 14:48:16.093271 23690 heartbeater.cc:511] Master 127.30.214.190:40141 requested a full tablet report, sending...
I20260808 14:48:16.093745 23193 ts_manager.cc:194] Registered new tserver with Master: 78f732c786474630ad34b76d0a05800b (127.30.214.130:42365)
I20260808 14:48:16.094131 23193 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.214.130@KRBTEST.COM'} at 127.30.214.130:59751
W20260808 14:48:16.169685 23693 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:48:16.169972 23693 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:48:16.170008 23693 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:48:16.171460 23693 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:48:16.171511 23693 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:48:16.171545 23693 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.131
I20260808 14:48:16.173681 23693 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:43459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab
--principal=kudu/127.30.214.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.131:40261
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.214.131
--webserver_port=40853
--tserver_master_addrs=127.30.214.190:40141
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23693
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.131
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:48:16.173967 23693 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:48:16.174242 23693 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:48:16.183662 23701 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:48:16.183647 23705 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:48:16.183789 23693 server_base.cc:1034] running on GCE node
W20260808 14:48:16.183647 23703 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:48:16.184070 23693 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:48:16.184336 23693 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:48:16.185497 23693 hybrid_clock.cc:648] HybridClock initialized: now 1786200496185485 us; error 32 us; skew 500 ppm
Aug 08 14:48:16 dist-test-slave-42z9 krb5kdc[22329](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200496, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:48:16.188060 23693 init.cc:377] Logged in from keytab as kudu/127.30.214.131@KRBTEST.COM (short username kudu)
I20260808 14:48:16.188521 23693 webserver.cc:460] Webserver started at http://127.30.214.131:40853/ using document root <none> and password file <none>
I20260808 14:48:16.188751 23693 fs_manager.cc:359] Metadata directory not provided
I20260808 14:48:16.188809 23693 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:48:16.190219 23693 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.000s
I20260808 14:48:16.190876 23717 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:48:16.191130 23693 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:48:16.191200 23693 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-2/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-2/wal
uuid: "091ccdf967d949c9a2b8b03fcd48258c"
format_stamp: "Formatted at 2026-08-08 14:47:55 on dist-test-slave-42z9"
server_key: "d630a513b439c1cd553942d9a74db351"
server_key_iv: "6fbc3bf5f1c25a791fc832b6b69bfa49"
server_key_version: "encryptionkey@0"
I20260808 14:48:16.191558 23693 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:48:16.211568 23693 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:48:16.213528 23693 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:48:16.213670 23693 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:48:16.213903 23693 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:48:16.214231 23693 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:48:16.214267 23693 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:48:16.214298 23693 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:48:16.214322 23693 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:48:16.220398 23693 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.131:40261
I20260808 14:48:16.220582 23894 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.131:40261 every 8 connection(s)
I20260808 14:48:16.220839 23693 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
I20260808 14:48:16.221613 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 23693
Aug 08 14:48:16 dist-test-slave-42z9 krb5kdc[22329](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200496, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.131@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:48:16.228750 23900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:16.222036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54438 (local address 127.30.214.190:40141)
0808 14:48:16.222170 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0808 14:48:16.222172 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:48:16.222182 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:48:16.222260 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:48:16.222261 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:48:16.222270 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:48:16.222326 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:48:16.223072 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:16.223576 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:16.224420 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:16.224606 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:16.224647 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:16.226049 (+ 1402us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:48:16.226050 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:48:16.226051 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:48:16.226057 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:48:16.227444 (+ 1387us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:48:16.227823 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:48:16.227825 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:48:16.227825 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:48:16.227913 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:48:16.228241 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:48:16.228242 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:48:16.228242 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:48:16.228352 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:48:16.228514 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0808 14:48:16.228552 (+ 38us) server_negotiation.cc:299] Negotiation successful
0808 14:48:16.228643 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":85,"threads_started":1}
I20260808 14:48:16.230829 23487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:16.221630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:59253 (local address 127.30.214.190:40141)
0808 14:48:16.221686 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 14:48:16.221689 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:48:16.221999 (+ 310us) server_negotiation.cc:407] Connection header received
0808 14:48:16.222606 (+ 607us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:48:16.222607 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:48:16.222612 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:48:16.222640 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:48:16.223691 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:16.224099 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:16.225364 (+ 1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:16.225613 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:16.225662 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:16.227862 (+ 2200us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:48:16.227863 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:48:16.227864 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:48:16.227871 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:48:16.229178 (+ 1307us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:48:16.229853 (+ 675us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:48:16.229856 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:48:16.229856 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:48:16.229991 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:48:16.230287 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:48:16.230289 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:48:16.230289 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:48:16.230434 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:48:16.230501 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 14:48:16.230705 (+ 204us) server_negotiation.cc:299] Negotiation successful
0808 14:48:16.230769 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 14:48:16.230996 23897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:16.221625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:40141 (local address 127.30.214.131:59253)
0808 14:48:16.221799 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:16.221850 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0808 14:48:16.222515 (+ 665us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:48:16.222745 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:48:16.222749 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:48:16.223406 (+ 657us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:48:16.223611 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:16.223617 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:16.224178 (+ 561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:16.224179 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:16.225273 (+ 1094us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:16.225276 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:16.225690 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:16.225691 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:16.225842 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:16.226293 (+ 451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:48:16.226301 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:48:16.227764 (+ 1463us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:48:16.229384 (+ 1620us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:48:16.229391 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:48:16.229394 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:48:16.229682 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:48:16.230098 (+ 416us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:48:16.230098 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:48:16.230099 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:48:16.230194 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:48:16.230500 (+ 306us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:48:16.230503 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:48:16.230613 (+ 110us) client_negotiation.cc:769] Sending connection context
0808 14:48:16.230687 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 14:48:16.230808 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":90,"threads_started":1}
I20260808 14:48:16.231406 23895 heartbeater.cc:347] Connected to a master server at 127.30.214.190:40141
I20260808 14:48:16.231503 23895 heartbeater.cc:464] Registering TS with master...
I20260808 14:48:16.231688 23895 heartbeater.cc:511] Master 127.30.214.190:40141 requested a full tablet report, sending...
I20260808 14:48:16.232374 23193 ts_manager.cc:194] Registered new tserver with Master: 091ccdf967d949c9a2b8b03fcd48258c (127.30.214.131:40261)
I20260808 14:48:16.232770 23193 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.214.131@KRBTEST.COM'} at 127.30.214.131:59253
I20260808 14:48:16.240581 31578 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:48:16.243654 23487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:16.240996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54454 (local address 127.30.214.190:40141)
0808 14:48:16.241060 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0808 14:48:16.241063 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:48:16.241161 (+ 98us) server_negotiation.cc:407] Connection header received
0808 14:48:16.241240 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:48:16.241241 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:48:16.241294 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:48:16.241357 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:48:16.241533 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:16.242048 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:16.242835 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:16.243050 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:16.243108 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:16.243263 (+ 155us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:48:16.243321 (+ 58us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0808 14:48:16.243578 (+ 257us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:54454: token expired
Metrics: {"server-negotiator.queue_time_us":34}
W20260808 14:48:16.243723 23487 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:54454: token expired
W20260808 14:48:16.243857 23074 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.30.214.190:40141)
I20260808 14:48:16.250463 23487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:16.244103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54468 (local address 127.30.214.190:40141)
0808 14:48:16.244136 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0808 14:48:16.244138 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:48:16.244148 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:48:16.244197 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:48:16.244198 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:48:16.244206 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:48:16.244250 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:48:16.244761 (+ 511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:16.245221 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:16.246220 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:16.246413 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:16.246487 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:16.247682 (+ 1195us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:48:16.247683 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:48:16.247684 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:48:16.247691 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:48:16.249020 (+ 1329us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:48:16.249657 (+ 637us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:48:16.249658 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:48:16.249659 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:48:16.249725 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:48:16.250018 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:48:16.250019 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:48:16.250019 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:48:16.250150 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:48:16.250238 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 14:48:16.250319 (+ 81us) server_negotiation.cc:299] Negotiation successful
0808 14:48:16.250385 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260808 14:48:16.251724 23193 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54468:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:48:16.253342 23193 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:48:16.255699 23382 tablet_service.cc:1467] Processing CreateTablet for tablet 4fce2f79d709481aaa374fe13ac6e7be (DEFAULT_TABLE table=test-table [id=f42bf7024e18411aad01cc1a27a8577e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:48:16.255910 23382 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4fce2f79d709481aaa374fe13ac6e7be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:48:16.257632 23320 tablet_bootstrap.cc:492] T 4fce2f79d709481aaa374fe13ac6e7be P 24be9ebf5aff4ed787fbfd57e4f7e633: Bootstrap starting.
I20260808 14:48:16.257977 23320 tablet_bootstrap.cc:654] T 4fce2f79d709481aaa374fe13ac6e7be P 24be9ebf5aff4ed787fbfd57e4f7e633: Neither blocks nor log segments found. Creating new log.
I20260808 14:48:16.258615 23320 tablet_bootstrap.cc:492] T 4fce2f79d709481aaa374fe13ac6e7be P 24be9ebf5aff4ed787fbfd57e4f7e633: No bootstrap required, opened a new log
I20260808 14:48:16.258673 23320 ts_tablet_manager.cc:1397] T 4fce2f79d709481aaa374fe13ac6e7be P 24be9ebf5aff4ed787fbfd57e4f7e633: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260808 14:48:16.259009 23320 raft_consensus.cc:348] T 4fce2f79d709481aaa374fe13ac6e7be P 24be9ebf5aff4ed787fbfd57e4f7e633 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78f732c786474630ad34b76d0a05800b" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 42365 } } peers { permanent_uuid: "091ccdf967d949c9a2b8b03fcd48258c" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40261 } } peers { permanent_uuid: "24be9ebf5aff4ed787fbfd57e4f7e633" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38613 } }
I20260808 14:48:16.259090 23320 raft_consensus.cc:374] T 4fce2f79d709481aaa374fe13ac6e7be P 24be9ebf5aff4ed787fbfd57e4f7e633 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:48:16.259150 23320 raft_consensus.cc:729] T 4fce2f79d709481aaa374fe13ac6e7be P 24be9ebf5aff4ed787fbfd57e4f7e633 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24be9ebf5aff4ed787fbfd57e4f7e633, State: Initialized, Role: FOLLOWER
I20260808 14:48:16.259198 23320 consensus_queue.cc:260] T 4fce2f79d709481aaa374fe13ac6e7be P 24be9ebf5aff4ed787fbfd57e4f7e633 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78f732c786474630ad34b76d0a05800b" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 42365 } } peers { permanent_uuid: "091ccdf967d949c9a2b8b03fcd48258c" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40261 } } peers { permanent_uuid: "24be9ebf5aff4ed787fbfd57e4f7e633" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38613 } }
I20260808 14:48:16.259290 23320 ts_tablet_manager.cc:1428] T 4fce2f79d709481aaa374fe13ac6e7be P 24be9ebf5aff4ed787fbfd57e4f7e633: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260808 14:48:16.259646 23902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:16.255275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.131:40261 (local address 127.0.0.1:54970)
0808 14:48:16.255451 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:16.255462 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:48:16.255521 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:48:16.255853 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:48:16.255854 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:48:16.255857 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:48:16.255920 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:16.255922 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:16.257269 (+ 1347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:16.257270 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:16.258548 (+ 1278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:16.258551 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:16.259374 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:16.259375 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:16.259438 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:16.259461 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 14:48:16.259515 (+ 54us) client_negotiation.cc:240] Negotiation successful
0808 14:48:16.259562 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"mutex_wait_us":21,"thread_start_us":98,"threads_started":1}
I20260808 14:48:16.259932 23904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:16.255538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54970 (local address 127.30.214.131:40261)
0808 14:48:16.255697 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0808 14:48:16.255701 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:48:16.255709 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:48:16.255742 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:48:16.255744 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:48:16.255756 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:48:16.255826 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:48:16.256090 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:16.257171 (+ 1081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:16.258626 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:16.259193 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:16.259265 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:16.259323 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 14:48:16.259801 (+ 478us) server_negotiation.cc:299] Negotiation successful
0808 14:48:16.259850 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":91,"threads_started":1}
I20260808 14:48:16.260619 23787 tablet_service.cc:1467] Processing CreateTablet for tablet 4fce2f79d709481aaa374fe13ac6e7be (DEFAULT_TABLE table=test-table [id=f42bf7024e18411aad01cc1a27a8577e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:48:16.260913 23787 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4fce2f79d709481aaa374fe13ac6e7be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:48:16.262456 23903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:16.255434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50038 (local address 127.30.214.130:42365)
0808 14:48:16.257713 (+ 2279us) server_negotiation.cc:206] Beginning negotiation
0808 14:48:16.257717 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:48:16.257728 (+ 11us) server_negotiation.cc:407] Connection header received
0808 14:48:16.257765 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:48:16.257768 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:48:16.257784 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:48:16.257888 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:48:16.258007 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:16.259034 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:16.261558 (+ 2524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:16.262108 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:16.262165 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:16.262200 (+ 35us) server_negotiation.cc:1035] Waiting for connection context
0808 14:48:16.262356 (+ 156us) server_negotiation.cc:299] Negotiation successful
0808 14:48:16.262389 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2233,"thread_start_us":112,"threads_started":1}
I20260808 14:48:16.262457 23493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:16.255275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.130:42365 (local address 127.0.0.1:50038)
0808 14:48:16.255332 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:16.255343 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:48:16.255382 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:48:16.257888 (+ 2506us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:48:16.257890 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:48:16.257891 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:48:16.257939 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:16.257941 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:16.259141 (+ 1200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:16.259142 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:16.260173 (+ 1031us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:16.260176 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:16.262189 (+ 2013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:16.262190 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:16.262271 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:16.262277 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 14:48:16.262334 (+ 57us) client_negotiation.cc:240] Negotiation successful
0808 14:48:16.262385 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260808 14:48:16.263077 23595 tablet_service.cc:1467] Processing CreateTablet for tablet 4fce2f79d709481aaa374fe13ac6e7be (DEFAULT_TABLE table=test-table [id=f42bf7024e18411aad01cc1a27a8577e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:48:16.263360 23595 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4fce2f79d709481aaa374fe13ac6e7be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:48:16.263962 23906 tablet_bootstrap.cc:492] T 4fce2f79d709481aaa374fe13ac6e7be P 091ccdf967d949c9a2b8b03fcd48258c: Bootstrap starting.
I20260808 14:48:16.264680 23906 tablet_bootstrap.cc:654] T 4fce2f79d709481aaa374fe13ac6e7be P 091ccdf967d949c9a2b8b03fcd48258c: Neither blocks nor log segments found. Creating new log.
I20260808 14:48:16.265221 23906 log.cc:824] T 4fce2f79d709481aaa374fe13ac6e7be P 091ccdf967d949c9a2b8b03fcd48258c: Log is configured to *not* fsync() on all Append() calls
I20260808 14:48:16.265960 23906 tablet_bootstrap.cc:492] T 4fce2f79d709481aaa374fe13ac6e7be P 091ccdf967d949c9a2b8b03fcd48258c: No bootstrap required, opened a new log
I20260808 14:48:16.266028 23906 ts_tablet_manager.cc:1397] T 4fce2f79d709481aaa374fe13ac6e7be P 091ccdf967d949c9a2b8b03fcd48258c: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:48:16.266182 23913 tablet_bootstrap.cc:492] T 4fce2f79d709481aaa374fe13ac6e7be P 78f732c786474630ad34b76d0a05800b: Bootstrap starting.
I20260808 14:48:16.266789 23913 tablet_bootstrap.cc:654] T 4fce2f79d709481aaa374fe13ac6e7be P 78f732c786474630ad34b76d0a05800b: Neither blocks nor log segments found. Creating new log.
I20260808 14:48:16.267252 23913 log.cc:824] T 4fce2f79d709481aaa374fe13ac6e7be P 78f732c786474630ad34b76d0a05800b: Log is configured to *not* fsync() on all Append() calls
I20260808 14:48:16.267555 23906 raft_consensus.cc:348] T 4fce2f79d709481aaa374fe13ac6e7be P 091ccdf967d949c9a2b8b03fcd48258c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78f732c786474630ad34b76d0a05800b" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 42365 } } peers { permanent_uuid: "091ccdf967d949c9a2b8b03fcd48258c" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40261 } } peers { permanent_uuid: "24be9ebf5aff4ed787fbfd57e4f7e633" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38613 } }
I20260808 14:48:16.267740 23906 raft_consensus.cc:374] T 4fce2f79d709481aaa374fe13ac6e7be P 091ccdf967d949c9a2b8b03fcd48258c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:48:16.267786 23906 raft_consensus.cc:729] T 4fce2f79d709481aaa374fe13ac6e7be P 091ccdf967d949c9a2b8b03fcd48258c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 091ccdf967d949c9a2b8b03fcd48258c, State: Initialized, Role: FOLLOWER
I20260808 14:48:16.267920 23906 consensus_queue.cc:260] T 4fce2f79d709481aaa374fe13ac6e7be P 091ccdf967d949c9a2b8b03fcd48258c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78f732c786474630ad34b76d0a05800b" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 42365 } } peers { permanent_uuid: "091ccdf967d949c9a2b8b03fcd48258c" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40261 } } peers { permanent_uuid: "24be9ebf5aff4ed787fbfd57e4f7e633" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38613 } }
I20260808 14:48:16.267995 23913 tablet_bootstrap.cc:492] T 4fce2f79d709481aaa374fe13ac6e7be P 78f732c786474630ad34b76d0a05800b: No bootstrap required, opened a new log
I20260808 14:48:16.268064 23913 ts_tablet_manager.cc:1397] T 4fce2f79d709481aaa374fe13ac6e7be P 78f732c786474630ad34b76d0a05800b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:48:16.268224 23906 ts_tablet_manager.cc:1428] T 4fce2f79d709481aaa374fe13ac6e7be P 091ccdf967d949c9a2b8b03fcd48258c: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:48:16.268319 23895 heartbeater.cc:503] Master 127.30.214.190:40141 was elected leader, sending a full tablet report...
I20260808 14:48:16.269711 23913 raft_consensus.cc:348] T 4fce2f79d709481aaa374fe13ac6e7be P 78f732c786474630ad34b76d0a05800b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78f732c786474630ad34b76d0a05800b" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 42365 } } peers { permanent_uuid: "091ccdf967d949c9a2b8b03fcd48258c" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40261 } } peers { permanent_uuid: "24be9ebf5aff4ed787fbfd57e4f7e633" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38613 } }
I20260808 14:48:16.269842 23913 raft_consensus.cc:374] T 4fce2f79d709481aaa374fe13ac6e7be P 78f732c786474630ad34b76d0a05800b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:48:16.269874 23913 raft_consensus.cc:729] T 4fce2f79d709481aaa374fe13ac6e7be P 78f732c786474630ad34b76d0a05800b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78f732c786474630ad34b76d0a05800b, State: Initialized, Role: FOLLOWER
I20260808 14:48:16.269980 23913 consensus_queue.cc:260] T 4fce2f79d709481aaa374fe13ac6e7be P 78f732c786474630ad34b76d0a05800b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78f732c786474630ad34b76d0a05800b" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 42365 } } peers { permanent_uuid: "091ccdf967d949c9a2b8b03fcd48258c" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40261 } } peers { permanent_uuid: "24be9ebf5aff4ed787fbfd57e4f7e633" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38613 } }
I20260808 14:48:16.270215 23913 ts_tablet_manager.cc:1428] T 4fce2f79d709481aaa374fe13ac6e7be P 78f732c786474630ad34b76d0a05800b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:48:16.270268 23690 heartbeater.cc:503] Master 127.30.214.190:40141 was elected leader, sending a full tablet report...
W20260808 14:48:16.332854 23691 tablet.cc:2369] T 4fce2f79d709481aaa374fe13ac6e7be P 78f732c786474630ad34b76d0a05800b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:48:16.450839 23480 tablet.cc:2369] T 4fce2f79d709481aaa374fe13ac6e7be P 24be9ebf5aff4ed787fbfd57e4f7e633: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:48:16.471480 23896 tablet.cc:2369] T 4fce2f79d709481aaa374fe13ac6e7be P 091ccdf967d949c9a2b8b03fcd48258c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:48:16.498898 23492 raft_consensus.cc:482] T 4fce2f79d709481aaa374fe13ac6e7be P 24be9ebf5aff4ed787fbfd57e4f7e633 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:48:16.499051 23492 raft_consensus.cc:504] T 4fce2f79d709481aaa374fe13ac6e7be P 24be9ebf5aff4ed787fbfd57e4f7e633 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78f732c786474630ad34b76d0a05800b" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 42365 } } peers { permanent_uuid: "091ccdf967d949c9a2b8b03fcd48258c" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40261 } } peers { permanent_uuid: "24be9ebf5aff4ed787fbfd57e4f7e633" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38613 } }
I20260808 14:48:16.499399 23492 leader_election.cc:288] T 4fce2f79d709481aaa374fe13ac6e7be P 24be9ebf5aff4ed787fbfd57e4f7e633 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 78f732c786474630ad34b76d0a05800b (127.30.214.130:42365), 091ccdf967d949c9a2b8b03fcd48258c (127.30.214.131:40261)
I20260808 14:48:16.501854 23915 raft_consensus.cc:482] T 4fce2f79d709481aaa374fe13ac6e7be P 091ccdf967d949c9a2b8b03fcd48258c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:48:16.501995 23915 raft_consensus.cc:504] T 4fce2f79d709481aaa374fe13ac6e7be P 091ccdf967d949c9a2b8b03fcd48258c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78f732c786474630ad34b76d0a05800b" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 42365 } } peers { permanent_uuid: "091ccdf967d949c9a2b8b03fcd48258c" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40261 } } peers { permanent_uuid: "24be9ebf5aff4ed787fbfd57e4f7e633" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38613 } }
I20260808 14:48:16.502367 23915 leader_election.cc:288] T 4fce2f79d709481aaa374fe13ac6e7be P 091ccdf967d949c9a2b8b03fcd48258c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 78f732c786474630ad34b76d0a05800b (127.30.214.130:42365), 24be9ebf5aff4ed787fbfd57e4f7e633 (127.30.214.129:38613)
I20260808 14:48:16.502966 23903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:16.499652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.129:57833 (local address 127.30.214.130:42365)
0808 14:48:16.499701 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 14:48:16.499703 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:48:16.499804 (+ 101us) server_negotiation.cc:407] Connection header received
0808 14:48:16.499870 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:48:16.499871 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:48:16.499888 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:48:16.499934 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:48:16.500058 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:16.500531 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:16.501936 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:16.502486 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:16.502547 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:16.502555 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 14:48:16.502844 (+ 289us) server_negotiation.cc:299] Negotiation successful
0808 14:48:16.502896 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 14:48:16.503067 23904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:16.499705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.129:38903 (local address 127.30.214.131:40261)
0808 14:48:16.499761 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 14:48:16.499763 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:48:16.499790 (+ 27us) server_negotiation.cc:407] Connection header received
0808 14:48:16.499883 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:48:16.499884 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:48:16.499893 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:48:16.499940 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:48:16.500096 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:16.500571 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:16.501895 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:16.502472 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:16.502547 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:16.502555 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 14:48:16.502956 (+ 401us) server_negotiation.cc:299] Negotiation successful
0808 14:48:16.503013 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 14:48:16.503219 23918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:16.499581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.130:42365 (local address 127.30.214.129:57833)
0808 14:48:16.499725 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:16.499736 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:48:16.499811 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:48:16.499943 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:48:16.499944 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:48:16.499946 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:48:16.500006 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:16.500008 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:16.500625 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:16.500626 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:16.501802 (+ 1176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:16.501806 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:16.502595 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:16.502596 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:16.502718 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:16.502753 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 14:48:16.503090 (+ 337us) client_negotiation.cc:240] Negotiation successful
0808 14:48:16.503141 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":67,"threads_started":1}
I20260808 14:48:16.503278 23919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:16.499601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.131:40261 (local address 127.30.214.129:38903)
0808 14:48:16.499727 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:16.499737 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:48:16.499801 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:48:16.499954 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:48:16.499955 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:48:16.499956 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:48:16.500031 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:16.500033 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:16.500665 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:16.500666 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:16.501807 (+ 1141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:16.501810 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:16.502822 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:16.502823 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:16.502878 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:16.502881 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:48:16.503153 (+ 272us) client_negotiation.cc:240] Negotiation successful
0808 14:48:16.503186 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"mutex_wait_us":9,"thread_start_us":63,"threads_started":1}
I20260808 14:48:16.503566 23822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fce2f79d709481aaa374fe13ac6e7be" candidate_uuid: "24be9ebf5aff4ed787fbfd57e4f7e633" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "091ccdf967d949c9a2b8b03fcd48258c" is_pre_election: true
I20260808 14:48:16.503576 23626 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fce2f79d709481aaa374fe13ac6e7be" candidate_uuid: "24be9ebf5aff4ed787fbfd57e4f7e633" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78f732c786474630ad34b76d0a05800b" is_pre_election: true
I20260808 14:48:16.503682 23822 raft_consensus.cc:2454] T 4fce2f79d709481aaa374fe13ac6e7be P 091ccdf967d949c9a2b8b03fcd48258c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24be9ebf5aff4ed787fbfd57e4f7e633 in term 0.
I20260808 14:48:16.503724 23626 raft_consensus.cc:2454] T 4fce2f79d709481aaa374fe13ac6e7be P 78f732c786474630ad34b76d0a05800b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24be9ebf5aff4ed787fbfd57e4f7e633 in term 0.
I20260808 14:48:16.503892 23312 leader_election.cc:302] T 4fce2f79d709481aaa374fe13ac6e7be P 24be9ebf5aff4ed787fbfd57e4f7e633 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 091ccdf967d949c9a2b8b03fcd48258c, 24be9ebf5aff4ed787fbfd57e4f7e633; no voters:
I20260808 14:48:16.504045 23492 raft_consensus.cc:2781] T 4fce2f79d709481aaa374fe13ac6e7be P 24be9ebf5aff4ed787fbfd57e4f7e633 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:48:16.504094 23492 raft_consensus.cc:482] T 4fce2f79d709481aaa374fe13ac6e7be P 24be9ebf5aff4ed787fbfd57e4f7e633 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:48:16.504148 23492 raft_consensus.cc:3037] T 4fce2f79d709481aaa374fe13ac6e7be P 24be9ebf5aff4ed787fbfd57e4f7e633 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:48:16.505012 23492 raft_consensus.cc:504] T 4fce2f79d709481aaa374fe13ac6e7be P 24be9ebf5aff4ed787fbfd57e4f7e633 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78f732c786474630ad34b76d0a05800b" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 42365 } } peers { permanent_uuid: "091ccdf967d949c9a2b8b03fcd48258c" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40261 } } peers { permanent_uuid: "24be9ebf5aff4ed787fbfd57e4f7e633" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38613 } }
I20260808 14:48:16.505152 23492 leader_election.cc:288] T 4fce2f79d709481aaa374fe13ac6e7be P 24be9ebf5aff4ed787fbfd57e4f7e633 [CANDIDATE]: Term 1 election: Requested vote from peers 78f732c786474630ad34b76d0a05800b (127.30.214.130:42365), 091ccdf967d949c9a2b8b03fcd48258c (127.30.214.131:40261)
I20260808 14:48:16.505354 23626 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fce2f79d709481aaa374fe13ac6e7be" candidate_uuid: "24be9ebf5aff4ed787fbfd57e4f7e633" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78f732c786474630ad34b76d0a05800b"
I20260808 14:48:16.505457 23626 raft_consensus.cc:3037] T 4fce2f79d709481aaa374fe13ac6e7be P 78f732c786474630ad34b76d0a05800b [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:48:16.506206 23626 raft_consensus.cc:2454] T 4fce2f79d709481aaa374fe13ac6e7be P 78f732c786474630ad34b76d0a05800b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24be9ebf5aff4ed787fbfd57e4f7e633 in term 1.
I20260808 14:48:16.506373 23315 leader_election.cc:302] T 4fce2f79d709481aaa374fe13ac6e7be P 24be9ebf5aff4ed787fbfd57e4f7e633 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24be9ebf5aff4ed787fbfd57e4f7e633, 78f732c786474630ad34b76d0a05800b; no voters:
I20260808 14:48:16.506399 23897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:16.502499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.130:42365 (local address 127.30.214.131:51569)
0808 14:48:16.502549 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:16.502559 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:48:16.502593 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:48:16.502875 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:48:16.502876 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:48:16.502877 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:48:16.502936 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:16.502937 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:16.504371 (+ 1434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:16.504372 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:16.505334 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:16.505337 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:16.506117 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:16.506118 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:16.506192 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:16.506196 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:48:16.506261 (+ 65us) client_negotiation.cc:240] Negotiation successful
0808 14:48:16.506305 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260808 14:48:16.506426 23922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:16.502688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.129:38613 (local address 127.30.214.131:33305)
0808 14:48:16.502840 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:16.502850 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:48:16.502900 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:48:16.503466 (+ 566us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:48:16.503467 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:48:16.503469 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:48:16.503538 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:16.503539 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:16.504502 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:16.504503 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:16.505300 (+ 797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:16.505303 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:16.506157 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:16.506159 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:16.506232 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:16.506236 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:48:16.506284 (+ 48us) client_negotiation.cc:240] Negotiation successful
0808 14:48:16.506322 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":86,"threads_started":1}
I20260808 14:48:16.506620 23923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:16.502730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:33305 (local address 127.30.214.129:38613)
0808 14:48:16.503334 (+ 604us) server_negotiation.cc:206] Beginning negotiation
0808 14:48:16.503336 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:48:16.503344 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:48:16.503365 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:48:16.503366 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:48:16.503374 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:48:16.503427 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:48:16.503603 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:16.504428 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:16.505374 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:16.506030 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:16.506099 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:16.506154 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 14:48:16.506516 (+ 362us) server_negotiation.cc:299] Negotiation successful
0808 14:48:16.506555 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":588,"thread_start_us":51,"threads_started":1}
I20260808 14:48:16.506623 23492 raft_consensus.cc:2781] T 4fce2f79d709481aaa374fe13ac6e7be P 24be9ebf5aff4ed787fbfd57e4f7e633 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:48:16.506642 23822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fce2f79d709481aaa374fe13ac6e7be" candidate_uuid: "24be9ebf5aff4ed787fbfd57e4f7e633" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "091ccdf967d949c9a2b8b03fcd48258c"
I20260808 14:48:16.506712 23822 raft_consensus.cc:3037] T 4fce2f79d709481aaa374fe13ac6e7be P 091ccdf967d949c9a2b8b03fcd48258c [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:48:16.506773 23492 raft_consensus.cc:686] T 4fce2f79d709481aaa374fe13ac6e7be P 24be9ebf5aff4ed787fbfd57e4f7e633 [term 1 LEADER]: Becoming Leader. State: Replica: 24be9ebf5aff4ed787fbfd57e4f7e633, State: Running, Role: LEADER
I20260808 14:48:16.506644 23920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:16.502562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:51569 (local address 127.30.214.130:42365)
0808 14:48:16.502741 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0808 14:48:16.502742 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:48:16.502750 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:48:16.502772 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:48:16.502773 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:48:16.502781 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:48:16.502993 (+ 212us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:48:16.503023 (+ 30us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:16.504284 (+ 1261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:16.505413 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:16.506024 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:16.506098 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:16.506106 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 14:48:16.506322 (+ 216us) server_negotiation.cc:299] Negotiation successful
0808 14:48:16.506359 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":91,"threads_started":1}
I20260808 14:48:16.506841 23492 consensus_queue.cc:237] T 4fce2f79d709481aaa374fe13ac6e7be P 24be9ebf5aff4ed787fbfd57e4f7e633 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78f732c786474630ad34b76d0a05800b" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 42365 } } peers { permanent_uuid: "091ccdf967d949c9a2b8b03fcd48258c" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40261 } } peers { permanent_uuid: "24be9ebf5aff4ed787fbfd57e4f7e633" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38613 } }
I20260808 14:48:16.506844 23414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fce2f79d709481aaa374fe13ac6e7be" candidate_uuid: "091ccdf967d949c9a2b8b03fcd48258c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24be9ebf5aff4ed787fbfd57e4f7e633" is_pre_election: true
I20260808 14:48:16.507351 23626 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fce2f79d709481aaa374fe13ac6e7be" candidate_uuid: "091ccdf967d949c9a2b8b03fcd48258c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78f732c786474630ad34b76d0a05800b" is_pre_election: true
I20260808 14:48:16.507459 23626 raft_consensus.cc:2379] T 4fce2f79d709481aaa374fe13ac6e7be P 78f732c786474630ad34b76d0a05800b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 091ccdf967d949c9a2b8b03fcd48258c in current term 1: Already voted for candidate 24be9ebf5aff4ed787fbfd57e4f7e633 in this term.
I20260808 14:48:16.507592 23822 raft_consensus.cc:2454] T 4fce2f79d709481aaa374fe13ac6e7be P 091ccdf967d949c9a2b8b03fcd48258c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24be9ebf5aff4ed787fbfd57e4f7e633 in term 1.
I20260808 14:48:16.507680 23720 leader_election.cc:302] T 4fce2f79d709481aaa374fe13ac6e7be P 091ccdf967d949c9a2b8b03fcd48258c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 091ccdf967d949c9a2b8b03fcd48258c; no voters: 24be9ebf5aff4ed787fbfd57e4f7e633, 78f732c786474630ad34b76d0a05800b
I20260808 14:48:16.507596 23193 catalog_manager.cc:5495] T 4fce2f79d709481aaa374fe13ac6e7be P 24be9ebf5aff4ed787fbfd57e4f7e633 reported cstate change: term changed from 0 to 1, leader changed from <none> to 24be9ebf5aff4ed787fbfd57e4f7e633 (127.30.214.129). New cstate: current_term: 1 leader_uuid: "24be9ebf5aff4ed787fbfd57e4f7e633" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78f732c786474630ad34b76d0a05800b" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "091ccdf967d949c9a2b8b03fcd48258c" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40261 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24be9ebf5aff4ed787fbfd57e4f7e633" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38613 } health_report { overall_health: HEALTHY } } }
I20260808 14:48:16.507790 23915 raft_consensus.cc:2726] T 4fce2f79d709481aaa374fe13ac6e7be P 091ccdf967d949c9a2b8b03fcd48258c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260808 14:48:16.541886 23923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:16.539678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39842 (local address 127.30.214.129:38613)
0808 14:48:16.539740 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 14:48:16.539742 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:48:16.539750 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:48:16.539793 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:48:16.539794 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:48:16.539812 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:48:16.539870 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:48:16.539994 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:16.540473 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:16.541161 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:16.541355 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:16.541419 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:16.541581 (+ 162us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:48:16.541686 (+ 105us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:48:16.541749 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 14:48:16.541784 (+ 35us) server_negotiation.cc:299] Negotiation successful
0808 14:48:16.541807 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 14:48:16.545261 23626 raft_consensus.cc:1261] T 4fce2f79d709481aaa374fe13ac6e7be P 78f732c786474630ad34b76d0a05800b [term 1 FOLLOWER]: Refusing update from remote peer 24be9ebf5aff4ed787fbfd57e4f7e633: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:48:16.545617 23822 raft_consensus.cc:1261] T 4fce2f79d709481aaa374fe13ac6e7be P 091ccdf967d949c9a2b8b03fcd48258c [term 1 FOLLOWER]: Refusing update from remote peer 24be9ebf5aff4ed787fbfd57e4f7e633: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:48:16.545589 23492 consensus_queue.cc:1035] T 4fce2f79d709481aaa374fe13ac6e7be P 24be9ebf5aff4ed787fbfd57e4f7e633 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78f732c786474630ad34b76d0a05800b" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:48:16.545849 23492 consensus_queue.cc:1035] T 4fce2f79d709481aaa374fe13ac6e7be P 24be9ebf5aff4ed787fbfd57e4f7e633 [LEADER]: Connected to new peer: Peer: permanent_uuid: "091ccdf967d949c9a2b8b03fcd48258c" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:48:16.548211 23932 mvcc.cc:205] Tried to move back new op lower bound from 7316277233846812672 to 7316277233692700672. Current Snapshot: MvccSnapshot[applied={T|T < 7316277233846812672}]
I20260808 14:48:16.548674 23934 mvcc.cc:205] Tried to move back new op lower bound from 7316277233846812672 to 7316277233692700672. Current Snapshot: MvccSnapshot[applied={T|T < 7316277233846812672}]
I20260808 14:48:16.548874 23933 mvcc.cc:205] Tried to move back new op lower bound from 7316277233846812672 to 7316277233692700672. Current Snapshot: MvccSnapshot[applied={T|T < 7316277233846812672}]
I20260808 14:48:16.550237 23183 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54468:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:48:16.550343 23183 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54468:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:48:16.551070 23183 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f7d2284723d74dd7b9e1b0f3e3b1cc1c: Sending DeleteTablet for 3 replicas of tablet 4fce2f79d709481aaa374fe13ac6e7be
I20260808 14:48:16.551407 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 23254
I20260808 14:48:16.551451 23787 tablet_service.cc:1514] Processing DeleteTablet for tablet 4fce2f79d709481aaa374fe13ac6e7be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:48:16 UTC) from {username='kudu', principal='kudu/127.30.214.190@KRBTEST.COM'} at 127.0.0.1:54970
I20260808 14:48:16.551468 23382 tablet_service.cc:1514] Processing DeleteTablet for tablet 4fce2f79d709481aaa374fe13ac6e7be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:48:16 UTC) from {username='kudu', principal='kudu/127.30.214.190@KRBTEST.COM'} at 127.0.0.1:39836
I20260808 14:48:16.551908 23595 tablet_service.cc:1514] Processing DeleteTablet for tablet 4fce2f79d709481aaa374fe13ac6e7be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:48:16 UTC) from {username='kudu', principal='kudu/127.30.214.190@KRBTEST.COM'} at 127.0.0.1:50038
I20260808 14:48:16.552119 23955 tablet_replica.cc:330] T 4fce2f79d709481aaa374fe13ac6e7be P 78f732c786474630ad34b76d0a05800b: stopping tablet replica
I20260808 14:48:16.552198 23955 raft_consensus.cc:2229] T 4fce2f79d709481aaa374fe13ac6e7be P 78f732c786474630ad34b76d0a05800b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:48:16.552268 23955 raft_consensus.cc:2258] T 4fce2f79d709481aaa374fe13ac6e7be P 78f732c786474630ad34b76d0a05800b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:48:16.552671 23955 ts_tablet_manager.cc:1905] T 4fce2f79d709481aaa374fe13ac6e7be P 78f732c786474630ad34b76d0a05800b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:48:16.555552 23955 ts_tablet_manager.cc:1918] T 4fce2f79d709481aaa374fe13ac6e7be P 78f732c786474630ad34b76d0a05800b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:48:16.555670 23955 log.cc:1196] T 4fce2f79d709481aaa374fe13ac6e7be P 78f732c786474630ad34b76d0a05800b: Deleting WAL directory at /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-1/wal/wals/4fce2f79d709481aaa374fe13ac6e7be
I20260808 14:48:16.556270 23955 ts_tablet_manager.cc:1939] T 4fce2f79d709481aaa374fe13ac6e7be P 78f732c786474630ad34b76d0a05800b: Deleting consensus metadata
I20260808 14:48:16.556815 23159 catalog_manager.cc:4841] TS 78f732c786474630ad34b76d0a05800b (127.30.214.130:42365): tablet 4fce2f79d709481aaa374fe13ac6e7be (table test-table [id=f42bf7024e18411aad01cc1a27a8577e]) successfully deleted
I20260808 14:48:16.561582 23950 tablet_replica.cc:330] T 4fce2f79d709481aaa374fe13ac6e7be P 091ccdf967d949c9a2b8b03fcd48258c: stopping tablet replica
I20260808 14:48:16.561723 23950 raft_consensus.cc:2229] T 4fce2f79d709481aaa374fe13ac6e7be P 091ccdf967d949c9a2b8b03fcd48258c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:48:16.561849 23950 raft_consensus.cc:2258] T 4fce2f79d709481aaa374fe13ac6e7be P 091ccdf967d949c9a2b8b03fcd48258c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:48:16.562291 23950 ts_tablet_manager.cc:1905] T 4fce2f79d709481aaa374fe13ac6e7be P 091ccdf967d949c9a2b8b03fcd48258c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:48:16.563623 23950 ts_tablet_manager.cc:1918] T 4fce2f79d709481aaa374fe13ac6e7be P 091ccdf967d949c9a2b8b03fcd48258c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:48:16.563689 23950 log.cc:1196] T 4fce2f79d709481aaa374fe13ac6e7be P 091ccdf967d949c9a2b8b03fcd48258c: Deleting WAL directory at /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-2/wal/wals/4fce2f79d709481aaa374fe13ac6e7be
I20260808 14:48:16.564235 23950 ts_tablet_manager.cc:1939] T 4fce2f79d709481aaa374fe13ac6e7be P 091ccdf967d949c9a2b8b03fcd48258c: Deleting consensus metadata
W20260808 14:48:16.564332 23158 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.30.214.129:38613 (error 108)
I20260808 14:48:16.564630 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 23491
I20260808 14:48:16.564654 23158 catalog_manager.cc:4841] TS 091ccdf967d949c9a2b8b03fcd48258c (127.30.214.131:40261): tablet 4fce2f79d709481aaa374fe13ac6e7be (table test-table [id=f42bf7024e18411aad01cc1a27a8577e]) successfully deleted
I20260808 14:48:16.570783 23493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:16.570604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.129:38613 (local address 127.0.0.1:39854)
0808 14:48:16.570678 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:16.570741 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.129:38613: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260808 14:48:16.570938 23158 catalog_manager.cc:4584] TS 24be9ebf5aff4ed787fbfd57e4f7e633 (127.30.214.129:38613): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4fce2f79d709481aaa374fe13ac6e7be: Network error: Client connection negotiation failed: client connection to 127.30.214.129:38613: connect: Connection refused (error 111)
I20260808 14:48:16.573928 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 23693
I20260808 14:48:16.587917 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 23133
I20260808 14:48:36.597872 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:40141
--webserver_interface=127.30.214.190
--webserver_port=35789
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab
--principal=kudu/127.30.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:43459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.214.190:40141
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:48:36.686702 23959 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:48:36.686934 23959 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:48:36.686956 23959 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:48:36.688159 23959 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 14:48:36.688210 23959 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 14:48:36.688222 23959 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 14:48:36.688233 23959 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:48:36.688246 23959 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:48:36.688268 23959 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:48:36.688292 23959 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:48:36.688315 23959 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:48:36.689955 23959 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:43459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.30.214.190:40141
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab
--principal=kudu/127.30.214.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:40141
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.214.190
--webserver_port=35789
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23959
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:48:36.690233 23959 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:48:36.690482 23959 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:48:36.695786 23965 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:48:36.695823 23959 server_base.cc:1034] running on GCE node
W20260808 14:48:36.695776 23964 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:48:36.695777 23967 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:48:36.696290 23959 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:48:36.696607 23959 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:48:36.697746 23959 hybrid_clock.cc:648] HybridClock initialized: now 1786200516697732 us; error 37 us; skew 500 ppm
Aug 08 14:48:36 dist-test-slave-42z9 krb5kdc[22329](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200516, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:48:36.703418 23959 init.cc:377] Logged in from keytab as kudu/127.30.214.190@KRBTEST.COM (short username kudu)
I20260808 14:48:36.703882 23959 webserver.cc:460] Webserver started at http://127.30.214.190:35789/ using document root <none> and password file <none>
I20260808 14:48:36.704111 23959 fs_manager.cc:359] Metadata directory not provided
I20260808 14:48:36.704154 23959 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:48:36.705502 23959 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:48:36.706142 23978 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:48:36.706301 23959 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:48:36.706393 23959 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/master-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/master-0/wal
uuid: "f7d2284723d74dd7b9e1b0f3e3b1cc1c"
format_stamp: "Formatted at 2026-08-08 14:47:54 on dist-test-slave-42z9"
server_key: "0cd964ee2b125eab145ef233ec332fc5"
server_key_iv: "711aaed7aa510dc685ff21cd67bb81c3"
server_key_version: "encryptionkey@0"
I20260808 14:48:36.706748 23959 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:48:36.719892 23959 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:48:36.722250 23959 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:48:36.722381 23959 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:48:36.726867 23959 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.190:40141
I20260808 14:48:36.726931 24054 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.190:40141 every 8 connection(s)
I20260808 14:48:36.727303 23959 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
I20260808 14:48:36.728899 24055 sys_catalog.cc:263] Verifying existing consensus state
I20260808 14:48:36.729681 24055 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f7d2284723d74dd7b9e1b0f3e3b1cc1c: Bootstrap starting.
I20260808 14:48:36.734707 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 23959
I20260808 14:48:36.735088 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.129:38613
--local_ip_for_outbound_sockets=127.30.214.129
--tserver_master_addrs=127.30.214.190:40141
--webserver_port=43837
--webserver_interface=127.30.214.129
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab
--principal=kudu/127.30.214.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:43459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:48:36.739125 24055 log.cc:824] T 00000000000000000000000000000000 P f7d2284723d74dd7b9e1b0f3e3b1cc1c: Log is configured to *not* fsync() on all Append() calls
I20260808 14:48:36.741724 24055 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f7d2284723d74dd7b9e1b0f3e3b1cc1c: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 14:48:36.742050 24055 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f7d2284723d74dd7b9e1b0f3e3b1cc1c: Bootstrap complete.
I20260808 14:48:36.744503 24055 raft_consensus.cc:348] T 00000000000000000000000000000000 P f7d2284723d74dd7b9e1b0f3e3b1cc1c [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7d2284723d74dd7b9e1b0f3e3b1cc1c" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 40141 } }
I20260808 14:48:36.744915 24055 raft_consensus.cc:729] T 00000000000000000000000000000000 P f7d2284723d74dd7b9e1b0f3e3b1cc1c [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7d2284723d74dd7b9e1b0f3e3b1cc1c, State: Initialized, Role: FOLLOWER
I20260808 14:48:36.745149 24055 consensus_queue.cc:260] T 00000000000000000000000000000000 P f7d2284723d74dd7b9e1b0f3e3b1cc1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7d2284723d74dd7b9e1b0f3e3b1cc1c" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 40141 } }
I20260808 14:48:36.745229 24055 raft_consensus.cc:388] T 00000000000000000000000000000000 P f7d2284723d74dd7b9e1b0f3e3b1cc1c [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:48:36.745280 24055 raft_consensus.cc:482] T 00000000000000000000000000000000 P f7d2284723d74dd7b9e1b0f3e3b1cc1c [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:48:36.745328 24055 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f7d2284723d74dd7b9e1b0f3e3b1cc1c [term 2 FOLLOWER]: Advancing to term 3
I20260808 14:48:36.746496 24055 raft_consensus.cc:504] T 00000000000000000000000000000000 P f7d2284723d74dd7b9e1b0f3e3b1cc1c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7d2284723d74dd7b9e1b0f3e3b1cc1c" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 40141 } }
I20260808 14:48:36.746609 24055 leader_election.cc:302] T 00000000000000000000000000000000 P f7d2284723d74dd7b9e1b0f3e3b1cc1c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f7d2284723d74dd7b9e1b0f3e3b1cc1c; no voters:
I20260808 14:48:36.746804 24055 leader_election.cc:288] T 00000000000000000000000000000000 P f7d2284723d74dd7b9e1b0f3e3b1cc1c [CANDIDATE]: Term 3 election: Requested vote from peers
I20260808 14:48:36.746860 24062 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f7d2284723d74dd7b9e1b0f3e3b1cc1c [term 3 FOLLOWER]: Leader election won for term 3
I20260808 14:48:36.746991 24062 raft_consensus.cc:686] T 00000000000000000000000000000000 P f7d2284723d74dd7b9e1b0f3e3b1cc1c [term 3 LEADER]: Becoming Leader. State: Replica: f7d2284723d74dd7b9e1b0f3e3b1cc1c, State: Running, Role: LEADER
I20260808 14:48:36.747107 24055 sys_catalog.cc:564] T 00000000000000000000000000000000 P f7d2284723d74dd7b9e1b0f3e3b1cc1c [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:48:36.747087 24062 consensus_queue.cc:237] T 00000000000000000000000000000000 P f7d2284723d74dd7b9e1b0f3e3b1cc1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7d2284723d74dd7b9e1b0f3e3b1cc1c" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 40141 } }
I20260808 14:48:36.747471 24065 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7d2284723d74dd7b9e1b0f3e3b1cc1c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "f7d2284723d74dd7b9e1b0f3e3b1cc1c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7d2284723d74dd7b9e1b0f3e3b1cc1c" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 40141 } } }
I20260808 14:48:36.747562 24065 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7d2284723d74dd7b9e1b0f3e3b1cc1c [sys.catalog]: This master's current role is: LEADER
I20260808 14:48:36.747807 24066 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7d2284723d74dd7b9e1b0f3e3b1cc1c [sys.catalog]: SysCatalogTable state changed. Reason: New leader f7d2284723d74dd7b9e1b0f3e3b1cc1c. Latest consensus state: current_term: 3 leader_uuid: "f7d2284723d74dd7b9e1b0f3e3b1cc1c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7d2284723d74dd7b9e1b0f3e3b1cc1c" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 40141 } } }
I20260808 14:48:36.747913 24066 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7d2284723d74dd7b9e1b0f3e3b1cc1c [sys.catalog]: This master's current role is: LEADER
I20260808 14:48:36.747926 24072 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:48:36.749130 24072 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:48:36.749236 24072 catalog_manager.cc:1259] Loaded cluster ID: 7cefac0c3be14a7ea82f936dc8062033
I20260808 14:48:36.749259 24072 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:48:36.750447 24072 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:48:36.750646 24072 catalog_manager.cc:5879] T 00000000000000000000000000000000 P f7d2284723d74dd7b9e1b0f3e3b1cc1c: Loaded TSK: 0
I20260808 14:48:36.750699 24072 catalog_manager.cc:5879] T 00000000000000000000000000000000 P f7d2284723d74dd7b9e1b0f3e3b1cc1c: Loaded TSK: 1
F20260808 14:48:36.750933 24072 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7ff6810689ad google::LogMessage::Fail() at ??:0
@ 0x7ff68106b88a google::LogMessage::SendToLog() at ??:0
@ 0x7ff6810684de google::LogMessage::Flush() at ??:0
@ 0x7ff681069a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7ff6837d5104 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7ff6837d2d41 kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7ff688fc21cd kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7ff688fc248e kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7ff688fc2594 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7ff688f88c48 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7ff688f92ad0 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7ff682f360d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7ff682f2b954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7ff683d8f6db start_thread at ??:0
@ 0x7ff67fb6661f clone at ??:0
W20260808 14:48:36.847205 24057 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:48:36.847506 24057 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:48:36.847548 24057 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:48:36.849396 24057 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:48:36.849504 24057 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:48:36.849552 24057 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.129
I20260808 14:48:36.851929 24057 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:43459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab
--principal=kudu/127.30.214.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.129:38613
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.214.129
--webserver_port=43837
--tserver_master_addrs=127.30.214.190:40141
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24057
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.129
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:48:36.852242 24057 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:48:36.852514 24057 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:48:36.858096 24122 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:48:36.858105 24124 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:48:36.858139 24126 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:48:36.858436 24057 server_base.cc:1034] running on GCE node
I20260808 14:48:36.858633 24057 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:48:36.858877 24057 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:48:36.860030 24057 hybrid_clock.cc:648] HybridClock initialized: now 1786200516860018 us; error 35 us; skew 500 ppm
Aug 08 14:48:36 dist-test-slave-42z9 krb5kdc[22329](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200516, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:48:36.862706 24057 init.cc:377] Logged in from keytab as kudu/127.30.214.129@KRBTEST.COM (short username kudu)
I20260808 14:48:36.863231 24057 webserver.cc:460] Webserver started at http://127.30.214.129:43837/ using document root <none> and password file <none>
I20260808 14:48:36.863458 24057 fs_manager.cc:359] Metadata directory not provided
I20260808 14:48:36.863508 24057 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:48:36.864912 24057 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:48:36.865648 24139 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:48:36.865813 24057 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:48:36.865901 24057 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-0/wal
uuid: "24be9ebf5aff4ed787fbfd57e4f7e633"
format_stamp: "Formatted at 2026-08-08 14:47:55 on dist-test-slave-42z9"
server_key: "c146464be7c83212c32cf0432cb63730"
server_key_iv: "703135265e862d7466370aa95f9b64df"
server_key_version: "encryptionkey@0"
I20260808 14:48:36.866267 24057 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:48:36.878985 24057 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:48:36.881131 24057 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:48:36.881274 24057 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:48:36.881595 24057 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:48:36.882071 24149 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 14:48:36.884150 24057 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 14:48:36.884198 24057 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260808 14:48:36.884233 24057 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 14:48:36.884895 24057 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 14:48:36.884929 24057 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260808 14:48:36.885027 24149 tablet_bootstrap.cc:492] T 4fce2f79d709481aaa374fe13ac6e7be P 24be9ebf5aff4ed787fbfd57e4f7e633: Bootstrap starting.
I20260808 14:48:36.891721 24057 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.129:38613
I20260808 14:48:36.891949 24328 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.129:38613 every 8 connection(s)
I20260808 14:48:36.892163 24057 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
I20260808 14:48:36.896158 24149 log.cc:824] T 4fce2f79d709481aaa374fe13ac6e7be P 24be9ebf5aff4ed787fbfd57e4f7e633: Log is configured to *not* fsync() on all Append() calls
I20260808 14:48:36.899106 24149 tablet_bootstrap.cc:492] T 4fce2f79d709481aaa374fe13ac6e7be P 24be9ebf5aff4ed787fbfd57e4f7e633: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 14:48:36.899456 24149 tablet_bootstrap.cc:492] T 4fce2f79d709481aaa374fe13ac6e7be P 24be9ebf5aff4ed787fbfd57e4f7e633: Bootstrap complete.
I20260808 14:48:36.900646 24149 ts_tablet_manager.cc:1397] T 4fce2f79d709481aaa374fe13ac6e7be P 24be9ebf5aff4ed787fbfd57e4f7e633: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.009s
I20260808 14:48:36.901942 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 24057
I20260808 14:48:36.902202 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.130:42365
--local_ip_for_outbound_sockets=127.30.214.130
--tserver_master_addrs=127.30.214.190:40141
--webserver_port=40757
--webserver_interface=127.30.214.130
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab
--principal=kudu/127.30.214.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:43459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:48:36.902122 24149 raft_consensus.cc:348] T 4fce2f79d709481aaa374fe13ac6e7be P 24be9ebf5aff4ed787fbfd57e4f7e633 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78f732c786474630ad34b76d0a05800b" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 42365 } } peers { permanent_uuid: "091ccdf967d949c9a2b8b03fcd48258c" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40261 } } peers { permanent_uuid: "24be9ebf5aff4ed787fbfd57e4f7e633" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38613 } }
I20260808 14:48:36.902462 24149 raft_consensus.cc:729] T 4fce2f79d709481aaa374fe13ac6e7be P 24be9ebf5aff4ed787fbfd57e4f7e633 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24be9ebf5aff4ed787fbfd57e4f7e633, State: Initialized, Role: FOLLOWER
I20260808 14:48:36.902630 24149 consensus_queue.cc:260] T 4fce2f79d709481aaa374fe13ac6e7be P 24be9ebf5aff4ed787fbfd57e4f7e633 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78f732c786474630ad34b76d0a05800b" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 42365 } } peers { permanent_uuid: "091ccdf967d949c9a2b8b03fcd48258c" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40261 } } peers { permanent_uuid: "24be9ebf5aff4ed787fbfd57e4f7e633" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38613 } }
I20260808 14:48:36.902925 24149 ts_tablet_manager.cc:1428] T 4fce2f79d709481aaa374fe13ac6e7be P 24be9ebf5aff4ed787fbfd57e4f7e633: Time spent starting tablet: real 0.002s user 0.005s sys 0.000s
W20260808 14:48:36.977705 24334 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:48:36.892872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:40141 (local address 127.30.214.129:54227)
0808 14:48:36.893542 (+ 670us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:36.893578 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 14:48:36.894028 (+ 450us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:48:36.977469 (+ 83441us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:40141: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":629,"thread_start_us":78,"threads_started":1}
W20260808 14:48:36.977988 24331 heartbeater.cc:644] Failed to heartbeat to 127.30.214.190:40141 (0 consecutive failures): Network error: Failed to ping master at 127.30.214.190:40141: Client connection negotiation failed: client connection to 127.30.214.190:40141: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 14:48:36.978315 24334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:36.978204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:40141 (local address 127.30.214.129:40845)
0808 14:48:36.978255 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:36.978294 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:40141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260808 14:48:36.978672 24334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:36.978589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:40141 (local address 127.30.214.129:34801)
0808 14:48:36.978632 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:36.978656 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:40141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260808 14:48:36.978780 24331 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 14:48:36.988312 24342 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:48:36.988541 24342 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:48:36.988576 24342 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:48:36.989859 24342 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:48:36.989914 24342 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:48:36.989954 24342 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.130
I20260808 14:48:36.991509 24342 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:43459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab
--principal=kudu/127.30.214.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.130:42365
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.214.130
--webserver_port=40757
--tserver_master_addrs=127.30.214.190:40141
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24342
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.130
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:48:36.991763 24342 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:48:36.991991 24342 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:48:36.997084 24350 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:48:36.997097 24354 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:48:36.997126 24357 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:48:36.997404 24342 server_base.cc:1034] running on GCE node
I20260808 14:48:36.997710 24342 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:48:36.997964 24342 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:48:36.999125 24342 hybrid_clock.cc:648] HybridClock initialized: now 1786200516999108 us; error 32 us; skew 500 ppm
Aug 08 14:48:36 dist-test-slave-42z9 krb5kdc[22329](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200516, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:48:37.001721 24342 init.cc:377] Logged in from keytab as kudu/127.30.214.130@KRBTEST.COM (short username kudu)
I20260808 14:48:37.002223 24342 webserver.cc:460] Webserver started at http://127.30.214.130:40757/ using document root <none> and password file <none>
I20260808 14:48:37.002460 24342 fs_manager.cc:359] Metadata directory not provided
I20260808 14:48:37.002512 24342 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:48:37.003944 24342 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:48:37.004544 24370 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:48:37.004700 24342 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:48:37.004779 24342 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-1/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-1/wal
uuid: "78f732c786474630ad34b76d0a05800b"
format_stamp: "Formatted at 2026-08-08 14:47:55 on dist-test-slave-42z9"
server_key: "4ebe4bc2375ed3478a0e4f86dd51ba99"
server_key_iv: "eea12add0d25be48f5750b1356039067"
server_key_version: "encryptionkey@0"
I20260808 14:48:37.005137 24342 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:48:37.024466 24342 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:48:37.026813 24342 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:48:37.026981 24342 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:48:37.027233 24342 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:48:37.027552 24342 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:48:37.027590 24342 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:48:37.027621 24342 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:48:37.027643 24342 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:48:37.033529 24342 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.130:42365
I20260808 14:48:37.033591 24550 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.130:42365 every 8 connection(s)
I20260808 14:48:37.033943 24342 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
I20260808 14:48:37.035362 24554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:37.034869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:40141 (local address 127.30.214.130:58973)
0808 14:48:37.035080 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:37.035184 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:40141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":97,"threads_started":1}
W20260808 14:48:37.035815 24551 heartbeater.cc:644] Failed to heartbeat to 127.30.214.190:40141 (0 consecutive failures): Network error: Failed to ping master at 127.30.214.190:40141: Client connection negotiation failed: client connection to 127.30.214.190:40141: connect: Connection refused (error 111)
I20260808 14:48:37.036113 24554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:37.036035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:40141 (local address 127.30.214.130:44461)
0808 14:48:37.036069 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:37.036096 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:40141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":16}
I20260808 14:48:37.036353 24554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:37.036298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:40141 (local address 127.30.214.130:56765)
0808 14:48:37.036321 (+ 23us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:37.036340 (+ 19us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:40141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":13}
W20260808 14:48:37.036454 24551 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 14:48:37.038672 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 24342
I20260808 14:48:37.038930 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.131:40261
--local_ip_for_outbound_sockets=127.30.214.131
--tserver_master_addrs=127.30.214.190:40141
--webserver_port=40853
--webserver_interface=127.30.214.131
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab
--principal=kudu/127.30.214.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:43459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:48:37.123018 24557 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:48:37.123253 24557 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:48:37.123279 24557 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:48:37.124442 24557 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:48:37.124480 24557 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:48:37.124506 24557 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.131
I20260808 14:48:37.126037 24557 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:43459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab
--principal=kudu/127.30.214.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.131:40261
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.214.131
--webserver_port=40853
--tserver_master_addrs=127.30.214.190:40141
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24557
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.131
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:48:37.126262 24557 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:48:37.126470 24557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:48:37.131955 24565 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:48:37.131978 24568 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:48:37.131959 24563 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:48:37.132910 24557 server_base.cc:1034] running on GCE node
I20260808 14:48:37.133140 24557 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:48:37.133386 24557 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:48:37.134541 24557 hybrid_clock.cc:648] HybridClock initialized: now 1786200517134524 us; error 37 us; skew 500 ppm
Aug 08 14:48:37 dist-test-slave-42z9 krb5kdc[22329](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200517, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:48:37.137102 24557 init.cc:377] Logged in from keytab as kudu/127.30.214.131@KRBTEST.COM (short username kudu)
I20260808 14:48:37.137641 24557 webserver.cc:460] Webserver started at http://127.30.214.131:40853/ using document root <none> and password file <none>
I20260808 14:48:37.137876 24557 fs_manager.cc:359] Metadata directory not provided
I20260808 14:48:37.137929 24557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:48:37.139339 24557 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:48:37.140141 24576 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:48:37.140393 24557 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:48:37.140508 24557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-2/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-2/wal
uuid: "091ccdf967d949c9a2b8b03fcd48258c"
format_stamp: "Formatted at 2026-08-08 14:47:55 on dist-test-slave-42z9"
server_key: "d630a513b439c1cd553942d9a74db351"
server_key_iv: "6fbc3bf5f1c25a791fc832b6b69bfa49"
server_key_version: "encryptionkey@0"
I20260808 14:48:37.140875 24557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:48:37.158463 24557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:48:37.160748 24557 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:48:37.160899 24557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:48:37.161144 24557 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:48:37.161494 24557 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:48:37.161535 24557 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:48:37.161566 24557 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:48:37.161589 24557 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:48:37.167594 24557 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.131:40261
I20260808 14:48:37.167655 24774 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.131:40261 every 8 connection(s)
I20260808 14:48:37.168006 24557 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
I20260808 14:48:37.169492 24778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:37.168929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:40141 (local address 127.30.214.131:40223)
0808 14:48:37.169195 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:37.169292 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:40141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":146,"threads_started":1}
W20260808 14:48:37.170236 24775 heartbeater.cc:644] Failed to heartbeat to 127.30.214.190:40141 (0 consecutive failures): Network error: Failed to ping master at 127.30.214.190:40141: Client connection negotiation failed: client connection to 127.30.214.190:40141: connect: Connection refused (error 111)
I20260808 14:48:37.170651 24778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:37.170544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:40141 (local address 127.30.214.131:34453)
0808 14:48:37.170594 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:37.170624 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:40141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260808 14:48:37.171185 24778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:37.171062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:40141 (local address 127.30.214.131:34563)
0808 14:48:37.171131 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:37.171160 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:40141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260808 14:48:37.171341 24775 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 14:48:37.175136 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 24557
I20260808 14:48:37.979609 24781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:37.979181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:40141 (local address 127.30.214.129:45597)
0808 14:48:37.979435 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:37.979513 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:40141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":73,"threads_started":1}
I20260808 14:48:38.037206 24785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:38.036910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:40141 (local address 127.30.214.130:49047)
0808 14:48:38.037086 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:38.037137 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:40141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":96,"threads_started":1}
I20260808 14:48:38.171926 24786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:38.171707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:40141 (local address 127.30.214.131:48065)
0808 14:48:38.171824 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:38.171866 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:40141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":64,"threads_started":1}
I20260808 14:48:38.269733 24787 raft_consensus.cc:482] T 4fce2f79d709481aaa374fe13ac6e7be P 24be9ebf5aff4ed787fbfd57e4f7e633 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:48:38.269878 24787 raft_consensus.cc:504] T 4fce2f79d709481aaa374fe13ac6e7be P 24be9ebf5aff4ed787fbfd57e4f7e633 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78f732c786474630ad34b76d0a05800b" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 42365 } } peers { permanent_uuid: "091ccdf967d949c9a2b8b03fcd48258c" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40261 } } peers { permanent_uuid: "24be9ebf5aff4ed787fbfd57e4f7e633" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38613 } }
I20260808 14:48:38.270219 24787 leader_election.cc:288] T 4fce2f79d709481aaa374fe13ac6e7be P 24be9ebf5aff4ed787fbfd57e4f7e633 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 78f732c786474630ad34b76d0a05800b (127.30.214.130:42365), 091ccdf967d949c9a2b8b03fcd48258c (127.30.214.131:40261)
Aug 08 14:48:38 dist-test-slave-42z9 krb5kdc[22329](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200516, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.129@KRBTEST.COM for kudu/127.30.214.131@KRBTEST.COM
Aug 08 14:48:38 dist-test-slave-42z9 krb5kdc[22329](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200516, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.129@KRBTEST.COM for kudu/127.30.214.130@KRBTEST.COM
I20260808 14:48:38.283740 24790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:38.270604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.129:42971 (local address 127.30.214.131:40261)
0808 14:48:38.270770 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0808 14:48:38.270787 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 14:48:38.270840 (+ 53us) server_negotiation.cc:407] Connection header received
0808 14:48:38.271585 (+ 745us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:48:38.271589 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:48:38.271662 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:48:38.271858 (+ 196us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:48:38.272939 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:38.274779 (+ 1840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:38.276429 (+ 1650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:38.277129 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:38.277256 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:38.280164 (+ 2908us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:48:38.280170 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:48:38.280170 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:48:38.280186 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:48:38.282107 (+ 1921us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:48:38.282510 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:48:38.282512 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:48:38.282513 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:48:38.282603 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:48:38.282861 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:48:38.282862 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:48:38.282863 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:48:38.283132 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:48:38.283210 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 14:48:38.283490 (+ 280us) server_negotiation.cc:299] Negotiation successful
0808 14:48:38.283618 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":72,"threads_started":1}
I20260808 14:48:38.283732 24792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:38.270657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.129:41093 (local address 127.30.214.130:42365)
0808 14:48:38.270845 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0808 14:48:38.270853 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:48:38.270894 (+ 41us) server_negotiation.cc:407] Connection header received
0808 14:48:38.271586 (+ 692us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:48:38.271589 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:48:38.271662 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:48:38.271858 (+ 196us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:48:38.272938 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:38.274786 (+ 1848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:38.276428 (+ 1642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:38.277129 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:38.277256 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:38.280445 (+ 3189us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:48:38.280449 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:48:38.280449 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:48:38.280462 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:48:38.282116 (+ 1654us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:48:38.282713 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:48:38.282715 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:48:38.282715 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:48:38.282804 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:48:38.282978 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:48:38.282979 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:48:38.282979 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:48:38.283219 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:48:38.283294 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 14:48:38.283482 (+ 188us) server_negotiation.cc:299] Negotiation successful
0808 14:48:38.283617 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":71,"threads_started":1}
I20260808 14:48:38.283730 24781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:38.270417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.131:40261 (local address 127.30.214.129:42971)
0808 14:48:38.270476 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:38.270488 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:48:38.270563 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:48:38.271958 (+ 1395us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:48:38.271962 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:48:38.272441 (+ 479us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:48:38.272748 (+ 307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:38.272756 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:38.274947 (+ 2191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:38.274948 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:38.276306 (+ 1358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:38.276310 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:38.277261 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:38.277262 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:38.277425 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:38.278114 (+ 689us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:48:38.278122 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:48:38.280022 (+ 1900us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:48:38.282193 (+ 2171us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:48:38.282201 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:48:38.282203 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:48:38.282436 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:48:38.282677 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:48:38.282678 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:48:38.282678 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:48:38.282799 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:48:38.283201 (+ 402us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:48:38.283209 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:48:38.283333 (+ 124us) client_negotiation.cc:769] Sending connection context
0808 14:48:38.283423 (+ 90us) client_negotiation.cc:240] Negotiation successful
0808 14:48:38.283629 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36,"mutex_wait_us":74}
I20260808 14:48:38.283831 24788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:38.270493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.130:42365 (local address 127.30.214.129:41093)
0808 14:48:38.270801 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:38.270811 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:48:38.270859 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:48:38.271958 (+ 1099us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:48:38.271962 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:48:38.272442 (+ 480us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:48:38.272748 (+ 306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:38.272756 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:38.274963 (+ 2207us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:38.274964 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:38.276307 (+ 1343us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:38.276310 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:38.277261 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:38.277262 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:38.277425 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:38.278110 (+ 685us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:48:38.278122 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:48:38.280331 (+ 2209us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:48:38.282508 (+ 2177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:48:38.282508 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:48:38.282508 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:48:38.282633 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:48:38.282868 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:48:38.282868 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:48:38.282869 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:48:38.282926 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:48:38.283286 (+ 360us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:48:38.283287 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:48:38.283339 (+ 52us) client_negotiation.cc:769] Sending connection context
0808 14:48:38.283422 (+ 83us) client_negotiation.cc:240] Negotiation successful
0808 14:48:38.283708 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":293,"mutex_wait_us":172,"thread_start_us":97,"threads_started":1}
W20260808 14:48:38.284690 24141 leader_election.cc:341] T 4fce2f79d709481aaa374fe13ac6e7be P 24be9ebf5aff4ed787fbfd57e4f7e633 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 091ccdf967d949c9a2b8b03fcd48258c (127.30.214.131:40261): Not found: Tablet not found: 4fce2f79d709481aaa374fe13ac6e7be
W20260808 14:48:38.285104 24143 leader_election.cc:341] T 4fce2f79d709481aaa374fe13ac6e7be P 24be9ebf5aff4ed787fbfd57e4f7e633 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 78f732c786474630ad34b76d0a05800b (127.30.214.130:42365): Not found: Tablet not found: 4fce2f79d709481aaa374fe13ac6e7be
I20260808 14:48:38.285149 24143 leader_election.cc:302] T 4fce2f79d709481aaa374fe13ac6e7be P 24be9ebf5aff4ed787fbfd57e4f7e633 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24be9ebf5aff4ed787fbfd57e4f7e633; no voters: 091ccdf967d949c9a2b8b03fcd48258c, 78f732c786474630ad34b76d0a05800b
I20260808 14:48:38.285261 24787 raft_consensus.cc:2726] T 4fce2f79d709481aaa374fe13ac6e7be P 24be9ebf5aff4ed787fbfd57e4f7e633 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 14:48:38.980537 24793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:38.980281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:40141 (local address 127.30.214.129:59443)
0808 14:48:38.980435 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:38.980488 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:40141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":71,"threads_started":1}
I20260808 14:48:39.037990 24794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:39.037721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:40141 (local address 127.30.214.130:33973)
0808 14:48:39.037899 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:39.037945 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:40141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":65,"threads_started":1}
I20260808 14:48:39.172570 24796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:39.172350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:40141 (local address 127.30.214.131:46375)
0808 14:48:39.172482 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:39.172520 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:40141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":68,"threads_started":1}
I20260808 14:48:39.981323 24801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:39.981068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:40141 (local address 127.30.214.129:42289)
0808 14:48:39.981227 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:39.981272 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:40141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":69,"threads_started":1}
I20260808 14:48:40.038801 24802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:40.038572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:40141 (local address 127.30.214.130:54529)
0808 14:48:40.038707 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:40.038752 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:40141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":73,"threads_started":1}
I20260808 14:48:40.173259 24803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:40.173033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:40141 (local address 127.30.214.131:35335)
0808 14:48:40.173166 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:40.173211 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:40141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":69,"threads_started":1}
I20260808 14:48:40.224301 24804 raft_consensus.cc:482] T 4fce2f79d709481aaa374fe13ac6e7be P 24be9ebf5aff4ed787fbfd57e4f7e633 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:48:40.224411 24804 raft_consensus.cc:504] T 4fce2f79d709481aaa374fe13ac6e7be P 24be9ebf5aff4ed787fbfd57e4f7e633 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78f732c786474630ad34b76d0a05800b" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 42365 } } peers { permanent_uuid: "091ccdf967d949c9a2b8b03fcd48258c" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40261 } } peers { permanent_uuid: "24be9ebf5aff4ed787fbfd57e4f7e633" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38613 } }
I20260808 14:48:40.224581 24804 leader_election.cc:288] T 4fce2f79d709481aaa374fe13ac6e7be P 24be9ebf5aff4ed787fbfd57e4f7e633 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 78f732c786474630ad34b76d0a05800b (127.30.214.130:42365), 091ccdf967d949c9a2b8b03fcd48258c (127.30.214.131:40261)
W20260808 14:48:40.225016 24143 leader_election.cc:341] T 4fce2f79d709481aaa374fe13ac6e7be P 24be9ebf5aff4ed787fbfd57e4f7e633 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 78f732c786474630ad34b76d0a05800b (127.30.214.130:42365): Not found: Tablet not found: 4fce2f79d709481aaa374fe13ac6e7be
W20260808 14:48:40.225160 24141 leader_election.cc:341] T 4fce2f79d709481aaa374fe13ac6e7be P 24be9ebf5aff4ed787fbfd57e4f7e633 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 091ccdf967d949c9a2b8b03fcd48258c (127.30.214.131:40261): Not found: Tablet not found: 4fce2f79d709481aaa374fe13ac6e7be
I20260808 14:48:40.225229 24141 leader_election.cc:302] T 4fce2f79d709481aaa374fe13ac6e7be P 24be9ebf5aff4ed787fbfd57e4f7e633 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24be9ebf5aff4ed787fbfd57e4f7e633; no voters: 091ccdf967d949c9a2b8b03fcd48258c, 78f732c786474630ad34b76d0a05800b
I20260808 14:48:40.225299 24804 raft_consensus.cc:2726] T 4fce2f79d709481aaa374fe13ac6e7be P 24be9ebf5aff4ed787fbfd57e4f7e633 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 14:48:40.982060 24805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:40.981798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:40141 (local address 127.30.214.129:35137)
0808 14:48:40.981961 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:40.982009 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:40141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":78,"threads_started":1}
I20260808 14:48:41.039582 24806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:41.039329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:40141 (local address 127.30.214.130:56693)
0808 14:48:41.039492 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:41.039536 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:40141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":75,"threads_started":1}
I20260808 14:48:41.173911 24808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:41.173693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:40141 (local address 127.30.214.131:54957)
0808 14:48:41.173818 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:41.173864 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:40141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":62,"threads_started":1}
I20260808 14:48:41.982756 24809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:41.982523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:40141 (local address 127.30.214.129:36787)
0808 14:48:41.982671 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:41.982708 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:40141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":86,"threads_started":1}
I20260808 14:48:42.040246 24810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:42.040001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:40141 (local address 127.30.214.130:47999)
0808 14:48:42.040161 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:42.040200 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:40141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":62,"threads_started":1}
I20260808 14:48:42.103869 24812 raft_consensus.cc:482] T 4fce2f79d709481aaa374fe13ac6e7be P 24be9ebf5aff4ed787fbfd57e4f7e633 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:48:42.103977 24812 raft_consensus.cc:504] T 4fce2f79d709481aaa374fe13ac6e7be P 24be9ebf5aff4ed787fbfd57e4f7e633 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78f732c786474630ad34b76d0a05800b" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 42365 } } peers { permanent_uuid: "091ccdf967d949c9a2b8b03fcd48258c" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40261 } } peers { permanent_uuid: "24be9ebf5aff4ed787fbfd57e4f7e633" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38613 } }
I20260808 14:48:42.104163 24812 leader_election.cc:288] T 4fce2f79d709481aaa374fe13ac6e7be P 24be9ebf5aff4ed787fbfd57e4f7e633 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 78f732c786474630ad34b76d0a05800b (127.30.214.130:42365), 091ccdf967d949c9a2b8b03fcd48258c (127.30.214.131:40261)
W20260808 14:48:42.104578 24141 leader_election.cc:341] T 4fce2f79d709481aaa374fe13ac6e7be P 24be9ebf5aff4ed787fbfd57e4f7e633 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 091ccdf967d949c9a2b8b03fcd48258c (127.30.214.131:40261): Not found: Tablet not found: 4fce2f79d709481aaa374fe13ac6e7be
W20260808 14:48:42.104660 24143 leader_election.cc:341] T 4fce2f79d709481aaa374fe13ac6e7be P 24be9ebf5aff4ed787fbfd57e4f7e633 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 78f732c786474630ad34b76d0a05800b (127.30.214.130:42365): Not found: Tablet not found: 4fce2f79d709481aaa374fe13ac6e7be
I20260808 14:48:42.104718 24143 leader_election.cc:302] T 4fce2f79d709481aaa374fe13ac6e7be P 24be9ebf5aff4ed787fbfd57e4f7e633 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24be9ebf5aff4ed787fbfd57e4f7e633; no voters: 091ccdf967d949c9a2b8b03fcd48258c, 78f732c786474630ad34b76d0a05800b
I20260808 14:48:42.104797 24812 raft_consensus.cc:2726] T 4fce2f79d709481aaa374fe13ac6e7be P 24be9ebf5aff4ed787fbfd57e4f7e633 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 14:48:42.174516 24813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:42.174296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:40141 (local address 127.30.214.131:36475)
0808 14:48:42.174415 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:42.174463 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:40141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":61,"threads_started":1}
I20260808 14:48:42.983457 24815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:42.983232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:40141 (local address 127.30.214.129:53585)
0808 14:48:42.983374 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:42.983411 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:40141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":66,"threads_started":1}
I20260808 14:48:43.040933 24817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:43.040701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:40141 (local address 127.30.214.130:52743)
0808 14:48:43.040848 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:43.040889 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:40141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":64,"threads_started":1}
I20260808 14:48:43.175186 24818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:43.174981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:40141 (local address 127.30.214.131:57179)
0808 14:48:43.175106 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:43.175144 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:40141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":65,"threads_started":1}
I20260808 14:48:43.984216 24820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:43.983955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:40141 (local address 127.30.214.129:48635)
0808 14:48:43.984130 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:43.984168 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:40141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":93,"threads_started":1}
I20260808 14:48:44.032145 24821 raft_consensus.cc:482] T 4fce2f79d709481aaa374fe13ac6e7be P 24be9ebf5aff4ed787fbfd57e4f7e633 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:48:44.032248 24821 raft_consensus.cc:504] T 4fce2f79d709481aaa374fe13ac6e7be P 24be9ebf5aff4ed787fbfd57e4f7e633 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78f732c786474630ad34b76d0a05800b" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 42365 } } peers { permanent_uuid: "091ccdf967d949c9a2b8b03fcd48258c" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40261 } } peers { permanent_uuid: "24be9ebf5aff4ed787fbfd57e4f7e633" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38613 } }
I20260808 14:48:44.032418 24821 leader_election.cc:288] T 4fce2f79d709481aaa374fe13ac6e7be P 24be9ebf5aff4ed787fbfd57e4f7e633 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 78f732c786474630ad34b76d0a05800b (127.30.214.130:42365), 091ccdf967d949c9a2b8b03fcd48258c (127.30.214.131:40261)
W20260808 14:48:44.032773 24143 leader_election.cc:341] T 4fce2f79d709481aaa374fe13ac6e7be P 24be9ebf5aff4ed787fbfd57e4f7e633 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 78f732c786474630ad34b76d0a05800b (127.30.214.130:42365): Not found: Tablet not found: 4fce2f79d709481aaa374fe13ac6e7be
W20260808 14:48:44.032859 24141 leader_election.cc:341] T 4fce2f79d709481aaa374fe13ac6e7be P 24be9ebf5aff4ed787fbfd57e4f7e633 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 091ccdf967d949c9a2b8b03fcd48258c (127.30.214.131:40261): Not found: Tablet not found: 4fce2f79d709481aaa374fe13ac6e7be
I20260808 14:48:44.032982 24141 leader_election.cc:302] T 4fce2f79d709481aaa374fe13ac6e7be P 24be9ebf5aff4ed787fbfd57e4f7e633 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24be9ebf5aff4ed787fbfd57e4f7e633; no voters: 091ccdf967d949c9a2b8b03fcd48258c, 78f732c786474630ad34b76d0a05800b
I20260808 14:48:44.033087 24821 raft_consensus.cc:2726] T 4fce2f79d709481aaa374fe13ac6e7be P 24be9ebf5aff4ed787fbfd57e4f7e633 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 14:48:44.041630 24822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:44.041368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:40141 (local address 127.30.214.130:35279)
0808 14:48:44.041543 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:44.041587 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:40141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":108,"threads_started":1}
I20260808 14:48:44.175778 24825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:44.175546 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:40141 (local address 127.30.214.131:45185)
0808 14:48:44.175704 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:44.175739 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:40141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":87,"threads_started":1}
I20260808 14:48:44.984907 24826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:44.984673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:40141 (local address 127.30.214.129:52657)
0808 14:48:44.984815 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:44.984858 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:40141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":68,"threads_started":1}
I20260808 14:48:45.042294 24828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:45.042068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:40141 (local address 127.30.214.130:42393)
0808 14:48:45.042206 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:45.042248 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:40141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":64,"threads_started":1}
I20260808 14:48:45.176496 24829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:45.176258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:40141 (local address 127.30.214.131:44473)
0808 14:48:45.176387 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:45.176428 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:40141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":66,"threads_started":1}
I20260808 14:48:45.985638 24830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:45.985396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:40141 (local address 127.30.214.129:50121)
0808 14:48:45.985553 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:45.985592 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:40141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":107,"threads_started":1}
I20260808 14:48:46.042869 24832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:46.042688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:40141 (local address 127.30.214.130:48151)
0808 14:48:46.042798 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:46.042826 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:40141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":64,"threads_started":1}
I20260808 14:48:46.177269 24833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:46.177023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:40141 (local address 127.30.214.131:60947)
0808 14:48:46.177175 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:46.177221 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:40141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":68,"threads_started":1}
I20260808 14:48:46.986361 24834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:46.986131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:40141 (local address 127.30.214.129:44633)
0808 14:48:46.986269 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:46.986306 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:40141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":77,"threads_started":1}
I20260808 14:48:47.043550 24836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:47.043331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:40141 (local address 127.30.214.130:60595)
0808 14:48:47.043468 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:47.043506 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:40141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":64,"threads_started":1}
I20260808 14:48:47.177906 24837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:47.177692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:40141 (local address 127.30.214.131:37199)
0808 14:48:47.177823 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:47.177862 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:40141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":63,"threads_started":1}
I20260808 14:48:47.987043 24838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:47.986841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:40141 (local address 127.30.214.129:45979)
0808 14:48:47.986956 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:47.986995 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:40141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":61,"threads_started":1}
I20260808 14:48:48.044227 24839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:48.043957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:40141 (local address 127.30.214.130:56081)
0808 14:48:48.044142 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:48.044181 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:40141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":69,"threads_started":1}
I20260808 14:48:48.178597 24840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:48.178349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:40141 (local address 127.30.214.131:58777)
0808 14:48:48.178506 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:48.178548 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:40141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":67,"threads_started":1}
I20260808 14:48:48.987656 24845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:48.987457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:40141 (local address 127.30.214.129:38405)
0808 14:48:48.987576 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:48.987609 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:40141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":65,"threads_started":1}
I20260808 14:48:49.045042 24846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:49.044756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:40141 (local address 127.30.214.130:51357)
0808 14:48:49.044949 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:49.044995 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:40141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":67,"threads_started":1}
I20260808 14:48:49.060937 24847 raft_consensus.cc:482] T 4fce2f79d709481aaa374fe13ac6e7be P 24be9ebf5aff4ed787fbfd57e4f7e633 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:48:49.061049 24847 raft_consensus.cc:504] T 4fce2f79d709481aaa374fe13ac6e7be P 24be9ebf5aff4ed787fbfd57e4f7e633 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78f732c786474630ad34b76d0a05800b" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 42365 } } peers { permanent_uuid: "091ccdf967d949c9a2b8b03fcd48258c" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 40261 } } peers { permanent_uuid: "24be9ebf5aff4ed787fbfd57e4f7e633" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 38613 } }
I20260808 14:48:49.061226 24847 leader_election.cc:288] T 4fce2f79d709481aaa374fe13ac6e7be P 24be9ebf5aff4ed787fbfd57e4f7e633 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 78f732c786474630ad34b76d0a05800b (127.30.214.130:42365), 091ccdf967d949c9a2b8b03fcd48258c (127.30.214.131:40261)
W20260808 14:48:49.061636 24143 leader_election.cc:341] T 4fce2f79d709481aaa374fe13ac6e7be P 24be9ebf5aff4ed787fbfd57e4f7e633 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 78f732c786474630ad34b76d0a05800b (127.30.214.130:42365): Not found: Tablet not found: 4fce2f79d709481aaa374fe13ac6e7be
W20260808 14:48:49.061713 24141 leader_election.cc:341] T 4fce2f79d709481aaa374fe13ac6e7be P 24be9ebf5aff4ed787fbfd57e4f7e633 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 091ccdf967d949c9a2b8b03fcd48258c (127.30.214.131:40261): Not found: Tablet not found: 4fce2f79d709481aaa374fe13ac6e7be
I20260808 14:48:49.061769 24141 leader_election.cc:302] T 4fce2f79d709481aaa374fe13ac6e7be P 24be9ebf5aff4ed787fbfd57e4f7e633 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24be9ebf5aff4ed787fbfd57e4f7e633; no voters: 091ccdf967d949c9a2b8b03fcd48258c, 78f732c786474630ad34b76d0a05800b
I20260808 14:48:49.061851 24847 raft_consensus.cc:2726] T 4fce2f79d709481aaa374fe13ac6e7be P 24be9ebf5aff4ed787fbfd57e4f7e633 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 14:48:49.179225 24851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:49.179007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:40141 (local address 127.30.214.131:37383)
0808 14:48:49.179143 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:49.179177 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:40141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":87,"threads_started":1}
I20260808 14:48:49.988435 24854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:49.988163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:40141 (local address 127.30.214.129:50557)
0808 14:48:49.988342 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:49.988386 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:40141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":76,"threads_started":1}
I20260808 14:48:50.045794 24855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:50.045575 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:40141 (local address 127.30.214.130:41591)
0808 14:48:50.045711 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:50.045745 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:40141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":82,"threads_started":1}
I20260808 14:48:50.179939 24860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:50.179699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:40141 (local address 127.30.214.131:55697)
0808 14:48:50.179845 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:50.179890 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:40141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":63,"threads_started":1}
I20260808 14:48:50.989223 24863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:50.988963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:40141 (local address 127.30.214.129:60525)
0808 14:48:50.989125 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:50.989173 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:40141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":74,"threads_started":1}
I20260808 14:48:51.046520 24864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:51.046303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:40141 (local address 127.30.214.130:60605)
0808 14:48:51.046437 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:51.046473 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:40141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":63,"threads_started":1}
I20260808 14:48:51.180742 24865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:51.180514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:40141 (local address 127.30.214.131:40771)
0808 14:48:51.180644 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:51.180693 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:40141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":66,"threads_started":1}
I20260808 14:48:51.990238 24867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:51.989931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:40141 (local address 127.30.214.129:59631)
0808 14:48:51.990134 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:51.990190 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:40141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":125,"threads_started":1}
I20260808 14:48:52.047344 24868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:52.047099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:40141 (local address 127.30.214.130:40621)
0808 14:48:52.047257 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:52.047297 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:40141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":86,"threads_started":1}
I20260808 14:48:52.178272 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 24057
I20260808 14:48:52.192777 24869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:52.190786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:40141 (local address 127.30.214.131:35999)
0808 14:48:52.192615 (+ 1829us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:52.192696 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.190:40141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1791,"thread_start_us":1697,"threads_started":1}
I20260808 14:48:52.205535 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 24342
I20260808 14:48:52.224469 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 24557
2026-08-08T14:48:52Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (58639 ms)
[----------] 30 tests from SecurityITest (236352 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:48:52 dist-test-slave-42z9 krb5kdc[24872](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:48:52 dist-test-slave-42z9 krb5kdc[24872](info): set up 2 sockets
Aug 08 14:48:52 dist-test-slave-42z9 krb5kdc[24872](info): commencing operation
krb5kdc: starting...
W20260808 14:48:53.383703 31578 mini_kdc.cc:121] Time spent starting KDC: real 1.128s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Aug 08 14:48:53 dist-test-slave-42z9 krb5kdc[24872](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200533, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:48:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:48:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.214.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab.
Entry for principal kudu/127.30.214.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab.
I20260808 14:48:53.506597 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:42591
--webserver_interface=127.30.214.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab
--principal=kudu/127.30.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:40871
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.214.190:42591
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:48:53.590404 24891 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:48:53.590624 24891 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:48:53.590647 24891 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:48:53.591765 24891 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:48:53.591800 24891 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:48:53.591813 24891 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:48:53.591825 24891 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:48:53.591841 24891 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:48:53.593318 24891 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:40871
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.214.190:42591
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab
--principal=kudu/127.30.214.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:42591
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24891
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:48:53.593590 24891 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:48:53.593791 24891 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:48:53.598853 24900 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:48:53.598816 24902 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:48:53.598834 24891 server_base.cc:1034] running on GCE node
W20260808 14:48:53.598794 24898 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:48:53.599251 24891 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:48:53.599586 24891 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:48:53.600721 24891 hybrid_clock.cc:648] HybridClock initialized: now 1786200533600709 us; error 33 us; skew 500 ppm
Aug 08 14:48:53 dist-test-slave-42z9 krb5kdc[24872](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200533, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:48:53.603209 24891 init.cc:377] Logged in from keytab as kudu/127.30.214.190@KRBTEST.COM (short username kudu)
I20260808 14:48:53.603684 24891 webserver.cc:460] Webserver started at http://127.30.214.190:39885/ using document root <none> and password file <none>
I20260808 14:48:53.603899 24891 fs_manager.cc:359] Metadata directory not provided
I20260808 14:48:53.603948 24891 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:48:53.604079 24891 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:48:53.605154 24891 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/minicluster-data/master-0/data/instance:
uuid: "02f3fc3b14134ddcae29a06c909485ae"
format_stamp: "Formatted at 2026-08-08 14:48:53 on dist-test-slave-42z9"
server_key: "e653fb46463e788cd3db49d88de350f4"
server_key_iv: "ecf10641a75010080c45caa6640ba96d"
server_key_version: "encryptionkey@0"
I20260808 14:48:53.605556 24891 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/minicluster-data/master-0/wal/instance:
uuid: "02f3fc3b14134ddcae29a06c909485ae"
format_stamp: "Formatted at 2026-08-08 14:48:53 on dist-test-slave-42z9"
server_key: "e653fb46463e788cd3db49d88de350f4"
server_key_iv: "ecf10641a75010080c45caa6640ba96d"
server_key_version: "encryptionkey@0"
I20260808 14:48:53.606863 24891 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:48:53.607594 24912 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:48:53.607765 24891 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:48:53.607851 24891 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/minicluster-data/master-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/minicluster-data/master-0/wal
uuid: "02f3fc3b14134ddcae29a06c909485ae"
format_stamp: "Formatted at 2026-08-08 14:48:53 on dist-test-slave-42z9"
server_key: "e653fb46463e788cd3db49d88de350f4"
server_key_iv: "ecf10641a75010080c45caa6640ba96d"
server_key_version: "encryptionkey@0"
I20260808 14:48:53.607920 24891 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:48:53.631412 24891 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:48:53.633555 24891 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:48:53.633711 24891 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:48:53.637766 24891 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.190:42591
I20260808 14:48:53.637809 24995 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.190:42591 every 8 connection(s)
I20260808 14:48:53.638154 24891 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
I20260808 14:48:53.639043 24996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:48:53.641364 24996 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 02f3fc3b14134ddcae29a06c909485ae: Bootstrap starting.
I20260808 14:48:53.642004 24996 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 02f3fc3b14134ddcae29a06c909485ae: Neither blocks nor log segments found. Creating new log.
I20260808 14:48:53.642242 24996 log.cc:824] T 00000000000000000000000000000000 P 02f3fc3b14134ddcae29a06c909485ae: Log is configured to *not* fsync() on all Append() calls
I20260808 14:48:53.642923 24996 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 02f3fc3b14134ddcae29a06c909485ae: No bootstrap required, opened a new log
I20260808 14:48:53.643091 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 24891
I20260808 14:48:53.643177 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/minicluster-data/master-0/wal/instance
I20260808 14:48:53.643356 31578 external_mini_cluster.cc:1428] Setting key cc79d16c6c1452a6f9f163f2a7c97ade
I20260808 14:48:53.645049 24996 raft_consensus.cc:348] T 00000000000000000000000000000000 P 02f3fc3b14134ddcae29a06c909485ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02f3fc3b14134ddcae29a06c909485ae" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 42591 } }
I20260808 14:48:53.645227 24996 raft_consensus.cc:374] T 00000000000000000000000000000000 P 02f3fc3b14134ddcae29a06c909485ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:48:53.645263 24996 raft_consensus.cc:729] T 00000000000000000000000000000000 P 02f3fc3b14134ddcae29a06c909485ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02f3fc3b14134ddcae29a06c909485ae, State: Initialized, Role: FOLLOWER
I20260808 14:48:53.645394 24996 consensus_queue.cc:260] T 00000000000000000000000000000000 P 02f3fc3b14134ddcae29a06c909485ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02f3fc3b14134ddcae29a06c909485ae" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 42591 } }
I20260808 14:48:53.645503 24996 raft_consensus.cc:388] T 00000000000000000000000000000000 P 02f3fc3b14134ddcae29a06c909485ae [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:48:53.645543 24996 raft_consensus.cc:482] T 00000000000000000000000000000000 P 02f3fc3b14134ddcae29a06c909485ae [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:48:53.645639 24996 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 02f3fc3b14134ddcae29a06c909485ae [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:48:53.646243 24996 raft_consensus.cc:504] T 00000000000000000000000000000000 P 02f3fc3b14134ddcae29a06c909485ae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02f3fc3b14134ddcae29a06c909485ae" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 42591 } }
I20260808 14:48:53.646334 24996 leader_election.cc:302] T 00000000000000000000000000000000 P 02f3fc3b14134ddcae29a06c909485ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 02f3fc3b14134ddcae29a06c909485ae; no voters:
I20260808 14:48:53.646490 24996 leader_election.cc:288] T 00000000000000000000000000000000 P 02f3fc3b14134ddcae29a06c909485ae [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:48:53.646533 25005 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 02f3fc3b14134ddcae29a06c909485ae [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:48:53.646685 25005 raft_consensus.cc:686] T 00000000000000000000000000000000 P 02f3fc3b14134ddcae29a06c909485ae [term 1 LEADER]: Becoming Leader. State: Replica: 02f3fc3b14134ddcae29a06c909485ae, State: Running, Role: LEADER
I20260808 14:48:53.646760 24996 sys_catalog.cc:564] T 00000000000000000000000000000000 P 02f3fc3b14134ddcae29a06c909485ae [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:48:53.646768 25005 consensus_queue.cc:237] T 00000000000000000000000000000000 P 02f3fc3b14134ddcae29a06c909485ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02f3fc3b14134ddcae29a06c909485ae" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 42591 } }
I20260808 14:48:53.647231 25006 sys_catalog.cc:455] T 00000000000000000000000000000000 P 02f3fc3b14134ddcae29a06c909485ae [sys.catalog]: SysCatalogTable state changed. Reason: New leader 02f3fc3b14134ddcae29a06c909485ae. Latest consensus state: current_term: 1 leader_uuid: "02f3fc3b14134ddcae29a06c909485ae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02f3fc3b14134ddcae29a06c909485ae" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 42591 } } }
I20260808 14:48:53.647362 25006 sys_catalog.cc:458] T 00000000000000000000000000000000 P 02f3fc3b14134ddcae29a06c909485ae [sys.catalog]: This master's current role is: LEADER
I20260808 14:48:53.647611 25016 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:48:53.648116 25016 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:48:53.648276 25007 sys_catalog.cc:455] T 00000000000000000000000000000000 P 02f3fc3b14134ddcae29a06c909485ae [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "02f3fc3b14134ddcae29a06c909485ae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02f3fc3b14134ddcae29a06c909485ae" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 42591 } } }
I20260808 14:48:53.649312 25007 sys_catalog.cc:458] T 00000000000000000000000000000000 P 02f3fc3b14134ddcae29a06c909485ae [sys.catalog]: This master's current role is: LEADER
I20260808 14:48:53.649850 25016 catalog_manager.cc:1347] Generated new cluster ID: e581a2697c1c40f4ba4586467ad6daeb
I20260808 14:48:53.649899 25016 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 14:48:53 dist-test-slave-42z9 krb5kdc[24872](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200533, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:48:53.655416 25003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:53.643861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59688 (local address 127.30.214.190:42591)
0808 14:48:53.644038 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0808 14:48:53.644046 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:48:53.644071 (+ 25us) server_negotiation.cc:407] Connection header received
0808 14:48:53.644632 (+ 561us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:48:53.644638 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:48:53.644686 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:48:53.644797 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:48:53.645605 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:53.647040 (+ 1435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:53.648145 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:53.648740 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:53.648844 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:53.651822 (+ 2978us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:48:53.651827 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:48:53.651827 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:48:53.651840 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:48:53.653798 (+ 1958us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:48:53.654179 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:48:53.654183 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:48:53.654183 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:48:53.654296 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:48:53.654471 (+ 175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:48:53.654472 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:48:53.654472 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:48:53.654785 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:48:53.654944 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0808 14:48:53.655023 (+ 79us) server_negotiation.cc:299] Negotiation successful
0808 14:48:53.655178 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":75,"threads_started":1}
I20260808 14:48:53.656502 25016 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:48:53.656988 25016 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:48:53.659416 25016 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 02f3fc3b14134ddcae29a06c909485ae: Generated new TSK 0
I20260808 14:48:53.659566 25016 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.214.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab.
Entry for principal kudu/127.30.214.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab.
I20260808 14:48:53.689720 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.129:0
--local_ip_for_outbound_sockets=127.30.214.129
--webserver_interface=127.30.214.129
--webserver_port=0
--tserver_master_addrs=127.30.214.190:42591
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab
--principal=kudu/127.30.214.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:40871
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:48:53.785756 25033 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:48:53.785979 25033 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:48:53.786011 25033 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:48:53.787227 25033 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:48:53.787278 25033 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:48:53.787310 25033 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.129
I20260808 14:48:53.788862 25033 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:40871
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab
--principal=kudu/127.30.214.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.214.129
--webserver_port=0
--tserver_master_addrs=127.30.214.190:42591
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25033
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.129
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:48:53.789109 25033 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:48:53.789345 25033 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:48:53.794896 25042 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:48:53.794948 25046 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:48:53.794947 25040 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:48:53.795032 25033 server_base.cc:1034] running on GCE node
I20260808 14:48:53.795404 25033 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:48:53.795640 25033 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:48:53.796795 25033 hybrid_clock.cc:648] HybridClock initialized: now 1786200533796780 us; error 28 us; skew 500 ppm
Aug 08 14:48:53 dist-test-slave-42z9 krb5kdc[24872](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200533, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:48:53.799434 25033 init.cc:377] Logged in from keytab as kudu/127.30.214.129@KRBTEST.COM (short username kudu)
I20260808 14:48:53.799937 25033 webserver.cc:460] Webserver started at http://127.30.214.129:42083/ using document root <none> and password file <none>
I20260808 14:48:53.800151 25033 fs_manager.cc:359] Metadata directory not provided
I20260808 14:48:53.800202 25033 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:48:53.800334 25033 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:48:53.801411 25033 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/minicluster-data/ts-0/data/instance:
uuid: "4a67b42bf489487a917c5c0e4f660b40"
format_stamp: "Formatted at 2026-08-08 14:48:53 on dist-test-slave-42z9"
server_key: "c0fcfc4c865d23a38ae75aee20db5c98"
server_key_iv: "d095f1639bab447c8d6f3949c03777b5"
server_key_version: "encryptionkey@0"
I20260808 14:48:53.801806 25033 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/minicluster-data/ts-0/wal/instance:
uuid: "4a67b42bf489487a917c5c0e4f660b40"
format_stamp: "Formatted at 2026-08-08 14:48:53 on dist-test-slave-42z9"
server_key: "c0fcfc4c865d23a38ae75aee20db5c98"
server_key_iv: "d095f1639bab447c8d6f3949c03777b5"
server_key_version: "encryptionkey@0"
I20260808 14:48:53.803092 25033 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:48:53.803793 25055 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:48:53.803974 25033 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:48:53.804061 25033 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/minicluster-data/ts-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/minicluster-data/ts-0/wal
uuid: "4a67b42bf489487a917c5c0e4f660b40"
format_stamp: "Formatted at 2026-08-08 14:48:53 on dist-test-slave-42z9"
server_key: "c0fcfc4c865d23a38ae75aee20db5c98"
server_key_iv: "d095f1639bab447c8d6f3949c03777b5"
server_key_version: "encryptionkey@0"
I20260808 14:48:53.804134 25033 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:48:53.819793 25033 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:48:53.822157 25033 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:48:53.822290 25033 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:48:53.822532 25033 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:48:53.822858 25033 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:48:53.822893 25033 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:48:53.822916 25033 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:48:53.822939 25033 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:48:53.828452 25033 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.129:44665
I20260808 14:48:53.828528 25229 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.129:44665 every 8 connection(s)
I20260808 14:48:53.828832 25033 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
Aug 08 14:48:53 dist-test-slave-42z9 krb5kdc[24872](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200533, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.129@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:48:53.836380 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 25033
I20260808 14:48:53.836510 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/minicluster-data/ts-0/wal/instance
I20260808 14:48:53.836728 31578 external_mini_cluster.cc:1428] Setting key ead6d666ac770989a0cd70c40af176b2
I20260808 14:48:53.838099 25003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:53.829546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.129:60889 (local address 127.30.214.190:42591)
0808 14:48:53.829592 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 14:48:53.829594 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:48:53.829807 (+ 213us) server_negotiation.cc:407] Connection header received
0808 14:48:53.830330 (+ 523us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:48:53.830332 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:48:53.830345 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:48:53.830398 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:48:53.831392 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:53.831898 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:53.832869 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:53.833084 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:53.833140 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:53.835247 (+ 2107us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:48:53.835249 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:48:53.835249 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:48:53.835256 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:48:53.836679 (+ 1423us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:48:53.837117 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:48:53.837118 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:48:53.837118 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:48:53.837172 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:48:53.837459 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:48:53.837460 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:48:53.837460 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:48:53.837602 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:48:53.837673 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 14:48:53.837921 (+ 248us) server_negotiation.cc:299] Negotiation successful
0808 14:48:53.838016 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 14:48:53.838184 25232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:53.829529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:42591 (local address 127.30.214.129:60889)
0808 14:48:53.829685 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:53.829724 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 14:48:53.830230 (+ 506us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:48:53.830483 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:48:53.830487 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:48:53.831082 (+ 595us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:48:53.831287 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:53.831292 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:53.831988 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:53.831989 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:53.832782 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:53.832784 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:53.833157 (+ 373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:53.833158 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:53.833284 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:53.833775 (+ 491us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:48:53.833784 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:48:53.835153 (+ 1369us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:48:53.836758 (+ 1605us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:48:53.836766 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:48:53.836768 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:48:53.837049 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:48:53.837230 (+ 181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:48:53.837230 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:48:53.837231 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:48:53.837368 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:48:53.837664 (+ 296us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:48:53.837669 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:48:53.837789 (+ 120us) client_negotiation.cc:769] Sending connection context
0808 14:48:53.837874 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 14:48:53.838005 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":73,"threads_started":1}
I20260808 14:48:53.839759 25230 heartbeater.cc:347] Connected to a master server at 127.30.214.190:42591
I20260808 14:48:53.839866 25230 heartbeater.cc:464] Registering TS with master...
I20260808 14:48:53.840057 25230 heartbeater.cc:511] Master 127.30.214.190:42591 requested a full tablet report, sending...
I20260808 14:48:53.840576 24936 ts_manager.cc:194] Registered new tserver with Master: 4a67b42bf489487a917c5c0e4f660b40 (127.30.214.129:44665)
I20260808 14:48:53.841202 24936 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.214.129@KRBTEST.COM'} at 127.30.214.129:60889
WARNING: no policy specified for kudu/127.30.214.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab.
Entry for principal kudu/127.30.214.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab.
I20260808 14:48:53.863637 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.130:0
--local_ip_for_outbound_sockets=127.30.214.130
--webserver_interface=127.30.214.130
--webserver_port=0
--tserver_master_addrs=127.30.214.190:42591
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab
--principal=kudu/127.30.214.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:40871
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:48:53.946846 25236 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:48:53.947113 25236 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:48:53.947147 25236 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:48:53.948406 25236 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:48:53.948462 25236 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:48:53.948500 25236 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.130
I20260808 14:48:53.950040 25236 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:40871
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab
--principal=kudu/127.30.214.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.214.130
--webserver_port=0
--tserver_master_addrs=127.30.214.190:42591
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25236
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.130
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:48:53.950289 25236 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:48:53.950517 25236 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:48:53.955508 25244 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:48:53.955518 25247 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:48:53.955518 25243 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:48:53.955683 25236 server_base.cc:1034] running on GCE node
I20260808 14:48:53.955921 25236 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:48:53.956156 25236 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:48:53.957289 25236 hybrid_clock.cc:648] HybridClock initialized: now 1786200533957278 us; error 33 us; skew 500 ppm
Aug 08 14:48:53 dist-test-slave-42z9 krb5kdc[24872](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200533, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:48:53.959860 25236 init.cc:377] Logged in from keytab as kudu/127.30.214.130@KRBTEST.COM (short username kudu)
I20260808 14:48:53.960306 25236 webserver.cc:460] Webserver started at http://127.30.214.130:42701/ using document root <none> and password file <none>
I20260808 14:48:53.960511 25236 fs_manager.cc:359] Metadata directory not provided
I20260808 14:48:53.960554 25236 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:48:53.960680 25236 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:48:53.961787 25236 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/minicluster-data/ts-1/data/instance:
uuid: "e64335e1acb94e7d910a21974f6b39eb"
format_stamp: "Formatted at 2026-08-08 14:48:53 on dist-test-slave-42z9"
server_key: "b81c75c07ccc05ac08cef95a799f034a"
server_key_iv: "0e3bcb614bcc3f50da7074e5f2a5e614"
server_key_version: "encryptionkey@0"
I20260808 14:48:53.962126 25236 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/minicluster-data/ts-1/wal/instance:
uuid: "e64335e1acb94e7d910a21974f6b39eb"
format_stamp: "Formatted at 2026-08-08 14:48:53 on dist-test-slave-42z9"
server_key: "b81c75c07ccc05ac08cef95a799f034a"
server_key_iv: "0e3bcb614bcc3f50da7074e5f2a5e614"
server_key_version: "encryptionkey@0"
I20260808 14:48:53.963492 25236 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:48:53.964243 25262 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:48:53.964408 25236 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:48:53.964489 25236 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/minicluster-data/ts-1/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/minicluster-data/ts-1/wal
uuid: "e64335e1acb94e7d910a21974f6b39eb"
format_stamp: "Formatted at 2026-08-08 14:48:53 on dist-test-slave-42z9"
server_key: "b81c75c07ccc05ac08cef95a799f034a"
server_key_iv: "0e3bcb614bcc3f50da7074e5f2a5e614"
server_key_version: "encryptionkey@0"
I20260808 14:48:53.964561 25236 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:48:53.978840 25236 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:48:53.980726 25236 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:48:53.980854 25236 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:48:53.981096 25236 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:48:53.981405 25236 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:48:53.981464 25236 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:48:53.981504 25236 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:48:53.981523 25236 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:48:53.987306 25236 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.130:37305
I20260808 14:48:53.987351 25437 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.130:37305 every 8 connection(s)
I20260808 14:48:53.987673 25236 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
I20260808 14:48:53.989333 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 25236
I20260808 14:48:53.989429 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/minicluster-data/ts-1/wal/instance
I20260808 14:48:53.989656 31578 external_mini_cluster.cc:1428] Setting key 92365fea56e62f8622e4d37053b52960
Aug 08 14:48:53 dist-test-slave-42z9 krb5kdc[24872](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200533, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.130@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:48:53.997476 25003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:53.988385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.130:58265 (local address 127.30.214.190:42591)
0808 14:48:53.988445 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0808 14:48:53.988447 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:48:53.988654 (+ 207us) server_negotiation.cc:407] Connection header received
0808 14:48:53.989152 (+ 498us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:48:53.989154 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:48:53.989166 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:48:53.989221 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:48:53.990325 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:53.990817 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:53.991786 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:53.991983 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:53.992051 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:53.994621 (+ 2570us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:48:53.994623 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:48:53.994623 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:48:53.994631 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:48:53.995964 (+ 1333us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:48:53.996483 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:48:53.996484 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:48:53.996484 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:48:53.996534 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:48:53.996818 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:48:53.996818 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:48:53.996819 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:48:53.996925 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:48:53.996974 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 14:48:53.997296 (+ 322us) server_negotiation.cc:299] Negotiation successful
0808 14:48:53.997371 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 14:48:53.997753 25440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:53.988355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:42591 (local address 127.30.214.130:58265)
0808 14:48:53.988512 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:53.988549 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 14:48:53.989050 (+ 501us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:48:53.989290 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:48:53.989294 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:48:53.989969 (+ 675us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:48:53.990241 (+ 272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:53.990248 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:53.990903 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:53.990904 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:53.991699 (+ 795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:53.991702 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:53.992092 (+ 390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:53.992093 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:53.992250 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:53.992758 (+ 508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:48:53.992766 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:48:53.994479 (+ 1713us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:48:53.996059 (+ 1580us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:48:53.996069 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:48:53.996071 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:48:53.996399 (+ 328us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:48:53.996606 (+ 207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:48:53.996607 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:48:53.996607 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:48:53.996758 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:48:53.996981 (+ 223us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:48:53.996986 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:48:53.997165 (+ 179us) client_negotiation.cc:769] Sending connection context
0808 14:48:53.997287 (+ 122us) client_negotiation.cc:240] Negotiation successful
0808 14:48:53.997500 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":77,"threads_started":1}
I20260808 14:48:53.998306 25438 heartbeater.cc:347] Connected to a master server at 127.30.214.190:42591
I20260808 14:48:53.998415 25438 heartbeater.cc:464] Registering TS with master...
I20260808 14:48:53.998633 25438 heartbeater.cc:511] Master 127.30.214.190:42591 requested a full tablet report, sending...
I20260808 14:48:53.999042 24936 ts_manager.cc:194] Registered new tserver with Master: e64335e1acb94e7d910a21974f6b39eb (127.30.214.130:37305)
WARNING: no policy specified for kudu/127.30.214.131@KRBTEST.COM; defaulting to no policy
I20260808 14:48:53.999447 24936 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.214.130@KRBTEST.COM'} at 127.30.214.130:58265
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab.
Entry for principal kudu/127.30.214.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab.
I20260808 14:48:54.016000 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.131:0
--local_ip_for_outbound_sockets=127.30.214.131
--webserver_interface=127.30.214.131
--webserver_port=0
--tserver_master_addrs=127.30.214.190:42591
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab
--principal=kudu/127.30.214.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:40871
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:48:54.100355 25444 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:48:54.100577 25444 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:48:54.100601 25444 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:48:54.101815 25444 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:48:54.101861 25444 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:48:54.101888 25444 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.131
I20260808 14:48:54.103353 25444 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:40871
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab
--principal=kudu/127.30.214.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.214.131
--webserver_port=0
--tserver_master_addrs=127.30.214.190:42591
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25444
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.131
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:48:54.103561 25444 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:48:54.103750 25444 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:48:54.108790 25449 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:48:54.108799 25450 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:48:54.108799 25453 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:48:54.108901 25444 server_base.cc:1034] running on GCE node
I20260808 14:48:54.109249 25444 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:48:54.109546 25444 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:48:54.110689 25444 hybrid_clock.cc:648] HybridClock initialized: now 1786200534110672 us; error 27 us; skew 500 ppm
Aug 08 14:48:54 dist-test-slave-42z9 krb5kdc[24872](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200534, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:48:54.113205 25444 init.cc:377] Logged in from keytab as kudu/127.30.214.131@KRBTEST.COM (short username kudu)
I20260808 14:48:54.113739 25444 webserver.cc:460] Webserver started at http://127.30.214.131:39253/ using document root <none> and password file <none>
I20260808 14:48:54.113969 25444 fs_manager.cc:359] Metadata directory not provided
I20260808 14:48:54.114020 25444 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:48:54.114151 25444 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:48:54.115226 25444 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/minicluster-data/ts-2/data/instance:
uuid: "63f1e22476c94c798bdee92ab2e3a7d8"
format_stamp: "Formatted at 2026-08-08 14:48:54 on dist-test-slave-42z9"
server_key: "dfbe3e038c74bd474a67edf518a33fdf"
server_key_iv: "46da1b52e890b883014fc28e6e371986"
server_key_version: "encryptionkey@0"
I20260808 14:48:54.115592 25444 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/minicluster-data/ts-2/wal/instance:
uuid: "63f1e22476c94c798bdee92ab2e3a7d8"
format_stamp: "Formatted at 2026-08-08 14:48:54 on dist-test-slave-42z9"
server_key: "dfbe3e038c74bd474a67edf518a33fdf"
server_key_iv: "46da1b52e890b883014fc28e6e371986"
server_key_version: "encryptionkey@0"
I20260808 14:48:54.117010 25444 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:48:54.118026 25468 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:48:54.118218 25444 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 14:48:54.118314 25444 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/minicluster-data/ts-2/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/minicluster-data/ts-2/wal
uuid: "63f1e22476c94c798bdee92ab2e3a7d8"
format_stamp: "Formatted at 2026-08-08 14:48:54 on dist-test-slave-42z9"
server_key: "dfbe3e038c74bd474a67edf518a33fdf"
server_key_iv: "46da1b52e890b883014fc28e6e371986"
server_key_version: "encryptionkey@0"
I20260808 14:48:54.118384 25444 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:48:54.127921 25444 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:48:54.129925 25444 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:48:54.130080 25444 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:48:54.130307 25444 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:48:54.130728 25444 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:48:54.130788 25444 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:48:54.130822 25444 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:48:54.130839 25444 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:48:54.136852 25444 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.131:34115
I20260808 14:48:54.136895 25631 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.131:34115 every 8 connection(s)
I20260808 14:48:54.137228 25444 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
I20260808 14:48:54.141949 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 25444
I20260808 14:48:54.142076 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/minicluster-data/ts-2/wal/instance
I20260808 14:48:54.142268 31578 external_mini_cluster.cc:1428] Setting key f5941429a65e976d604dc7df328915f5
Aug 08 14:48:54 dist-test-slave-42z9 krb5kdc[24872](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200534, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.131@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:48:54.146420 25003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:54.138037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:55393 (local address 127.30.214.190:42591)
0808 14:48:54.138107 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0808 14:48:54.138109 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:48:54.138275 (+ 166us) server_negotiation.cc:407] Connection header received
0808 14:48:54.138760 (+ 485us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:48:54.138761 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:48:54.138771 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:48:54.138830 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:48:54.139828 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:54.140345 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:54.141305 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:54.141518 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:54.141562 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:54.143870 (+ 2308us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:48:54.143872 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:48:54.143873 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:48:54.143888 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:48:54.145013 (+ 1125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:48:54.145410 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:48:54.145412 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:48:54.145412 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:48:54.145507 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:48:54.145741 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:48:54.145742 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:48:54.145742 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:48:54.145860 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:48:54.145926 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 14:48:54.146197 (+ 271us) server_negotiation.cc:299] Negotiation successful
0808 14:48:54.146302 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 14:48:54.146574 25634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:54.137976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:42591 (local address 127.30.214.131:55393)
0808 14:48:54.138146 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:54.138190 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 14:48:54.138681 (+ 491us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:48:54.138891 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:48:54.138894 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:48:54.139509 (+ 615us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:48:54.139725 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:54.139730 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:54.140424 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:54.140425 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:54.141236 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:54.141239 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:54.141596 (+ 357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:54.141597 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:54.141712 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:54.142318 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:48:54.142328 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:48:54.143773 (+ 1445us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:48:54.145093 (+ 1320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:48:54.145102 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:48:54.145104 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:48:54.145337 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:48:54.145571 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:48:54.145572 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:48:54.145572 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:48:54.145684 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:48:54.145923 (+ 239us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:48:54.145931 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:48:54.146072 (+ 141us) client_negotiation.cc:769] Sending connection context
0808 14:48:54.146165 (+ 93us) client_negotiation.cc:240] Negotiation successful
0808 14:48:54.146341 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":95,"threads_started":1}
I20260808 14:48:54.147058 25632 heartbeater.cc:347] Connected to a master server at 127.30.214.190:42591
I20260808 14:48:54.147152 25632 heartbeater.cc:464] Registering TS with master...
I20260808 14:48:54.147311 25632 heartbeater.cc:511] Master 127.30.214.190:42591 requested a full tablet report, sending...
I20260808 14:48:54.147642 24936 ts_manager.cc:194] Registered new tserver with Master: 63f1e22476c94c798bdee92ab2e3a7d8 (127.30.214.131:34115)
I20260808 14:48:54.148080 24936 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.214.131@KRBTEST.COM'} at 127.30.214.131:55393
I20260808 14:48:54.153992 31578 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:48:54.161142 25003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:54.155426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59700 (local address 127.30.214.190:42591)
0808 14:48:54.155481 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 14:48:54.155483 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:48:54.155538 (+ 55us) server_negotiation.cc:407] Connection header received
0808 14:48:54.155615 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:48:54.155616 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:48:54.155626 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:48:54.155676 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:48:54.156247 (+ 571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:54.156754 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:54.157504 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:54.157701 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:54.157760 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:54.158827 (+ 1067us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:48:54.158828 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:48:54.158828 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:48:54.158835 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:48:54.160112 (+ 1277us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:48:54.160477 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:48:54.160478 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:48:54.160478 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:48:54.160537 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:48:54.160686 (+ 149us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:48:54.160687 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:48:54.160687 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:48:54.160829 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:48:54.160910 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 14:48:54.160987 (+ 77us) server_negotiation.cc:299] Negotiation successful
0808 14:48:54.161066 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 14:48:54.163085 24936 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59700:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:48:54.164700 24936 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:48:54.171286 25650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:54.167330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52102 (local address 127.30.214.129:44665)
0808 14:48:54.167514 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0808 14:48:54.167519 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:48:54.167687 (+ 168us) server_negotiation.cc:407] Connection header received
0808 14:48:54.167732 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:48:54.167735 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:48:54.167751 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:48:54.167821 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:48:54.168037 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:54.169133 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:54.170405 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:54.170895 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:54.170964 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:54.171024 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 14:48:54.171157 (+ 133us) server_negotiation.cc:299] Negotiation successful
0808 14:48:54.171197 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":94,"threads_started":1}
I20260808 14:48:54.171273 25648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:54.167048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.129:44665 (local address 127.0.0.1:52102)
0808 14:48:54.167631 (+ 583us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:54.167637 (+ 6us) client_negotiation.cc:174] Beginning negotiation
0808 14:48:54.167675 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:48:54.167915 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:48:54.167915 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:48:54.167918 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:48:54.167963 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:54.167965 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:54.169244 (+ 1279us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:54.169245 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:54.170324 (+ 1079us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:54.170326 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:54.170974 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:54.170976 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:54.171056 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:54.171070 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 14:48:54.171136 (+ 66us) client_negotiation.cc:240] Negotiation successful
0808 14:48:54.171194 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":571,"mutex_wait_us":2,"thread_start_us":104,"threads_started":1}
I20260808 14:48:54.171429 25649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:54.167149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46428 (local address 127.30.214.130:37305)
0808 14:48:54.167546 (+ 397us) server_negotiation.cc:206] Beginning negotiation
0808 14:48:54.167551 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:48:54.167560 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:48:54.167597 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:48:54.167599 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:48:54.167611 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:48:54.167678 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:48:54.167933 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:54.168801 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:54.170217 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:54.170962 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:54.171035 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:54.171090 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 14:48:54.171283 (+ 193us) server_negotiation.cc:299] Negotiation successful
0808 14:48:54.171330 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":355,"thread_start_us":85,"threads_started":1}
I20260808 14:48:54.171628 25651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:54.167328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39490 (local address 127.30.214.131:34115)
0808 14:48:54.167822 (+ 494us) server_negotiation.cc:206] Beginning negotiation
0808 14:48:54.167826 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:48:54.167835 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:48:54.167870 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:48:54.167872 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:48:54.167898 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:48:54.167969 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:48:54.168157 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:54.169256 (+ 1099us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:54.170421 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:54.171108 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:54.171168 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:54.171215 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 14:48:54.171506 (+ 291us) server_negotiation.cc:299] Negotiation successful
0808 14:48:54.171547 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":461,"thread_start_us":101,"threads_started":1}
I20260808 14:48:54.171443 25646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:54.167047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.131:34115 (local address 127.0.0.1:39490)
0808 14:48:54.167515 (+ 468us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:54.167526 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:48:54.167575 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:48:54.168041 (+ 466us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:48:54.168042 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:48:54.168044 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:48:54.168080 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:54.168081 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:54.169344 (+ 1263us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:54.169345 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:54.170328 (+ 983us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:54.170330 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:54.171245 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:54.171246 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:54.171299 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:54.171301 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 14:48:54.171341 (+ 40us) client_negotiation.cc:240] Negotiation successful
0808 14:48:54.171379 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":446,"mutex_wait_us":4,"spinlock_wait_cycles":768,"thread_start_us":107,"threads_started":1}
I20260808 14:48:54.171640 25645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:54.167044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.130:37305 (local address 127.0.0.1:46428)
0808 14:48:54.167331 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:54.167375 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 14:48:54.167458 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:48:54.167758 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:48:54.167761 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:48:54.167764 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:48:54.167838 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:54.167841 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:54.168902 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:54.168903 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:54.170129 (+ 1226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:54.170132 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:54.171128 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:54.171129 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:54.171190 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:54.171194 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:48:54.171543 (+ 349us) client_negotiation.cc:240] Negotiation successful
0808 14:48:54.171587 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":48,"threads_started":1}
I20260808 14:48:54.172492 25136 tablet_service.cc:1467] Processing CreateTablet for tablet acf0530bc79148b69d76e686b847bc87 (DEFAULT_TABLE table=test-table [id=2f5b37c19acf459faf195d4d2ae90bdd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:48:54.172492 25539 tablet_service.cc:1467] Processing CreateTablet for tablet acf0530bc79148b69d76e686b847bc87 (DEFAULT_TABLE table=test-table [id=2f5b37c19acf459faf195d4d2ae90bdd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:48:54.172492 25331 tablet_service.cc:1467] Processing CreateTablet for tablet acf0530bc79148b69d76e686b847bc87 (DEFAULT_TABLE table=test-table [id=2f5b37c19acf459faf195d4d2ae90bdd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:48:54.172850 25136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet acf0530bc79148b69d76e686b847bc87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:48:54.172853 25539 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet acf0530bc79148b69d76e686b847bc87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:48:54.172853 25331 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet acf0530bc79148b69d76e686b847bc87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:48:54.175678 25653 tablet_bootstrap.cc:492] T acf0530bc79148b69d76e686b847bc87 P 4a67b42bf489487a917c5c0e4f660b40: Bootstrap starting.
I20260808 14:48:54.176080 25655 tablet_bootstrap.cc:492] T acf0530bc79148b69d76e686b847bc87 P e64335e1acb94e7d910a21974f6b39eb: Bootstrap starting.
I20260808 14:48:54.176311 25654 tablet_bootstrap.cc:492] T acf0530bc79148b69d76e686b847bc87 P 63f1e22476c94c798bdee92ab2e3a7d8: Bootstrap starting.
I20260808 14:48:54.176488 25653 tablet_bootstrap.cc:654] T acf0530bc79148b69d76e686b847bc87 P 4a67b42bf489487a917c5c0e4f660b40: Neither blocks nor log segments found. Creating new log.
I20260808 14:48:54.176720 25655 tablet_bootstrap.cc:654] T acf0530bc79148b69d76e686b847bc87 P e64335e1acb94e7d910a21974f6b39eb: Neither blocks nor log segments found. Creating new log.
I20260808 14:48:54.176908 25654 tablet_bootstrap.cc:654] T acf0530bc79148b69d76e686b847bc87 P 63f1e22476c94c798bdee92ab2e3a7d8: Neither blocks nor log segments found. Creating new log.
I20260808 14:48:54.177105 25653 log.cc:824] T acf0530bc79148b69d76e686b847bc87 P 4a67b42bf489487a917c5c0e4f660b40: Log is configured to *not* fsync() on all Append() calls
I20260808 14:48:54.177284 25655 log.cc:824] T acf0530bc79148b69d76e686b847bc87 P e64335e1acb94e7d910a21974f6b39eb: Log is configured to *not* fsync() on all Append() calls
I20260808 14:48:54.177397 25654 log.cc:824] T acf0530bc79148b69d76e686b847bc87 P 63f1e22476c94c798bdee92ab2e3a7d8: Log is configured to *not* fsync() on all Append() calls
I20260808 14:48:54.178046 25655 tablet_bootstrap.cc:492] T acf0530bc79148b69d76e686b847bc87 P e64335e1acb94e7d910a21974f6b39eb: No bootstrap required, opened a new log
I20260808 14:48:54.178046 25653 tablet_bootstrap.cc:492] T acf0530bc79148b69d76e686b847bc87 P 4a67b42bf489487a917c5c0e4f660b40: No bootstrap required, opened a new log
I20260808 14:48:54.178098 25654 tablet_bootstrap.cc:492] T acf0530bc79148b69d76e686b847bc87 P 63f1e22476c94c798bdee92ab2e3a7d8: No bootstrap required, opened a new log
I20260808 14:48:54.178123 25653 ts_tablet_manager.cc:1397] T acf0530bc79148b69d76e686b847bc87 P 4a67b42bf489487a917c5c0e4f660b40: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 14:48:54.178123 25655 ts_tablet_manager.cc:1397] T acf0530bc79148b69d76e686b847bc87 P e64335e1acb94e7d910a21974f6b39eb: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260808 14:48:54.178158 25654 ts_tablet_manager.cc:1397] T acf0530bc79148b69d76e686b847bc87 P 63f1e22476c94c798bdee92ab2e3a7d8: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:48:54.179687 25654 raft_consensus.cc:348] T acf0530bc79148b69d76e686b847bc87 P 63f1e22476c94c798bdee92ab2e3a7d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e64335e1acb94e7d910a21974f6b39eb" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 37305 } } peers { permanent_uuid: "4a67b42bf489487a917c5c0e4f660b40" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 44665 } } peers { permanent_uuid: "63f1e22476c94c798bdee92ab2e3a7d8" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 34115 } }
I20260808 14:48:54.179838 25654 raft_consensus.cc:374] T acf0530bc79148b69d76e686b847bc87 P 63f1e22476c94c798bdee92ab2e3a7d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:48:54.179872 25654 raft_consensus.cc:729] T acf0530bc79148b69d76e686b847bc87 P 63f1e22476c94c798bdee92ab2e3a7d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f1e22476c94c798bdee92ab2e3a7d8, State: Initialized, Role: FOLLOWER
I20260808 14:48:54.180015 25654 consensus_queue.cc:260] T acf0530bc79148b69d76e686b847bc87 P 63f1e22476c94c798bdee92ab2e3a7d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e64335e1acb94e7d910a21974f6b39eb" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 37305 } } peers { permanent_uuid: "4a67b42bf489487a917c5c0e4f660b40" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 44665 } } peers { permanent_uuid: "63f1e22476c94c798bdee92ab2e3a7d8" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 34115 } }
I20260808 14:48:54.180081 25655 raft_consensus.cc:348] T acf0530bc79148b69d76e686b847bc87 P e64335e1acb94e7d910a21974f6b39eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e64335e1acb94e7d910a21974f6b39eb" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 37305 } } peers { permanent_uuid: "4a67b42bf489487a917c5c0e4f660b40" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 44665 } } peers { permanent_uuid: "63f1e22476c94c798bdee92ab2e3a7d8" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 34115 } }
I20260808 14:48:54.180081 25653 raft_consensus.cc:348] T acf0530bc79148b69d76e686b847bc87 P 4a67b42bf489487a917c5c0e4f660b40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e64335e1acb94e7d910a21974f6b39eb" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 37305 } } peers { permanent_uuid: "4a67b42bf489487a917c5c0e4f660b40" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 44665 } } peers { permanent_uuid: "63f1e22476c94c798bdee92ab2e3a7d8" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 34115 } }
I20260808 14:48:54.180256 25655 raft_consensus.cc:374] T acf0530bc79148b69d76e686b847bc87 P e64335e1acb94e7d910a21974f6b39eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:48:54.180256 25653 raft_consensus.cc:374] T acf0530bc79148b69d76e686b847bc87 P 4a67b42bf489487a917c5c0e4f660b40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:48:54.180299 25655 raft_consensus.cc:729] T acf0530bc79148b69d76e686b847bc87 P e64335e1acb94e7d910a21974f6b39eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e64335e1acb94e7d910a21974f6b39eb, State: Initialized, Role: FOLLOWER
I20260808 14:48:54.180299 25653 raft_consensus.cc:729] T acf0530bc79148b69d76e686b847bc87 P 4a67b42bf489487a917c5c0e4f660b40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a67b42bf489487a917c5c0e4f660b40, State: Initialized, Role: FOLLOWER
I20260808 14:48:54.180307 25654 ts_tablet_manager.cc:1428] T acf0530bc79148b69d76e686b847bc87 P 63f1e22476c94c798bdee92ab2e3a7d8: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:48:54.180437 25632 heartbeater.cc:503] Master 127.30.214.190:42591 was elected leader, sending a full tablet report...
I20260808 14:48:54.180414 25653 consensus_queue.cc:260] T acf0530bc79148b69d76e686b847bc87 P 4a67b42bf489487a917c5c0e4f660b40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e64335e1acb94e7d910a21974f6b39eb" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 37305 } } peers { permanent_uuid: "4a67b42bf489487a917c5c0e4f660b40" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 44665 } } peers { permanent_uuid: "63f1e22476c94c798bdee92ab2e3a7d8" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 34115 } }
I20260808 14:48:54.180418 25655 consensus_queue.cc:260] T acf0530bc79148b69d76e686b847bc87 P e64335e1acb94e7d910a21974f6b39eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e64335e1acb94e7d910a21974f6b39eb" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 37305 } } peers { permanent_uuid: "4a67b42bf489487a917c5c0e4f660b40" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 44665 } } peers { permanent_uuid: "63f1e22476c94c798bdee92ab2e3a7d8" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 34115 } }
I20260808 14:48:54.180686 25653 ts_tablet_manager.cc:1428] T acf0530bc79148b69d76e686b847bc87 P 4a67b42bf489487a917c5c0e4f660b40: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 14:48:54.180696 25655 ts_tablet_manager.cc:1428] T acf0530bc79148b69d76e686b847bc87 P e64335e1acb94e7d910a21974f6b39eb: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260808 14:48:54.180704 25230 heartbeater.cc:503] Master 127.30.214.190:42591 was elected leader, sending a full tablet report...
I20260808 14:48:54.180805 25438 heartbeater.cc:503] Master 127.30.214.190:42591 was elected leader, sending a full tablet report...
I20260808 14:48:54.185742 25662 raft_consensus.cc:482] T acf0530bc79148b69d76e686b847bc87 P e64335e1acb94e7d910a21974f6b39eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:48:54.185838 25662 raft_consensus.cc:504] T acf0530bc79148b69d76e686b847bc87 P e64335e1acb94e7d910a21974f6b39eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e64335e1acb94e7d910a21974f6b39eb" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 37305 } } peers { permanent_uuid: "4a67b42bf489487a917c5c0e4f660b40" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 44665 } } peers { permanent_uuid: "63f1e22476c94c798bdee92ab2e3a7d8" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 34115 } }
I20260808 14:48:54.186177 25662 leader_election.cc:288] T acf0530bc79148b69d76e686b847bc87 P e64335e1acb94e7d910a21974f6b39eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a67b42bf489487a917c5c0e4f660b40 (127.30.214.129:44665), 63f1e22476c94c798bdee92ab2e3a7d8 (127.30.214.131:34115)
I20260808 14:48:54.189299 25440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:54.186325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.129:44665 (local address 127.30.214.130:60965)
0808 14:48:54.186379 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:54.186400 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 14:48:54.186445 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:48:54.186581 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:48:54.186582 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:48:54.186583 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:48:54.186646 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:54.186647 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:54.187247 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:54.187248 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:54.188442 (+ 1194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:54.188445 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:54.189103 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:54.189104 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:54.189166 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:54.189170 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:48:54.189208 (+ 38us) client_negotiation.cc:240] Negotiation successful
0808 14:48:54.189243 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260808 14:48:54.189328 25650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:54.186381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.130:60965 (local address 127.30.214.129:44665)
0808 14:48:54.186426 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 14:48:54.186428 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:48:54.186437 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:48:54.186518 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:48:54.186519 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:48:54.186529 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:48:54.186577 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:48:54.186717 (+ 140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:54.187179 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:54.188536 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:54.189027 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:54.189100 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:54.189110 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 14:48:54.189225 (+ 115us) server_negotiation.cc:299] Negotiation successful
0808 14:48:54.189261 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 14:48:54.189652 25651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:54.186475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.130:52535 (local address 127.30.214.131:34115)
0808 14:48:54.186518 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 14:48:54.186519 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:48:54.186778 (+ 259us) server_negotiation.cc:407] Connection header received
0808 14:48:54.186808 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:48:54.186809 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:48:54.186818 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:48:54.186869 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:48:54.186983 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:54.187565 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:54.188768 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:54.189303 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:54.189371 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:54.189379 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 14:48:54.189546 (+ 167us) server_negotiation.cc:299] Negotiation successful
0808 14:48:54.189590 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 14:48:54.189702 25163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acf0530bc79148b69d76e686b847bc87" candidate_uuid: "e64335e1acb94e7d910a21974f6b39eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a67b42bf489487a917c5c0e4f660b40" is_pre_election: true
I20260808 14:48:54.189851 25163 raft_consensus.cc:2454] T acf0530bc79148b69d76e686b847bc87 P 4a67b42bf489487a917c5c0e4f660b40 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e64335e1acb94e7d910a21974f6b39eb in term 0.
I20260808 14:48:54.190084 25664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:54.186331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.131:34115 (local address 127.30.214.130:52535)
0808 14:48:54.186724 (+ 393us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:54.186732 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 14:48:54.186768 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:48:54.186872 (+ 104us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:48:54.186873 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:48:54.186874 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:48:54.186933 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:54.186935 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:54.187661 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:54.187662 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:54.188694 (+ 1032us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:54.188696 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:54.189386 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:54.189386 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:54.189475 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:54.189480 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 14:48:54.189523 (+ 43us) client_negotiation.cc:240] Negotiation successful
0808 14:48:54.190010 (+ 487us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":380,"mutex_wait_us":115,"thread_start_us":109,"threads_started":1}
I20260808 14:48:54.190088 25267 leader_election.cc:302] T acf0530bc79148b69d76e686b847bc87 P e64335e1acb94e7d910a21974f6b39eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a67b42bf489487a917c5c0e4f660b40, e64335e1acb94e7d910a21974f6b39eb; no voters:
I20260808 14:48:54.190234 25662 raft_consensus.cc:2781] T acf0530bc79148b69d76e686b847bc87 P e64335e1acb94e7d910a21974f6b39eb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:48:54.190282 25662 raft_consensus.cc:482] T acf0530bc79148b69d76e686b847bc87 P e64335e1acb94e7d910a21974f6b39eb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:48:54.190304 25662 raft_consensus.cc:3037] T acf0530bc79148b69d76e686b847bc87 P e64335e1acb94e7d910a21974f6b39eb [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:48:54.190413 25565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acf0530bc79148b69d76e686b847bc87" candidate_uuid: "e64335e1acb94e7d910a21974f6b39eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f1e22476c94c798bdee92ab2e3a7d8" is_pre_election: true
I20260808 14:48:54.190557 25565 raft_consensus.cc:2454] T acf0530bc79148b69d76e686b847bc87 P 63f1e22476c94c798bdee92ab2e3a7d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e64335e1acb94e7d910a21974f6b39eb in term 0.
I20260808 14:48:54.191120 25662 raft_consensus.cc:504] T acf0530bc79148b69d76e686b847bc87 P e64335e1acb94e7d910a21974f6b39eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e64335e1acb94e7d910a21974f6b39eb" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 37305 } } peers { permanent_uuid: "4a67b42bf489487a917c5c0e4f660b40" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 44665 } } peers { permanent_uuid: "63f1e22476c94c798bdee92ab2e3a7d8" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 34115 } }
I20260808 14:48:54.191251 25662 leader_election.cc:288] T acf0530bc79148b69d76e686b847bc87 P e64335e1acb94e7d910a21974f6b39eb [CANDIDATE]: Term 1 election: Requested vote from peers 4a67b42bf489487a917c5c0e4f660b40 (127.30.214.129:44665), 63f1e22476c94c798bdee92ab2e3a7d8 (127.30.214.131:34115)
I20260808 14:48:54.191402 25565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acf0530bc79148b69d76e686b847bc87" candidate_uuid: "e64335e1acb94e7d910a21974f6b39eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f1e22476c94c798bdee92ab2e3a7d8"
I20260808 14:48:54.191414 25163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acf0530bc79148b69d76e686b847bc87" candidate_uuid: "e64335e1acb94e7d910a21974f6b39eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a67b42bf489487a917c5c0e4f660b40"
I20260808 14:48:54.191484 25565 raft_consensus.cc:3037] T acf0530bc79148b69d76e686b847bc87 P 63f1e22476c94c798bdee92ab2e3a7d8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:48:54.191484 25163 raft_consensus.cc:3037] T acf0530bc79148b69d76e686b847bc87 P 4a67b42bf489487a917c5c0e4f660b40 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:48:54.192368 25163 raft_consensus.cc:2454] T acf0530bc79148b69d76e686b847bc87 P 4a67b42bf489487a917c5c0e4f660b40 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e64335e1acb94e7d910a21974f6b39eb in term 1.
I20260808 14:48:54.192368 25565 raft_consensus.cc:2454] T acf0530bc79148b69d76e686b847bc87 P 63f1e22476c94c798bdee92ab2e3a7d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e64335e1acb94e7d910a21974f6b39eb in term 1.
I20260808 14:48:54.192543 25264 leader_election.cc:302] T acf0530bc79148b69d76e686b847bc87 P e64335e1acb94e7d910a21974f6b39eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f1e22476c94c798bdee92ab2e3a7d8, e64335e1acb94e7d910a21974f6b39eb; no voters:
I20260808 14:48:54.192651 25662 raft_consensus.cc:2781] T acf0530bc79148b69d76e686b847bc87 P e64335e1acb94e7d910a21974f6b39eb [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:48:54.192796 25662 raft_consensus.cc:686] T acf0530bc79148b69d76e686b847bc87 P e64335e1acb94e7d910a21974f6b39eb [term 1 LEADER]: Becoming Leader. State: Replica: e64335e1acb94e7d910a21974f6b39eb, State: Running, Role: LEADER
I20260808 14:48:54.192880 25662 consensus_queue.cc:237] T acf0530bc79148b69d76e686b847bc87 P e64335e1acb94e7d910a21974f6b39eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e64335e1acb94e7d910a21974f6b39eb" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 37305 } } peers { permanent_uuid: "4a67b42bf489487a917c5c0e4f660b40" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 44665 } } peers { permanent_uuid: "63f1e22476c94c798bdee92ab2e3a7d8" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 34115 } }
I20260808 14:48:54.193801 24936 catalog_manager.cc:5495] T acf0530bc79148b69d76e686b847bc87 P e64335e1acb94e7d910a21974f6b39eb reported cstate change: term changed from 0 to 1, leader changed from <none> to e64335e1acb94e7d910a21974f6b39eb (127.30.214.130). New cstate: current_term: 1 leader_uuid: "e64335e1acb94e7d910a21974f6b39eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e64335e1acb94e7d910a21974f6b39eb" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 37305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a67b42bf489487a917c5c0e4f660b40" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 44665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63f1e22476c94c798bdee92ab2e3a7d8" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 34115 } health_report { overall_health: UNKNOWN } } }
I20260808 14:48:54.206247 25649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:54.204039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46444 (local address 127.30.214.130:37305)
0808 14:48:54.204094 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 14:48:54.204096 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:48:54.204105 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:48:54.204146 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:48:54.204147 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:48:54.204164 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:48:54.204223 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:48:54.204336 (+ 113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:54.204831 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:54.205632 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:54.205819 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:54.205862 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:54.205957 (+ 95us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:48:54.206060 (+ 103us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:48:54.206117 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 14:48:54.206130 (+ 13us) server_negotiation.cc:299] Negotiation successful
0808 14:48:54.206151 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 14:48:54.208141 25163 raft_consensus.cc:1261] T acf0530bc79148b69d76e686b847bc87 P 4a67b42bf489487a917c5c0e4f660b40 [term 1 FOLLOWER]: Refusing update from remote peer e64335e1acb94e7d910a21974f6b39eb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:48:54.208177 25565 raft_consensus.cc:1261] T acf0530bc79148b69d76e686b847bc87 P 63f1e22476c94c798bdee92ab2e3a7d8 [term 1 FOLLOWER]: Refusing update from remote peer e64335e1acb94e7d910a21974f6b39eb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:48:54.208544 25662 consensus_queue.cc:1035] T acf0530bc79148b69d76e686b847bc87 P e64335e1acb94e7d910a21974f6b39eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f1e22476c94c798bdee92ab2e3a7d8" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 34115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:48:54.208703 25665 consensus_queue.cc:1035] T acf0530bc79148b69d76e686b847bc87 P e64335e1acb94e7d910a21974f6b39eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a67b42bf489487a917c5c0e4f660b40" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 44665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:48:54.212339 25670 mvcc.cc:205] Tried to move back new op lower bound from 7316277388113907712 to 7316277388054839296. Current Snapshot: MvccSnapshot[applied={T|T < 7316277388113907712}]
I20260808 14:48:54.213877 24934 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59700:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:48:54.213971 24934 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59700:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:48:54.214736 24934 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 02f3fc3b14134ddcae29a06c909485ae: Sending DeleteTablet for 3 replicas of tablet acf0530bc79148b69d76e686b847bc87
I20260808 14:48:54.215067 25539 tablet_service.cc:1514] Processing DeleteTablet for tablet acf0530bc79148b69d76e686b847bc87 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:48:54 UTC) from {username='kudu', principal='kudu/127.30.214.190@KRBTEST.COM'} at 127.0.0.1:39490
I20260808 14:48:54.215090 25136 tablet_service.cc:1514] Processing DeleteTablet for tablet acf0530bc79148b69d76e686b847bc87 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:48:54 UTC) from {username='kudu', principal='kudu/127.30.214.190@KRBTEST.COM'} at 127.0.0.1:52102
I20260808 14:48:54.215294 25331 tablet_service.cc:1514] Processing DeleteTablet for tablet acf0530bc79148b69d76e686b847bc87 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:48:54 UTC) from {username='kudu', principal='kudu/127.30.214.190@KRBTEST.COM'} at 127.0.0.1:46428
I20260808 14:48:54.215312 25683 tablet_replica.cc:330] T acf0530bc79148b69d76e686b847bc87 P 4a67b42bf489487a917c5c0e4f660b40: stopping tablet replica
I20260808 14:48:54.215462 25683 raft_consensus.cc:2229] T acf0530bc79148b69d76e686b847bc87 P 4a67b42bf489487a917c5c0e4f660b40 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:48:54.215514 25685 tablet_replica.cc:330] T acf0530bc79148b69d76e686b847bc87 P e64335e1acb94e7d910a21974f6b39eb: stopping tablet replica
I20260808 14:48:54.215615 25685 raft_consensus.cc:2229] T acf0530bc79148b69d76e686b847bc87 P e64335e1acb94e7d910a21974f6b39eb [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:48:54.215626 25683 raft_consensus.cc:2258] T acf0530bc79148b69d76e686b847bc87 P 4a67b42bf489487a917c5c0e4f660b40 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:48:54.215735 25685 raft_consensus.cc:2258] T acf0530bc79148b69d76e686b847bc87 P e64335e1acb94e7d910a21974f6b39eb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:48:54.215824 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 25033
I20260808 14:48:54.216182 25685 ts_tablet_manager.cc:1905] T acf0530bc79148b69d76e686b847bc87 P e64335e1acb94e7d910a21974f6b39eb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:48:54.218659 25685 ts_tablet_manager.cc:1918] T acf0530bc79148b69d76e686b847bc87 P e64335e1acb94e7d910a21974f6b39eb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:48:54.218753 25685 log.cc:1196] T acf0530bc79148b69d76e686b847bc87 P e64335e1acb94e7d910a21974f6b39eb: Deleting WAL directory at /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/minicluster-data/ts-1/wal/wals/acf0530bc79148b69d76e686b847bc87
I20260808 14:48:54.219064 25685 ts_tablet_manager.cc:1939] T acf0530bc79148b69d76e686b847bc87 P e64335e1acb94e7d910a21974f6b39eb: Deleting consensus metadata
I20260808 14:48:54.219568 24917 catalog_manager.cc:4841] TS e64335e1acb94e7d910a21974f6b39eb (127.30.214.130:37305): tablet acf0530bc79148b69d76e686b847bc87 (table test-table [id=2f5b37c19acf459faf195d4d2ae90bdd]) successfully deleted
I20260808 14:48:54.224524 25684 tablet_replica.cc:330] T acf0530bc79148b69d76e686b847bc87 P 63f1e22476c94c798bdee92ab2e3a7d8: stopping tablet replica
I20260808 14:48:54.225730 25684 raft_consensus.cc:2229] T acf0530bc79148b69d76e686b847bc87 P 63f1e22476c94c798bdee92ab2e3a7d8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:48:54.225953 25684 raft_consensus.cc:2258] T acf0530bc79148b69d76e686b847bc87 P 63f1e22476c94c798bdee92ab2e3a7d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:48:54.226552 25684 ts_tablet_manager.cc:1905] T acf0530bc79148b69d76e686b847bc87 P 63f1e22476c94c798bdee92ab2e3a7d8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:48:54.228318 25684 ts_tablet_manager.cc:1918] T acf0530bc79148b69d76e686b847bc87 P 63f1e22476c94c798bdee92ab2e3a7d8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:48:54.228454 25684 log.cc:1196] T acf0530bc79148b69d76e686b847bc87 P 63f1e22476c94c798bdee92ab2e3a7d8: Deleting WAL directory at /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786200295877777-31578-0/minicluster-data/ts-2/wal/wals/acf0530bc79148b69d76e686b847bc87
I20260808 14:48:54.228813 25684 ts_tablet_manager.cc:1939] T acf0530bc79148b69d76e686b847bc87 P 63f1e22476c94c798bdee92ab2e3a7d8: Deleting consensus metadata
I20260808 14:48:54.229380 24915 catalog_manager.cc:4841] TS 63f1e22476c94c798bdee92ab2e3a7d8 (127.30.214.131:34115): tablet acf0530bc79148b69d76e686b847bc87 (table test-table [id=2f5b37c19acf459faf195d4d2ae90bdd]) successfully deleted
W20260808 14:48:54.229676 24916 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.30.214.129:44665 (error 108)
I20260808 14:48:54.229885 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 25236
I20260808 14:48:54.230227 25648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:54.230099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.129:44665 (local address 127.0.0.1:52114)
0808 14:48:54.230152 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:54.230190 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.129:44665: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260808 14:48:54.232256 24916 catalog_manager.cc:4584] TS 4a67b42bf489487a917c5c0e4f660b40 (127.30.214.129:44665): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet acf0530bc79148b69d76e686b847bc87: Network error: Client connection negotiation failed: client connection to 127.30.214.129:44665: connect: Connection refused (error 111)
I20260808 14:48:54.240790 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 25444
I20260808 14:48:54.260465 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 24891
2026-08-08T14:48:54Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2033 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-08T14:48:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:48:54Z Disabled control of system clock
I20260808 14:48:54.297735 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200295877777-31578-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200295877777-31578-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200295877777-31578-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:44145
--webserver_interface=127.30.214.190
--webserver_port=0
--builtin_ntp_servers=127.30.214.148:45933
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.214.190:44145
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 14:48:54.380604 25693 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:48:54.380836 25693 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:48:54.380857 25693 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:48:54.382128 25693 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:48:54.382172 25693 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:48:54.382184 25693 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:48:54.382197 25693 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:48:54.382221 25693 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:48:54.383625 25693 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:45933
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200295877777-31578-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200295877777-31578-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.214.190:44145
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:44145
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25693
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200295877777-31578-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:48:54.383879 25693 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:48:54.384187 25693 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:48:54.388918 25704 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:48:54.388926 25708 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:48:54.388935 25703 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:48:54.389045 25693 server_base.cc:1034] running on GCE node
I20260808 14:48:54.389459 25693 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:48:54.389773 25693 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:48:54.390914 25693 hybrid_clock.cc:648] HybridClock initialized: now 1786200534390896 us; error 32 us; skew 500 ppm
I20260808 14:48:54.392280 25693 webserver.cc:460] Webserver started at http://127.30.214.190:42779/ using document root <none> and password file <none>
I20260808 14:48:54.392517 25693 fs_manager.cc:359] Metadata directory not provided
I20260808 14:48:54.392576 25693 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:48:54.392709 25693 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:48:54.393893 25693 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200295877777-31578-0/minicluster-data/master-0/data/instance:
uuid: "60baae82f78846b3a614479f19c27ddb"
format_stamp: "Formatted at 2026-08-08 14:48:54 on dist-test-slave-42z9"
server_key: "ae91619db44154fd9c07f2a1d6a6dfae"
server_key_iv: "1501121f09da2bb321d1346d031a2b61"
server_key_version: "encryptionkey@0"
I20260808 14:48:54.394243 25693 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200295877777-31578-0/minicluster-data/master-0/wal/instance:
uuid: "60baae82f78846b3a614479f19c27ddb"
format_stamp: "Formatted at 2026-08-08 14:48:54 on dist-test-slave-42z9"
server_key: "ae91619db44154fd9c07f2a1d6a6dfae"
server_key_iv: "1501121f09da2bb321d1346d031a2b61"
server_key_version: "encryptionkey@0"
I20260808 14:48:54.395502 25693 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:48:54.396205 25722 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:48:54.396375 25693 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 14:48:54.396461 25693 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200295877777-31578-0/minicluster-data/master-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200295877777-31578-0/minicluster-data/master-0/wal
uuid: "60baae82f78846b3a614479f19c27ddb"
format_stamp: "Formatted at 2026-08-08 14:48:54 on dist-test-slave-42z9"
server_key: "ae91619db44154fd9c07f2a1d6a6dfae"
server_key_iv: "1501121f09da2bb321d1346d031a2b61"
server_key_version: "encryptionkey@0"
I20260808 14:48:54.396533 25693 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200295877777-31578-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200295877777-31578-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200295877777-31578-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:48:54.409796 25693 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:48:54.410116 25693 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:48:54.410250 25693 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:48:54.414304 25693 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.190:44145
I20260808 14:48:54.414341 25799 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.190:44145 every 8 connection(s)
I20260808 14:48:54.414691 25693 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
I20260808 14:48:54.415683 25800 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:48:54.418149 25800 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 60baae82f78846b3a614479f19c27ddb: Bootstrap starting.
I20260808 14:48:54.418751 25800 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 60baae82f78846b3a614479f19c27ddb: Neither blocks nor log segments found. Creating new log.
I20260808 14:48:54.419044 25800 log.cc:824] T 00000000000000000000000000000000 P 60baae82f78846b3a614479f19c27ddb: Log is configured to *not* fsync() on all Append() calls
I20260808 14:48:54.419757 25800 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 60baae82f78846b3a614479f19c27ddb: No bootstrap required, opened a new log
I20260808 14:48:54.421411 25800 raft_consensus.cc:348] T 00000000000000000000000000000000 P 60baae82f78846b3a614479f19c27ddb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60baae82f78846b3a614479f19c27ddb" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 44145 } }
I20260808 14:48:54.421608 25800 raft_consensus.cc:374] T 00000000000000000000000000000000 P 60baae82f78846b3a614479f19c27ddb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:48:54.421636 25800 raft_consensus.cc:729] T 00000000000000000000000000000000 P 60baae82f78846b3a614479f19c27ddb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60baae82f78846b3a614479f19c27ddb, State: Initialized, Role: FOLLOWER
I20260808 14:48:54.421785 25800 consensus_queue.cc:260] T 00000000000000000000000000000000 P 60baae82f78846b3a614479f19c27ddb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60baae82f78846b3a614479f19c27ddb" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 44145 } }
I20260808 14:48:54.421849 25800 raft_consensus.cc:388] T 00000000000000000000000000000000 P 60baae82f78846b3a614479f19c27ddb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:48:54.421882 25800 raft_consensus.cc:482] T 00000000000000000000000000000000 P 60baae82f78846b3a614479f19c27ddb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:48:54.421928 25800 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 60baae82f78846b3a614479f19c27ddb [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:48:54.422482 25800 raft_consensus.cc:504] T 00000000000000000000000000000000 P 60baae82f78846b3a614479f19c27ddb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60baae82f78846b3a614479f19c27ddb" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 44145 } }
I20260808 14:48:54.422575 25800 leader_election.cc:302] T 00000000000000000000000000000000 P 60baae82f78846b3a614479f19c27ddb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 60baae82f78846b3a614479f19c27ddb; no voters:
I20260808 14:48:54.422730 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 25693
I20260808 14:48:54.422760 25800 leader_election.cc:288] T 00000000000000000000000000000000 P 60baae82f78846b3a614479f19c27ddb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:48:54.422806 25806 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 60baae82f78846b3a614479f19c27ddb [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:48:54.422829 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200295877777-31578-0/minicluster-data/master-0/wal/instance
I20260808 14:48:54.422943 25806 raft_consensus.cc:686] T 00000000000000000000000000000000 P 60baae82f78846b3a614479f19c27ddb [term 1 LEADER]: Becoming Leader. State: Replica: 60baae82f78846b3a614479f19c27ddb, State: Running, Role: LEADER
I20260808 14:48:54.423019 31578 external_mini_cluster.cc:1428] Setting key 84bb4bb79e6b7ed7b62dd88bfc8cf584
I20260808 14:48:54.423032 25800 sys_catalog.cc:564] T 00000000000000000000000000000000 P 60baae82f78846b3a614479f19c27ddb [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:48:54.423117 25806 consensus_queue.cc:237] T 00000000000000000000000000000000 P 60baae82f78846b3a614479f19c27ddb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60baae82f78846b3a614479f19c27ddb" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 44145 } }
I20260808 14:48:54.423581 25809 sys_catalog.cc:455] T 00000000000000000000000000000000 P 60baae82f78846b3a614479f19c27ddb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "60baae82f78846b3a614479f19c27ddb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60baae82f78846b3a614479f19c27ddb" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 44145 } } }
I20260808 14:48:54.423830 25809 sys_catalog.cc:458] T 00000000000000000000000000000000 P 60baae82f78846b3a614479f19c27ddb [sys.catalog]: This master's current role is: LEADER
I20260808 14:48:54.423765 25808 sys_catalog.cc:455] T 00000000000000000000000000000000 P 60baae82f78846b3a614479f19c27ddb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 60baae82f78846b3a614479f19c27ddb. Latest consensus state: current_term: 1 leader_uuid: "60baae82f78846b3a614479f19c27ddb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60baae82f78846b3a614479f19c27ddb" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 44145 } } }
I20260808 14:48:54.424093 25808 sys_catalog.cc:458] T 00000000000000000000000000000000 P 60baae82f78846b3a614479f19c27ddb [sys.catalog]: This master's current role is: LEADER
W20260808 14:48:54.424851 25831 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 60baae82f78846b3a614479f19c27ddb: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:48:54.424966 25831 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:48:54.425055 25821 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:48:54.425237 25821 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:48:54.426668 25821 catalog_manager.cc:1347] Generated new cluster ID: d6d0f28062bd4ff6a97efdf85a18ce21
I20260808 14:48:54.426728 25821 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:48:54.429695 25820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:54.423522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33254 (local address 127.30.214.190:44145)
0808 14:48:54.424342 (+ 820us) server_negotiation.cc:206] Beginning negotiation
0808 14:48:54.424351 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:48:54.424386 (+ 35us) server_negotiation.cc:407] Connection header received
0808 14:48:54.424511 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:48:54.424519 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:48:54.424590 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:48:54.424735 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:48:54.424986 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:54.426380 (+ 1394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:54.427468 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:54.428131 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:54.428291 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:54.428938 (+ 647us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:48:54.428942 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:48:54.428942 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:48:54.429174 (+ 232us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:48:54.429220 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:48:54.429236 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:48:54.429307 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 14:48:54.429366 (+ 59us) server_negotiation.cc:299] Negotiation successful
0808 14:48:54.429474 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":744,"thread_start_us":405,"threads_started":1}
I20260808 14:48:54.444427 25821 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:48:54.445012 25821 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:48:54.456338 25821 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 60baae82f78846b3a614479f19c27ddb: Generated new TSK 0
I20260808 14:48:54.456549 25821 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:48:54.457963 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200295877777-31578-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200295877777-31578-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200295877777-31578-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.129:0
--local_ip_for_outbound_sockets=127.30.214.129
--webserver_interface=127.30.214.129
--webserver_port=0
--tserver_master_addrs=127.30.214.190:44145
--builtin_ntp_servers=127.30.214.148:45933
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 14:48:54.541517 25835 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:48:54.541736 25835 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:48:54.541757 25835 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:48:54.542955 25835 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:48:54.542999 25835 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:48:54.543025 25835 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.129
I20260808 14:48:54.544405 25835 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:45933
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200295877777-31578-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200295877777-31578-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.214.129
--webserver_port=0
--tserver_master_addrs=127.30.214.190:44145
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25835
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.129
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200295877777-31578-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:48:54.544647 25835 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:48:54.544940 25835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:48:54.549937 25845 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:48:54.550127 25844 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:48:54.550117 25851 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:48:54.550305 25835 server_base.cc:1034] running on GCE node
I20260808 14:48:54.550546 25835 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:48:54.550793 25835 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:48:54.551985 25835 hybrid_clock.cc:648] HybridClock initialized: now 1786200534551972 us; error 29 us; skew 500 ppm
I20260808 14:48:54.553215 25835 webserver.cc:460] Webserver started at http://127.30.214.129:38911/ using document root <none> and password file <none>
I20260808 14:48:54.553476 25835 fs_manager.cc:359] Metadata directory not provided
I20260808 14:48:54.553539 25835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:48:54.553675 25835 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:48:54.554770 25835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200295877777-31578-0/minicluster-data/ts-0/data/instance:
uuid: "8b64bf682306419d8a925cee735d97f8"
format_stamp: "Formatted at 2026-08-08 14:48:54 on dist-test-slave-42z9"
server_key: "228c4c1959357ca14ff2c04026133c2f"
server_key_iv: "76dd9b99b0afbd971279cc035a2015c4"
server_key_version: "encryptionkey@0"
I20260808 14:48:54.555110 25835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200295877777-31578-0/minicluster-data/ts-0/wal/instance:
uuid: "8b64bf682306419d8a925cee735d97f8"
format_stamp: "Formatted at 2026-08-08 14:48:54 on dist-test-slave-42z9"
server_key: "228c4c1959357ca14ff2c04026133c2f"
server_key_iv: "76dd9b99b0afbd971279cc035a2015c4"
server_key_version: "encryptionkey@0"
I20260808 14:48:54.556586 25835 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:48:54.557345 25861 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:48:54.557552 25835 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:48:54.557646 25835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200295877777-31578-0/minicluster-data/ts-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200295877777-31578-0/minicluster-data/ts-0/wal
uuid: "8b64bf682306419d8a925cee735d97f8"
format_stamp: "Formatted at 2026-08-08 14:48:54 on dist-test-slave-42z9"
server_key: "228c4c1959357ca14ff2c04026133c2f"
server_key_iv: "76dd9b99b0afbd971279cc035a2015c4"
server_key_version: "encryptionkey@0"
I20260808 14:48:54.557724 25835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200295877777-31578-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200295877777-31578-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200295877777-31578-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:48:54.576962 25835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:48:54.577292 25835 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:48:54.577529 25835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:48:54.577782 25835 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:48:54.578128 25835 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:48:54.578164 25835 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:48:54.578194 25835 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:48:54.578217 25835 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:48:54.583810 25835 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.129:41043
I20260808 14:48:54.583866 26032 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.129:41043 every 8 connection(s)
I20260808 14:48:54.584203 25835 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
I20260808 14:48:54.589600 25820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:54.584944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.129:38997 (local address 127.30.214.190:44145)
0808 14:48:54.585036 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0808 14:48:54.585038 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:48:54.585227 (+ 189us) server_negotiation.cc:407] Connection header received
0808 14:48:54.585784 (+ 557us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:48:54.585785 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:48:54.585797 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:48:54.585861 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:48:54.586599 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:54.587315 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:54.588271 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:54.588509 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:54.588556 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:54.589317 (+ 761us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:48:54.589318 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:48:54.589319 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:48:54.589324 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:48:54.589340 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:48:54.589344 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:48:54.589396 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 14:48:54.589491 (+ 95us) server_negotiation.cc:299] Negotiation successful
0808 14:48:54.589537 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 14:48:54.589783 26042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:54.584914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:44145 (local address 127.30.214.129:38997)
0808 14:48:54.585104 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:54.585140 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 14:48:54.585687 (+ 547us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:48:54.585924 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:48:54.585928 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:48:54.585937 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:48:54.586434 (+ 497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:54.586439 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:54.587403 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:54.587404 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:54.588203 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:54.588206 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:54.588570 (+ 364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:54.588571 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:54.588678 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:54.589186 (+ 508us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:48:54.589187 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:48:54.589216 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:48:54.589241 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:48:54.589403 (+ 162us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:48:54.589405 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:48:54.589407 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 14:48:54.589486 (+ 79us) client_negotiation.cc:240] Negotiation successful
0808 14:48:54.589577 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":92,"threads_started":1}
I20260808 14:48:54.590299 26038 heartbeater.cc:347] Connected to a master server at 127.30.214.190:44145
I20260808 14:48:54.590406 26038 heartbeater.cc:464] Registering TS with master...
I20260808 14:48:54.590569 26038 heartbeater.cc:511] Master 127.30.214.190:44145 requested a full tablet report, sending...
I20260808 14:48:54.591046 25745 ts_manager.cc:194] Registered new tserver with Master: 8b64bf682306419d8a925cee735d97f8 (127.30.214.129:41043)
I20260808 14:48:54.591702 25745 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.30.214.129:38997
I20260808 14:48:54.594195 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 25835
I20260808 14:48:54.594295 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200295877777-31578-0/minicluster-data/ts-0/wal/instance
I20260808 14:48:54.594462 31578 external_mini_cluster.cc:1428] Setting key 08a66633731f568b65d8ea6a0c391605
I20260808 14:48:54.595337 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200295877777-31578-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200295877777-31578-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200295877777-31578-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.130:0
--local_ip_for_outbound_sockets=127.30.214.130
--webserver_interface=127.30.214.130
--webserver_port=0
--tserver_master_addrs=127.30.214.190:44145
--builtin_ntp_servers=127.30.214.148:45933
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 14:48:54.677646 26043 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:48:54.677868 26043 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:48:54.677891 26043 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:48:54.679045 26043 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:48:54.679082 26043 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:48:54.679108 26043 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.130
I20260808 14:48:54.680454 26043 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:45933
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200295877777-31578-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200295877777-31578-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.214.130
--webserver_port=0
--tserver_master_addrs=127.30.214.190:44145
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26043
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.130
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200295877777-31578-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:48:54.680694 26043 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:48:54.680974 26043 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:48:54.685950 26051 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:48:54.685974 26052 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:48:54.685961 26054 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:48:54.686101 26043 server_base.cc:1034] running on GCE node
I20260808 14:48:54.686378 26043 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:48:54.686650 26043 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:48:54.687791 26043 hybrid_clock.cc:648] HybridClock initialized: now 1786200534687779 us; error 31 us; skew 500 ppm
I20260808 14:48:54.689098 26043 webserver.cc:460] Webserver started at http://127.30.214.130:42923/ using document root <none> and password file <none>
I20260808 14:48:54.689340 26043 fs_manager.cc:359] Metadata directory not provided
I20260808 14:48:54.689391 26043 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:48:54.689558 26043 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:48:54.690644 26043 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200295877777-31578-0/minicluster-data/ts-1/data/instance:
uuid: "015735d1a004458b963c650b1c45270f"
format_stamp: "Formatted at 2026-08-08 14:48:54 on dist-test-slave-42z9"
server_key: "587d7ac27adafedf088710dfff862e19"
server_key_iv: "087318d57bfdc7b03e4ef6105919d4f2"
server_key_version: "encryptionkey@0"
I20260808 14:48:54.691017 26043 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200295877777-31578-0/minicluster-data/ts-1/wal/instance:
uuid: "015735d1a004458b963c650b1c45270f"
format_stamp: "Formatted at 2026-08-08 14:48:54 on dist-test-slave-42z9"
server_key: "587d7ac27adafedf088710dfff862e19"
server_key_iv: "087318d57bfdc7b03e4ef6105919d4f2"
server_key_version: "encryptionkey@0"
I20260808 14:48:54.692305 26043 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 14:48:54.693020 26063 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:48:54.693181 26043 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:48:54.693265 26043 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200295877777-31578-0/minicluster-data/ts-1/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200295877777-31578-0/minicluster-data/ts-1/wal
uuid: "015735d1a004458b963c650b1c45270f"
format_stamp: "Formatted at 2026-08-08 14:48:54 on dist-test-slave-42z9"
server_key: "587d7ac27adafedf088710dfff862e19"
server_key_iv: "087318d57bfdc7b03e4ef6105919d4f2"
server_key_version: "encryptionkey@0"
I20260808 14:48:54.693337 26043 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200295877777-31578-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200295877777-31578-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200295877777-31578-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:48:54.702606 26043 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:48:54.702922 26043 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:48:54.703049 26043 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:48:54.703272 26043 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:48:54.703605 26043 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:48:54.703639 26043 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:48:54.703670 26043 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:48:54.703693 26043 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:48:54.709391 26043 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.130:44715
I20260808 14:48:54.709465 26238 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.130:44715 every 8 connection(s)
I20260808 14:48:54.709805 26043 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
I20260808 14:48:54.711153 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 26043
I20260808 14:48:54.711241 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200295877777-31578-0/minicluster-data/ts-1/wal/instance
I20260808 14:48:54.711441 31578 external_mini_cluster.cc:1428] Setting key 725750e850f0d4f522ad3af5d5ac0433
I20260808 14:48:54.712340 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200295877777-31578-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200295877777-31578-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200295877777-31578-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.131:0
--local_ip_for_outbound_sockets=127.30.214.131
--webserver_interface=127.30.214.131
--webserver_port=0
--tserver_master_addrs=127.30.214.190:44145
--builtin_ntp_servers=127.30.214.148:45933
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 14:48:54.715411 25820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:54.710551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.130:58685 (local address 127.30.214.190:44145)
0808 14:48:54.710621 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0808 14:48:54.710623 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:48:54.710845 (+ 222us) server_negotiation.cc:407] Connection header received
0808 14:48:54.711387 (+ 542us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:48:54.711389 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:48:54.711403 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:48:54.711481 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:48:54.712173 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:54.712836 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:54.713935 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:54.714201 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:54.714272 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:54.715143 (+ 871us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:48:54.715144 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:48:54.715145 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:48:54.715150 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:48:54.715167 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:48:54.715172 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:48:54.715219 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 14:48:54.715297 (+ 78us) server_negotiation.cc:299] Negotiation successful
0808 14:48:54.715329 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 14:48:54.715621 26241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:54.710524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:44145 (local address 127.30.214.130:58685)
0808 14:48:54.710723 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:54.710759 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 14:48:54.711293 (+ 534us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:48:54.711560 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:48:54.711564 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:48:54.711574 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:48:54.712092 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:54.712097 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:54.712930 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:54.712930 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:54.713854 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:54.713857 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:54.714306 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:54.714308 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:54.714452 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:54.715011 (+ 559us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:48:54.715011 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:48:54.715041 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:48:54.715065 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:48:54.715225 (+ 160us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:48:54.715231 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:48:54.715235 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:48:54.715296 (+ 61us) client_negotiation.cc:240] Negotiation successful
0808 14:48:54.715406 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":94,"threads_started":1}
I20260808 14:48:54.716091 26239 heartbeater.cc:347] Connected to a master server at 127.30.214.190:44145
I20260808 14:48:54.716202 26239 heartbeater.cc:464] Registering TS with master...
I20260808 14:48:54.716413 26239 heartbeater.cc:511] Master 127.30.214.190:44145 requested a full tablet report, sending...
I20260808 14:48:54.716848 25745 ts_manager.cc:194] Registered new tserver with Master: 015735d1a004458b963c650b1c45270f (127.30.214.130:44715)
I20260808 14:48:54.717217 25745 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.30.214.130:58685
W20260808 14:48:54.796698 26243 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:48:54.796978 26243 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:48:54.797013 26243 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:48:54.798337 26243 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:48:54.798384 26243 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:48:54.798411 26243 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.131
I20260808 14:48:54.799964 26243 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:45933
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200295877777-31578-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200295877777-31578-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.214.131
--webserver_port=0
--tserver_master_addrs=127.30.214.190:44145
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26243
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.131
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200295877777-31578-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:48:54.800252 26243 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:48:54.800594 26243 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:48:54.805717 26249 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:48:54.805742 26252 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:48:54.805728 26250 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:48:54.805991 26243 server_base.cc:1034] running on GCE node
I20260808 14:48:54.806188 26243 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:48:54.806442 26243 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:48:54.807600 26243 hybrid_clock.cc:648] HybridClock initialized: now 1786200534807587 us; error 27 us; skew 500 ppm
I20260808 14:48:54.808910 26243 webserver.cc:460] Webserver started at http://127.30.214.131:42699/ using document root <none> and password file <none>
I20260808 14:48:54.809202 26243 fs_manager.cc:359] Metadata directory not provided
I20260808 14:48:54.809267 26243 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:48:54.809402 26243 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:48:54.810626 26243 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200295877777-31578-0/minicluster-data/ts-2/data/instance:
uuid: "dd4ac6ce4606442284c65b3c75d10897"
format_stamp: "Formatted at 2026-08-08 14:48:54 on dist-test-slave-42z9"
server_key: "52b256df93cb5adfd5af65edbbc62042"
server_key_iv: "30056fe16f1416b39def1d8ba4eb186d"
server_key_version: "encryptionkey@0"
I20260808 14:48:54.810916 26243 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200295877777-31578-0/minicluster-data/ts-2/wal/instance:
uuid: "dd4ac6ce4606442284c65b3c75d10897"
format_stamp: "Formatted at 2026-08-08 14:48:54 on dist-test-slave-42z9"
server_key: "52b256df93cb5adfd5af65edbbc62042"
server_key_iv: "30056fe16f1416b39def1d8ba4eb186d"
server_key_version: "encryptionkey@0"
I20260808 14:48:54.812119 26243 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 14:48:54.812791 26261 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:48:54.812915 26243 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:48:54.812987 26243 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200295877777-31578-0/minicluster-data/ts-2/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200295877777-31578-0/minicluster-data/ts-2/wal
uuid: "dd4ac6ce4606442284c65b3c75d10897"
format_stamp: "Formatted at 2026-08-08 14:48:54 on dist-test-slave-42z9"
server_key: "52b256df93cb5adfd5af65edbbc62042"
server_key_iv: "30056fe16f1416b39def1d8ba4eb186d"
server_key_version: "encryptionkey@0"
I20260808 14:48:54.813045 26243 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200295877777-31578-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200295877777-31578-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200295877777-31578-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:48:54.838135 26243 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:48:54.838461 26243 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:48:54.838572 26243 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:48:54.838771 26243 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:48:54.839057 26243 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:48:54.839088 26243 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:48:54.839111 26243 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:48:54.839128 26243 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:48:54.844892 26243 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.131:34785
I20260808 14:48:54.844945 26434 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.131:34785 every 8 connection(s)
I20260808 14:48:54.845275 26243 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
I20260808 14:48:54.848999 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 26243
I20260808 14:48:54.849100 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200295877777-31578-0/minicluster-data/ts-2/wal/instance
I20260808 14:48:54.849301 31578 external_mini_cluster.cc:1428] Setting key 78987cf5b9e170f5ff854fc791ec0a68
I20260808 14:48:54.850673 25820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:54.846078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:58465 (local address 127.30.214.190:44145)
0808 14:48:54.846132 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 14:48:54.846133 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:48:54.846353 (+ 220us) server_negotiation.cc:407] Connection header received
0808 14:48:54.846879 (+ 526us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:48:54.846881 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:48:54.846894 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:48:54.846947 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:48:54.847662 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:54.848167 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:54.849183 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:54.849506 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:54.849576 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:54.850446 (+ 870us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:48:54.850447 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:48:54.850447 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:48:54.850452 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:48:54.850470 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:48:54.850474 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:48:54.850526 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 14:48:54.850584 (+ 58us) server_negotiation.cc:299] Negotiation successful
0808 14:48:54.850613 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 14:48:54.850888 26439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:54.846053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:44145 (local address 127.30.214.131:58465)
0808 14:48:54.846231 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:54.846266 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 14:48:54.846775 (+ 509us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:48:54.847044 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:48:54.847049 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:48:54.847057 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:48:54.847568 (+ 511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:54.847573 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:54.848256 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:54.848257 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:54.849093 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:54.849096 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:54.849597 (+ 501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:54.849598 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:54.849730 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:54.850312 (+ 582us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:48:54.850313 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:48:54.850342 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:48:54.850366 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:48:54.850534 (+ 168us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:48:54.850537 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:48:54.850539 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 14:48:54.850586 (+ 47us) client_negotiation.cc:240] Negotiation successful
0808 14:48:54.850673 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":71,"threads_started":1}
I20260808 14:48:54.851372 26437 heartbeater.cc:347] Connected to a master server at 127.30.214.190:44145
I20260808 14:48:54.851469 26437 heartbeater.cc:464] Registering TS with master...
I20260808 14:48:54.851637 26437 heartbeater.cc:511] Master 127.30.214.190:44145 requested a full tablet report, sending...
I20260808 14:48:54.852001 25745 ts_manager.cc:194] Registered new tserver with Master: dd4ac6ce4606442284c65b3c75d10897 (127.30.214.131:34785)
I20260808 14:48:54.852341 25745 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.30.214.131:58465
I20260808 14:48:54.861362 31578 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:48:54.865993 25820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:54.863184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33260 (local address 127.30.214.190:44145)
0808 14:48:54.863252 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0808 14:48:54.863254 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:48:54.863320 (+ 66us) server_negotiation.cc:407] Connection header received
0808 14:48:54.863388 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:48:54.863389 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:48:54.863402 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:48:54.863452 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:48:54.863612 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:54.864110 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:54.864826 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:54.865034 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:54.865088 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:54.865747 (+ 659us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:48:54.865749 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:48:54.865749 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:48:54.865755 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:48:54.865770 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:48:54.865774 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:48:54.865815 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0808 14:48:54.865869 (+ 54us) server_negotiation.cc:299] Negotiation successful
0808 14:48:54.865896 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 14:48:54.867508 25745 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33260:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:48:54.869081 25745 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:48:54.875312 26453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:54.871218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.130:44715 (local address 127.0.0.1:52486)
0808 14:48:54.871541 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:54.871587 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 14:48:54.871666 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:48:54.872178 (+ 512us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:48:54.872180 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:48:54.872182 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:48:54.872231 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:54.872232 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:54.873126 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:54.873127 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:54.874357 (+ 1230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:54.874360 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:54.875008 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:54.875010 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:54.875091 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:54.875105 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 14:48:54.875176 (+ 71us) client_negotiation.cc:240] Negotiation successful
0808 14:48:54.875230 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":290,"mutex_wait_us":25,"thread_start_us":84,"threads_started":1}
I20260808 14:48:54.875322 26455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:54.871327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52486 (local address 127.30.214.130:44715)
0808 14:48:54.871517 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0808 14:48:54.871523 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:48:54.871645 (+ 122us) server_negotiation.cc:407] Connection header received
0808 14:48:54.871748 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:48:54.871751 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:48:54.871767 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:48:54.871841 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:48:54.872306 (+ 465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:54.873041 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:54.874430 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:54.874923 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:54.875001 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:54.875098 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0808 14:48:54.875191 (+ 93us) server_negotiation.cc:299] Negotiation successful
0808 14:48:54.875230 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":88,"threads_started":1}
I20260808 14:48:54.875416 26448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:54.871443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.131:34785 (local address 127.0.0.1:39346)
0808 14:48:54.871848 (+ 405us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:54.871858 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:48:54.871913 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:48:54.872089 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:48:54.872089 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:48:54.872091 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:48:54.872136 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:54.872138 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:54.873043 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:54.873044 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:54.874164 (+ 1120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:54.874167 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:54.875190 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:54.875191 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:54.875251 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:54.875256 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 14:48:54.875303 (+ 47us) client_negotiation.cc:240] Negotiation successful
0808 14:48:54.875344 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":393,"mutex_wait_us":40,"thread_start_us":82,"threads_started":1}
I20260808 14:48:54.875658 26458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:54.871664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39346 (local address 127.30.214.131:34785)
0808 14:48:54.871862 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0808 14:48:54.871865 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:48:54.871904 (+ 39us) server_negotiation.cc:407] Connection header received
0808 14:48:54.871993 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:48:54.871996 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:48:54.872010 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:48:54.872083 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:48:54.872211 (+ 128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:54.872959 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:54.874254 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:54.875008 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:54.875078 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:54.875157 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 14:48:54.875532 (+ 375us) server_negotiation.cc:299] Negotiation successful
0808 14:48:54.875579 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":95,"threads_started":1}
I20260808 14:48:54.876132 26138 tablet_service.cc:1467] Processing CreateTablet for tablet 30d7de202aa44135a1d1449fda3e476c (DEFAULT_TABLE table=test-table [id=1416acb5b98c46e8b1cdb6acee6db185]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:48:54.876266 26338 tablet_service.cc:1467] Processing CreateTablet for tablet 30d7de202aa44135a1d1449fda3e476c (DEFAULT_TABLE table=test-table [id=1416acb5b98c46e8b1cdb6acee6db185]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:48:54.876564 26338 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30d7de202aa44135a1d1449fda3e476c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:48:54.876564 26138 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30d7de202aa44135a1d1449fda3e476c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:48:54.876740 26457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:54.871234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.129:41043 (local address 127.0.0.1:39386)
0808 14:48:54.871586 (+ 352us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:54.871597 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:48:54.871666 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:48:54.872053 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:48:54.872055 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:48:54.872058 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:48:54.872136 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:54.872138 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:54.874219 (+ 2081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:54.874220 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:54.875261 (+ 1041us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:54.875263 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:54.876532 (+ 1269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:54.876532 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:54.876580 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:54.876583 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:48:54.876624 (+ 41us) client_negotiation.cc:240] Negotiation successful
0808 14:48:54.876664 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":330,"mutex_wait_us":1,"thread_start_us":116,"threads_started":1}
I20260808 14:48:54.876950 26456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:54.871346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39386 (local address 127.30.214.129:41043)
0808 14:48:54.871593 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0808 14:48:54.871597 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:48:54.871757 (+ 160us) server_negotiation.cc:407] Connection header received
0808 14:48:54.871879 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:48:54.871882 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:48:54.871898 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:48:54.871969 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:48:54.873043 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:54.874149 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:54.875348 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:54.876312 (+ 964us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:54.876414 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:54.876501 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 14:48:54.876842 (+ 341us) server_negotiation.cc:299] Negotiation successful
0808 14:48:54.876886 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":216,"thread_start_us":94,"threads_started":1}
I20260808 14:48:54.880064 26459 tablet_bootstrap.cc:492] T 30d7de202aa44135a1d1449fda3e476c P 015735d1a004458b963c650b1c45270f: Bootstrap starting.
I20260808 14:48:54.880784 26459 tablet_bootstrap.cc:654] T 30d7de202aa44135a1d1449fda3e476c P 015735d1a004458b963c650b1c45270f: Neither blocks nor log segments found. Creating new log.
I20260808 14:48:54.880761 25935 tablet_service.cc:1467] Processing CreateTablet for tablet 30d7de202aa44135a1d1449fda3e476c (DEFAULT_TABLE table=test-table [id=1416acb5b98c46e8b1cdb6acee6db185]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:48:54.881130 26459 log.cc:824] T 30d7de202aa44135a1d1449fda3e476c P 015735d1a004458b963c650b1c45270f: Log is configured to *not* fsync() on all Append() calls
I20260808 14:48:54.881165 25935 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30d7de202aa44135a1d1449fda3e476c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:48:54.881544 26460 tablet_bootstrap.cc:492] T 30d7de202aa44135a1d1449fda3e476c P dd4ac6ce4606442284c65b3c75d10897: Bootstrap starting.
I20260808 14:48:54.881904 26459 tablet_bootstrap.cc:492] T 30d7de202aa44135a1d1449fda3e476c P 015735d1a004458b963c650b1c45270f: No bootstrap required, opened a new log
I20260808 14:48:54.881978 26459 ts_tablet_manager.cc:1397] T 30d7de202aa44135a1d1449fda3e476c P 015735d1a004458b963c650b1c45270f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:48:54.882174 26460 tablet_bootstrap.cc:654] T 30d7de202aa44135a1d1449fda3e476c P dd4ac6ce4606442284c65b3c75d10897: Neither blocks nor log segments found. Creating new log.
I20260808 14:48:54.882761 26460 log.cc:824] T 30d7de202aa44135a1d1449fda3e476c P dd4ac6ce4606442284c65b3c75d10897: Log is configured to *not* fsync() on all Append() calls
I20260808 14:48:54.883530 26460 tablet_bootstrap.cc:492] T 30d7de202aa44135a1d1449fda3e476c P dd4ac6ce4606442284c65b3c75d10897: No bootstrap required, opened a new log
I20260808 14:48:54.883606 26460 ts_tablet_manager.cc:1397] T 30d7de202aa44135a1d1449fda3e476c P dd4ac6ce4606442284c65b3c75d10897: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:48:54.884073 26459 raft_consensus.cc:348] T 30d7de202aa44135a1d1449fda3e476c P 015735d1a004458b963c650b1c45270f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "015735d1a004458b963c650b1c45270f" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 44715 } } peers { permanent_uuid: "dd4ac6ce4606442284c65b3c75d10897" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 34785 } } peers { permanent_uuid: "8b64bf682306419d8a925cee735d97f8" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 41043 } }
I20260808 14:48:54.884208 26459 raft_consensus.cc:374] T 30d7de202aa44135a1d1449fda3e476c P 015735d1a004458b963c650b1c45270f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:48:54.884240 26459 raft_consensus.cc:729] T 30d7de202aa44135a1d1449fda3e476c P 015735d1a004458b963c650b1c45270f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 015735d1a004458b963c650b1c45270f, State: Initialized, Role: FOLLOWER
I20260808 14:48:54.884379 26459 consensus_queue.cc:260] T 30d7de202aa44135a1d1449fda3e476c P 015735d1a004458b963c650b1c45270f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "015735d1a004458b963c650b1c45270f" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 44715 } } peers { permanent_uuid: "dd4ac6ce4606442284c65b3c75d10897" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 34785 } } peers { permanent_uuid: "8b64bf682306419d8a925cee735d97f8" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 41043 } }
I20260808 14:48:54.884650 26459 ts_tablet_manager.cc:1428] T 30d7de202aa44135a1d1449fda3e476c P 015735d1a004458b963c650b1c45270f: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 14:48:54.884671 26239 heartbeater.cc:503] Master 127.30.214.190:44145 was elected leader, sending a full tablet report...
I20260808 14:48:54.884857 26464 tablet_bootstrap.cc:492] T 30d7de202aa44135a1d1449fda3e476c P 8b64bf682306419d8a925cee735d97f8: Bootstrap starting.
I20260808 14:48:54.885550 26464 tablet_bootstrap.cc:654] T 30d7de202aa44135a1d1449fda3e476c P 8b64bf682306419d8a925cee735d97f8: Neither blocks nor log segments found. Creating new log.
I20260808 14:48:54.885856 26464 log.cc:824] T 30d7de202aa44135a1d1449fda3e476c P 8b64bf682306419d8a925cee735d97f8: Log is configured to *not* fsync() on all Append() calls
I20260808 14:48:54.886133 26460 raft_consensus.cc:348] T 30d7de202aa44135a1d1449fda3e476c P dd4ac6ce4606442284c65b3c75d10897 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "015735d1a004458b963c650b1c45270f" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 44715 } } peers { permanent_uuid: "dd4ac6ce4606442284c65b3c75d10897" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 34785 } } peers { permanent_uuid: "8b64bf682306419d8a925cee735d97f8" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 41043 } }
I20260808 14:48:54.886267 26460 raft_consensus.cc:374] T 30d7de202aa44135a1d1449fda3e476c P dd4ac6ce4606442284c65b3c75d10897 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:48:54.886288 26460 raft_consensus.cc:729] T 30d7de202aa44135a1d1449fda3e476c P dd4ac6ce4606442284c65b3c75d10897 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd4ac6ce4606442284c65b3c75d10897, State: Initialized, Role: FOLLOWER
I20260808 14:48:54.886399 26460 consensus_queue.cc:260] T 30d7de202aa44135a1d1449fda3e476c P dd4ac6ce4606442284c65b3c75d10897 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "015735d1a004458b963c650b1c45270f" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 44715 } } peers { permanent_uuid: "dd4ac6ce4606442284c65b3c75d10897" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 34785 } } peers { permanent_uuid: "8b64bf682306419d8a925cee735d97f8" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 41043 } }
I20260808 14:48:54.886673 26464 tablet_bootstrap.cc:492] T 30d7de202aa44135a1d1449fda3e476c P 8b64bf682306419d8a925cee735d97f8: No bootstrap required, opened a new log
I20260808 14:48:54.886689 26460 ts_tablet_manager.cc:1428] T 30d7de202aa44135a1d1449fda3e476c P dd4ac6ce4606442284c65b3c75d10897: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 14:48:54.886708 26437 heartbeater.cc:503] Master 127.30.214.190:44145 was elected leader, sending a full tablet report...
I20260808 14:48:54.886742 26464 ts_tablet_manager.cc:1397] T 30d7de202aa44135a1d1449fda3e476c P 8b64bf682306419d8a925cee735d97f8: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260808 14:48:54.888653 26464 raft_consensus.cc:348] T 30d7de202aa44135a1d1449fda3e476c P 8b64bf682306419d8a925cee735d97f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "015735d1a004458b963c650b1c45270f" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 44715 } } peers { permanent_uuid: "dd4ac6ce4606442284c65b3c75d10897" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 34785 } } peers { permanent_uuid: "8b64bf682306419d8a925cee735d97f8" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 41043 } }
I20260808 14:48:54.888784 26464 raft_consensus.cc:374] T 30d7de202aa44135a1d1449fda3e476c P 8b64bf682306419d8a925cee735d97f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:48:54.888805 26464 raft_consensus.cc:729] T 30d7de202aa44135a1d1449fda3e476c P 8b64bf682306419d8a925cee735d97f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b64bf682306419d8a925cee735d97f8, State: Initialized, Role: FOLLOWER
I20260808 14:48:54.888898 26464 consensus_queue.cc:260] T 30d7de202aa44135a1d1449fda3e476c P 8b64bf682306419d8a925cee735d97f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "015735d1a004458b963c650b1c45270f" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 44715 } } peers { permanent_uuid: "dd4ac6ce4606442284c65b3c75d10897" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 34785 } } peers { permanent_uuid: "8b64bf682306419d8a925cee735d97f8" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 41043 } }
I20260808 14:48:54.889140 26464 ts_tablet_manager.cc:1428] T 30d7de202aa44135a1d1449fda3e476c P 8b64bf682306419d8a925cee735d97f8: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260808 14:48:54.889217 26038 heartbeater.cc:503] Master 127.30.214.190:44145 was elected leader, sending a full tablet report...
I20260808 14:48:54.904703 26467 raft_consensus.cc:482] T 30d7de202aa44135a1d1449fda3e476c P dd4ac6ce4606442284c65b3c75d10897 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:48:54.904837 26467 raft_consensus.cc:504] T 30d7de202aa44135a1d1449fda3e476c P dd4ac6ce4606442284c65b3c75d10897 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "015735d1a004458b963c650b1c45270f" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 44715 } } peers { permanent_uuid: "dd4ac6ce4606442284c65b3c75d10897" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 34785 } } peers { permanent_uuid: "8b64bf682306419d8a925cee735d97f8" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 41043 } }
I20260808 14:48:54.905236 26467 leader_election.cc:288] T 30d7de202aa44135a1d1449fda3e476c P dd4ac6ce4606442284c65b3c75d10897 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 015735d1a004458b963c650b1c45270f (127.30.214.130:44715), 8b64bf682306419d8a925cee735d97f8 (127.30.214.129:41043)
I20260808 14:48:54.908115 26455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:54.905589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:47133 (local address 127.30.214.130:44715)
0808 14:48:54.905637 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 14:48:54.905639 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:48:54.905647 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:48:54.905675 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:48:54.905676 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:48:54.905683 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:48:54.905731 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:48:54.905865 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:54.906339 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:54.907448 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:54.907803 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:54.907865 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:54.907873 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 14:48:54.908004 (+ 131us) server_negotiation.cc:299] Negotiation successful
0808 14:48:54.908050 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 14:48:54.908115 26439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:54.905425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.130:44715 (local address 127.30.214.131:47133)
0808 14:48:54.905498 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:54.905519 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 14:48:54.905583 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:48:54.905739 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:48:54.905740 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:48:54.905742 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:48:54.905809 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:54.905811 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:54.906411 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:54.906412 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:54.907362 (+ 950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:54.907365 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:54.907873 (+ 508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:54.907874 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:54.907945 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:54.907949 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:48:54.907993 (+ 44us) client_negotiation.cc:240] Negotiation successful
0808 14:48:54.908037 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46}
I20260808 14:48:54.908298 26456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:54.905513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:56865 (local address 127.30.214.129:41043)
0808 14:48:54.905571 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 14:48:54.905573 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:48:54.905799 (+ 226us) server_negotiation.cc:407] Connection header received
0808 14:48:54.905851 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:48:54.905852 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:48:54.905863 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:48:54.905910 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:48:54.906055 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:54.906541 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:54.907625 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:54.907983 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:54.908046 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:54.908054 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 14:48:54.908196 (+ 142us) server_negotiation.cc:299] Negotiation successful
0808 14:48:54.908235 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 14:48:54.908314 26472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:54.905430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.129:41043 (local address 127.30.214.131:56865)
0808 14:48:54.905724 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:54.905733 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:48:54.905793 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:48:54.905916 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:48:54.905917 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:48:54.905926 (+ 9us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:48:54.905995 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:54.905996 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:54.906613 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:54.906614 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:54.907535 (+ 921us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:54.907537 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:54.908064 (+ 527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:54.908065 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:54.908135 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:54.908138 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:48:54.908183 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 14:48:54.908221 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":275,"mutex_wait_us":116,"thread_start_us":114,"threads_started":1}
I20260808 14:48:54.908478 26166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30d7de202aa44135a1d1449fda3e476c" candidate_uuid: "dd4ac6ce4606442284c65b3c75d10897" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "015735d1a004458b963c650b1c45270f" is_pre_election: true
I20260808 14:48:54.908634 26166 raft_consensus.cc:2454] T 30d7de202aa44135a1d1449fda3e476c P 015735d1a004458b963c650b1c45270f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd4ac6ce4606442284c65b3c75d10897 in term 0.
I20260808 14:48:54.908595 25970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30d7de202aa44135a1d1449fda3e476c" candidate_uuid: "dd4ac6ce4606442284c65b3c75d10897" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b64bf682306419d8a925cee735d97f8" is_pre_election: true
I20260808 14:48:54.908730 25970 raft_consensus.cc:2454] T 30d7de202aa44135a1d1449fda3e476c P 8b64bf682306419d8a925cee735d97f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd4ac6ce4606442284c65b3c75d10897 in term 0.
I20260808 14:48:54.908855 26263 leader_election.cc:302] T 30d7de202aa44135a1d1449fda3e476c P dd4ac6ce4606442284c65b3c75d10897 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 015735d1a004458b963c650b1c45270f, dd4ac6ce4606442284c65b3c75d10897; no voters:
I20260808 14:48:54.908970 26467 raft_consensus.cc:2781] T 30d7de202aa44135a1d1449fda3e476c P dd4ac6ce4606442284c65b3c75d10897 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:48:54.909027 26467 raft_consensus.cc:482] T 30d7de202aa44135a1d1449fda3e476c P dd4ac6ce4606442284c65b3c75d10897 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:48:54.909050 26467 raft_consensus.cc:3037] T 30d7de202aa44135a1d1449fda3e476c P dd4ac6ce4606442284c65b3c75d10897 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:48:54.909847 26467 raft_consensus.cc:504] T 30d7de202aa44135a1d1449fda3e476c P dd4ac6ce4606442284c65b3c75d10897 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "015735d1a004458b963c650b1c45270f" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 44715 } } peers { permanent_uuid: "dd4ac6ce4606442284c65b3c75d10897" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 34785 } } peers { permanent_uuid: "8b64bf682306419d8a925cee735d97f8" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 41043 } }
I20260808 14:48:54.909978 26467 leader_election.cc:288] T 30d7de202aa44135a1d1449fda3e476c P dd4ac6ce4606442284c65b3c75d10897 [CANDIDATE]: Term 1 election: Requested vote from peers 015735d1a004458b963c650b1c45270f (127.30.214.130:44715), 8b64bf682306419d8a925cee735d97f8 (127.30.214.129:41043)
I20260808 14:48:54.910140 26166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30d7de202aa44135a1d1449fda3e476c" candidate_uuid: "dd4ac6ce4606442284c65b3c75d10897" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "015735d1a004458b963c650b1c45270f"
I20260808 14:48:54.910161 25970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30d7de202aa44135a1d1449fda3e476c" candidate_uuid: "dd4ac6ce4606442284c65b3c75d10897" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b64bf682306419d8a925cee735d97f8"
I20260808 14:48:54.910228 25970 raft_consensus.cc:3037] T 30d7de202aa44135a1d1449fda3e476c P 8b64bf682306419d8a925cee735d97f8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:48:54.910228 26166 raft_consensus.cc:3037] T 30d7de202aa44135a1d1449fda3e476c P 015735d1a004458b963c650b1c45270f [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:48:54.911101 26166 raft_consensus.cc:2454] T 30d7de202aa44135a1d1449fda3e476c P 015735d1a004458b963c650b1c45270f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd4ac6ce4606442284c65b3c75d10897 in term 1.
I20260808 14:48:54.911101 25970 raft_consensus.cc:2454] T 30d7de202aa44135a1d1449fda3e476c P 8b64bf682306419d8a925cee735d97f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd4ac6ce4606442284c65b3c75d10897 in term 1.
I20260808 14:48:54.911288 26263 leader_election.cc:302] T 30d7de202aa44135a1d1449fda3e476c P dd4ac6ce4606442284c65b3c75d10897 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 015735d1a004458b963c650b1c45270f, dd4ac6ce4606442284c65b3c75d10897; no voters:
I20260808 14:48:54.911383 26467 raft_consensus.cc:2781] T 30d7de202aa44135a1d1449fda3e476c P dd4ac6ce4606442284c65b3c75d10897 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:48:54.911536 26467 raft_consensus.cc:686] T 30d7de202aa44135a1d1449fda3e476c P dd4ac6ce4606442284c65b3c75d10897 [term 1 LEADER]: Becoming Leader. State: Replica: dd4ac6ce4606442284c65b3c75d10897, State: Running, Role: LEADER
I20260808 14:48:54.911612 26467 consensus_queue.cc:237] T 30d7de202aa44135a1d1449fda3e476c P dd4ac6ce4606442284c65b3c75d10897 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "015735d1a004458b963c650b1c45270f" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 44715 } } peers { permanent_uuid: "dd4ac6ce4606442284c65b3c75d10897" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 34785 } } peers { permanent_uuid: "8b64bf682306419d8a925cee735d97f8" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 41043 } }
I20260808 14:48:54.912402 25745 catalog_manager.cc:5495] T 30d7de202aa44135a1d1449fda3e476c P dd4ac6ce4606442284c65b3c75d10897 reported cstate change: term changed from 0 to 1, leader changed from <none> to dd4ac6ce4606442284c65b3c75d10897 (127.30.214.131). New cstate: current_term: 1 leader_uuid: "dd4ac6ce4606442284c65b3c75d10897" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "015735d1a004458b963c650b1c45270f" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 44715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd4ac6ce4606442284c65b3c75d10897" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 34785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b64bf682306419d8a925cee735d97f8" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 41043 } health_report { overall_health: UNKNOWN } } }
I20260808 14:48:54.920653 26458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:54.918539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39362 (local address 127.30.214.131:34785)
0808 14:48:54.918582 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 14:48:54.918584 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:48:54.918592 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:48:54.918653 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:48:54.918654 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:48:54.918668 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:48:54.918724 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:48:54.918812 (+ 88us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:54.919261 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:54.920036 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:54.920233 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:54.920293 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:54.920391 (+ 98us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:48:54.920489 (+ 98us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:48:54.920542 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 14:48:54.920561 (+ 19us) server_negotiation.cc:299] Negotiation successful
0808 14:48:54.920577 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 14:48:54.922395 25970 raft_consensus.cc:1261] T 30d7de202aa44135a1d1449fda3e476c P 8b64bf682306419d8a925cee735d97f8 [term 1 FOLLOWER]: Refusing update from remote peer dd4ac6ce4606442284c65b3c75d10897: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:48:54.922395 26166 raft_consensus.cc:1261] T 30d7de202aa44135a1d1449fda3e476c P 015735d1a004458b963c650b1c45270f [term 1 FOLLOWER]: Refusing update from remote peer dd4ac6ce4606442284c65b3c75d10897: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:48:54.922729 26467 consensus_queue.cc:1035] T 30d7de202aa44135a1d1449fda3e476c P dd4ac6ce4606442284c65b3c75d10897 [LEADER]: Connected to new peer: Peer: permanent_uuid: "015735d1a004458b963c650b1c45270f" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 44715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:48:54.922871 26473 consensus_queue.cc:1035] T 30d7de202aa44135a1d1449fda3e476c P dd4ac6ce4606442284c65b3c75d10897 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b64bf682306419d8a925cee735d97f8" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 41043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:48:54.925940 26479 mvcc.cc:205] Tried to move back new op lower bound from 7316277391039643648 to 7316277390998650880. Current Snapshot: MvccSnapshot[applied={T|T < 7316277391039643648 or (T in {7316277391039643648})}]
I20260808 14:48:54.928110 25744 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33260:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:48:54.928196 25744 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33260:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:48:54.928893 25744 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 60baae82f78846b3a614479f19c27ddb: Sending DeleteTablet for 3 replicas of tablet 30d7de202aa44135a1d1449fda3e476c
I20260808 14:48:54.929225 25935 tablet_service.cc:1514] Processing DeleteTablet for tablet 30d7de202aa44135a1d1449fda3e476c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:48:54 UTC) from {username='slave'} at 127.0.0.1:39386
I20260808 14:48:54.929255 26138 tablet_service.cc:1514] Processing DeleteTablet for tablet 30d7de202aa44135a1d1449fda3e476c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:48:54 UTC) from {username='slave'} at 127.0.0.1:52486
I20260808 14:48:54.929467 26338 tablet_service.cc:1514] Processing DeleteTablet for tablet 30d7de202aa44135a1d1449fda3e476c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:48:54 UTC) from {username='slave'} at 127.0.0.1:39346
I20260808 14:48:54.929538 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 25835
I20260808 14:48:54.942299 26494 tablet_replica.cc:330] T 30d7de202aa44135a1d1449fda3e476c P 015735d1a004458b963c650b1c45270f: stopping tablet replica
I20260808 14:48:54.942575 26494 raft_consensus.cc:2229] T 30d7de202aa44135a1d1449fda3e476c P 015735d1a004458b963c650b1c45270f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:48:54.942829 26494 raft_consensus.cc:2258] T 30d7de202aa44135a1d1449fda3e476c P 015735d1a004458b963c650b1c45270f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:48:54.945406 26494 ts_tablet_manager.cc:1905] T 30d7de202aa44135a1d1449fda3e476c P 015735d1a004458b963c650b1c45270f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:48:54.947618 26494 ts_tablet_manager.cc:1918] T 30d7de202aa44135a1d1449fda3e476c P 015735d1a004458b963c650b1c45270f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:48:54.947791 26494 log.cc:1196] T 30d7de202aa44135a1d1449fda3e476c P 015735d1a004458b963c650b1c45270f: Deleting WAL directory at /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200295877777-31578-0/minicluster-data/ts-1/wal/wals/30d7de202aa44135a1d1449fda3e476c
I20260808 14:48:54.948138 26494 ts_tablet_manager.cc:1939] T 30d7de202aa44135a1d1449fda3e476c P 015735d1a004458b963c650b1c45270f: Deleting consensus metadata
I20260808 14:48:54.948730 25724 catalog_manager.cc:4841] TS 015735d1a004458b963c650b1c45270f (127.30.214.130:44715): tablet 30d7de202aa44135a1d1449fda3e476c (table test-table [id=1416acb5b98c46e8b1cdb6acee6db185]) successfully deleted
I20260808 14:48:54.949558 26495 tablet_replica.cc:330] T 30d7de202aa44135a1d1449fda3e476c P dd4ac6ce4606442284c65b3c75d10897: stopping tablet replica
I20260808 14:48:54.949692 26495 raft_consensus.cc:2229] T 30d7de202aa44135a1d1449fda3e476c P dd4ac6ce4606442284c65b3c75d10897 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:48:54.949844 26495 raft_consensus.cc:2258] T 30d7de202aa44135a1d1449fda3e476c P dd4ac6ce4606442284c65b3c75d10897 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:48:54.950927 26495 ts_tablet_manager.cc:1905] T 30d7de202aa44135a1d1449fda3e476c P dd4ac6ce4606442284c65b3c75d10897: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:48:54.961988 26495 ts_tablet_manager.cc:1918] T 30d7de202aa44135a1d1449fda3e476c P dd4ac6ce4606442284c65b3c75d10897: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:48:54.962121 26495 log.cc:1196] T 30d7de202aa44135a1d1449fda3e476c P dd4ac6ce4606442284c65b3c75d10897: Deleting WAL directory at /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786200295877777-31578-0/minicluster-data/ts-2/wal/wals/30d7de202aa44135a1d1449fda3e476c
I20260808 14:48:54.962390 26495 ts_tablet_manager.cc:1939] T 30d7de202aa44135a1d1449fda3e476c P dd4ac6ce4606442284c65b3c75d10897: Deleting consensus metadata
I20260808 14:48:54.963006 25724 catalog_manager.cc:4841] TS dd4ac6ce4606442284c65b3c75d10897 (127.30.214.131:34785): tablet 30d7de202aa44135a1d1449fda3e476c (table test-table [id=1416acb5b98c46e8b1cdb6acee6db185]) successfully deleted
W20260808 14:48:54.967401 25725 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.30.214.129:41043 (error 108)
I20260808 14:48:54.967957 26453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:54.967828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.129:41043 (local address 127.0.0.1:39388)
0808 14:48:54.967880 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:54.967925 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.129:41043: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260808 14:48:54.968063 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 26043
W20260808 14:48:54.978191 25725 catalog_manager.cc:4584] TS 8b64bf682306419d8a925cee735d97f8 (127.30.214.129:41043): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 30d7de202aa44135a1d1449fda3e476c: Network error: Client connection negotiation failed: client connection to 127.30.214.129:41043: connect: Connection refused (error 111)
I20260808 14:48:54.983453 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 26243
I20260808 14:48:54.993692 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 25693
2026-08-08T14:48:55Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (729 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:48:55 dist-test-slave-42z9 krb5kdc[26502](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:48:55 dist-test-slave-42z9 krb5kdc[26502](info): set up 2 sockets
Aug 08 14:48:55 dist-test-slave-42z9 krb5kdc[26502](info): commencing operation
krb5kdc: starting...
W20260808 14:48:56.137466 31578 mini_kdc.cc:121] Time spent starting KDC: real 1.118s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Aug 08 14:48:56 dist-test-slave-42z9 krb5kdc[26502](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200536, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:48:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:48:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.214.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab.
Entry for principal kudu/127.30.214.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab.
I20260808 14:48:56.260725 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:41015
--webserver_interface=127.30.214.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab
--principal=kudu/127.30.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:38669
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.214.190:41015
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:48:56.349113 26523 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:48:56.349334 26523 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:48:56.349356 26523 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:48:56.350544 26523 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:48:56.350589 26523 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:48:56.350601 26523 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:48:56.350612 26523 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:48:56.350623 26523 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:48:56.352144 26523 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:38669
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.214.190:41015
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab
--principal=kudu/127.30.214.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:41015
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26523
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:48:56.352367 26523 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:48:56.352577 26523 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:48:56.357455 26530 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:48:56.357522 26529 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:48:56.357522 26536 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:48:56.357743 26523 server_base.cc:1034] running on GCE node
I20260808 14:48:56.357986 26523 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:48:56.358284 26523 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:48:56.359443 26523 hybrid_clock.cc:648] HybridClock initialized: now 1786200536359430 us; error 32 us; skew 500 ppm
Aug 08 14:48:56 dist-test-slave-42z9 krb5kdc[26502](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200536, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:48:56.365540 26523 init.cc:377] Logged in from keytab as kudu/127.30.214.190@KRBTEST.COM (short username kudu)
I20260808 14:48:56.366024 26523 webserver.cc:460] Webserver started at http://127.30.214.190:36671/ using document root <none> and password file <none>
I20260808 14:48:56.366250 26523 fs_manager.cc:359] Metadata directory not provided
I20260808 14:48:56.366291 26523 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:48:56.366391 26523 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:48:56.367451 26523 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/minicluster-data/master-0/data/instance:
uuid: "c9002693d8f940f08d3f476d794f3cd3"
format_stamp: "Formatted at 2026-08-08 14:48:56 on dist-test-slave-42z9"
server_key: "8c5771073a504e56606315c3844ec733"
server_key_iv: "af25e614ddf13d6b0dc89792145923b4"
server_key_version: "encryptionkey@0"
I20260808 14:48:56.367761 26523 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/minicluster-data/master-0/wal/instance:
uuid: "c9002693d8f940f08d3f476d794f3cd3"
format_stamp: "Formatted at 2026-08-08 14:48:56 on dist-test-slave-42z9"
server_key: "8c5771073a504e56606315c3844ec733"
server_key_iv: "af25e614ddf13d6b0dc89792145923b4"
server_key_version: "encryptionkey@0"
I20260808 14:48:56.369199 26523 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:48:56.370576 26546 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:48:56.370901 26523 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:48:56.371034 26523 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/minicluster-data/master-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/minicluster-data/master-0/wal
uuid: "c9002693d8f940f08d3f476d794f3cd3"
format_stamp: "Formatted at 2026-08-08 14:48:56 on dist-test-slave-42z9"
server_key: "8c5771073a504e56606315c3844ec733"
server_key_iv: "af25e614ddf13d6b0dc89792145923b4"
server_key_version: "encryptionkey@0"
I20260808 14:48:56.371122 26523 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:48:56.401834 26523 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:48:56.403716 26523 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:48:56.403833 26523 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:48:56.407986 26523 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.190:41015
I20260808 14:48:56.408026 26629 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.190:41015 every 8 connection(s)
I20260808 14:48:56.408375 26523 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
I20260808 14:48:56.409247 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 26523
I20260808 14:48:56.409370 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/minicluster-data/master-0/wal/instance
I20260808 14:48:56.409375 26630 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:48:56.409593 31578 external_mini_cluster.cc:1428] Setting key a67d5b2d107a647c4a493fe9ae64ed19
I20260808 14:48:56.412560 26630 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9002693d8f940f08d3f476d794f3cd3: Bootstrap starting.
I20260808 14:48:56.413319 26630 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c9002693d8f940f08d3f476d794f3cd3: Neither blocks nor log segments found. Creating new log.
I20260808 14:48:56.413669 26630 log.cc:824] T 00000000000000000000000000000000 P c9002693d8f940f08d3f476d794f3cd3: Log is configured to *not* fsync() on all Append() calls
I20260808 14:48:56.414423 26630 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9002693d8f940f08d3f476d794f3cd3: No bootstrap required, opened a new log
Aug 08 14:48:56 dist-test-slave-42z9 krb5kdc[26502](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200536, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:48:56.416852 26630 raft_consensus.cc:348] T 00000000000000000000000000000000 P c9002693d8f940f08d3f476d794f3cd3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9002693d8f940f08d3f476d794f3cd3" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41015 } }
I20260808 14:48:56.417009 26630 raft_consensus.cc:374] T 00000000000000000000000000000000 P c9002693d8f940f08d3f476d794f3cd3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:48:56.417063 26630 raft_consensus.cc:729] T 00000000000000000000000000000000 P c9002693d8f940f08d3f476d794f3cd3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9002693d8f940f08d3f476d794f3cd3, State: Initialized, Role: FOLLOWER
I20260808 14:48:56.417193 26630 consensus_queue.cc:260] T 00000000000000000000000000000000 P c9002693d8f940f08d3f476d794f3cd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9002693d8f940f08d3f476d794f3cd3" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41015 } }
I20260808 14:48:56.417268 26630 raft_consensus.cc:388] T 00000000000000000000000000000000 P c9002693d8f940f08d3f476d794f3cd3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:48:56.417307 26630 raft_consensus.cc:482] T 00000000000000000000000000000000 P c9002693d8f940f08d3f476d794f3cd3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:48:56.417356 26630 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c9002693d8f940f08d3f476d794f3cd3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:48:56.418097 26630 raft_consensus.cc:504] T 00000000000000000000000000000000 P c9002693d8f940f08d3f476d794f3cd3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9002693d8f940f08d3f476d794f3cd3" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41015 } }
I20260808 14:48:56.418220 26630 leader_election.cc:302] T 00000000000000000000000000000000 P c9002693d8f940f08d3f476d794f3cd3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c9002693d8f940f08d3f476d794f3cd3; no voters:
I20260808 14:48:56.418398 26630 leader_election.cc:288] T 00000000000000000000000000000000 P c9002693d8f940f08d3f476d794f3cd3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:48:56.418537 26638 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c9002693d8f940f08d3f476d794f3cd3 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:48:56.418722 26630 sys_catalog.cc:564] T 00000000000000000000000000000000 P c9002693d8f940f08d3f476d794f3cd3 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:48:56.418888 26638 raft_consensus.cc:686] T 00000000000000000000000000000000 P c9002693d8f940f08d3f476d794f3cd3 [term 1 LEADER]: Becoming Leader. State: Replica: c9002693d8f940f08d3f476d794f3cd3, State: Running, Role: LEADER
I20260808 14:48:56.419052 26638 consensus_queue.cc:237] T 00000000000000000000000000000000 P c9002693d8f940f08d3f476d794f3cd3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9002693d8f940f08d3f476d794f3cd3" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41015 } }
I20260808 14:48:56.419835 26640 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9002693d8f940f08d3f476d794f3cd3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c9002693d8f940f08d3f476d794f3cd3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9002693d8f940f08d3f476d794f3cd3" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41015 } } }
I20260808 14:48:56.419925 26640 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9002693d8f940f08d3f476d794f3cd3 [sys.catalog]: This master's current role is: LEADER
I20260808 14:48:56.420426 26658 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:48:56.420486 26641 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9002693d8f940f08d3f476d794f3cd3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c9002693d8f940f08d3f476d794f3cd3. Latest consensus state: current_term: 1 leader_uuid: "c9002693d8f940f08d3f476d794f3cd3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9002693d8f940f08d3f476d794f3cd3" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 41015 } } }
I20260808 14:48:56.420704 26641 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9002693d8f940f08d3f476d794f3cd3 [sys.catalog]: This master's current role is: LEADER
I20260808 14:48:56.421156 26658 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:48:56.421523 26635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:56.410145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48818 (local address 127.30.214.190:41015)
0808 14:48:56.410342 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0808 14:48:56.410350 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:48:56.410376 (+ 26us) server_negotiation.cc:407] Connection header received
0808 14:48:56.410880 (+ 504us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:48:56.410887 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:48:56.410935 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:48:56.411058 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:48:56.411837 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:56.412761 (+ 924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:56.413810 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:56.414332 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:56.414426 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:56.416989 (+ 2563us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:48:56.416993 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:48:56.416993 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:48:56.417006 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:48:56.419085 (+ 2079us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:48:56.419741 (+ 656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:48:56.419746 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:48:56.419747 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:48:56.419892 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:48:56.420399 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:48:56.420401 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:48:56.420401 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:48:56.420762 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:48:56.420942 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0808 14:48:56.421125 (+ 183us) server_negotiation.cc:299] Negotiation successful
0808 14:48:56.421301 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":82,"threads_started":1}
I20260808 14:48:56.423405 26658 catalog_manager.cc:1347] Generated new cluster ID: 811b9674cac8407b89574c2be3b47971
I20260808 14:48:56.423463 26658 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:48:56.454497 26658 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:48:56.455219 26658 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:48:56.461980 26658 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c9002693d8f940f08d3f476d794f3cd3: Generated new TSK 0
I20260808 14:48:56.462265 26658 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.214.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab.
Entry for principal kudu/127.30.214.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab.
I20260808 14:48:56.500064 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.129:0
--local_ip_for_outbound_sockets=127.30.214.129
--webserver_interface=127.30.214.129
--webserver_port=0
--tserver_master_addrs=127.30.214.190:41015
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab
--principal=kudu/127.30.214.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:38669
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:48:56.584236 26671 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:48:56.584462 26671 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:48:56.584494 26671 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:48:56.585762 26671 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:48:56.585812 26671 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:48:56.585839 26671 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.129
I20260808 14:48:56.587376 26671 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:38669
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab
--principal=kudu/127.30.214.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.214.129
--webserver_port=0
--tserver_master_addrs=127.30.214.190:41015
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26671
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.129
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:48:56.587644 26671 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:48:56.587872 26671 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:48:56.592885 26680 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:48:56.592885 26677 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:48:56.592917 26678 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:48:56.593168 26671 server_base.cc:1034] running on GCE node
I20260808 14:48:56.593410 26671 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:48:56.593714 26671 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:48:56.594877 26671 hybrid_clock.cc:648] HybridClock initialized: now 1786200536594865 us; error 28 us; skew 500 ppm
Aug 08 14:48:56 dist-test-slave-42z9 krb5kdc[26502](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200536, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:48:56.597872 26671 init.cc:377] Logged in from keytab as kudu/127.30.214.129@KRBTEST.COM (short username kudu)
I20260808 14:48:56.598565 26671 webserver.cc:460] Webserver started at http://127.30.214.129:38475/ using document root <none> and password file <none>
I20260808 14:48:56.598845 26671 fs_manager.cc:359] Metadata directory not provided
I20260808 14:48:56.598904 26671 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:48:56.599059 26671 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:48:56.600767 26671 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/minicluster-data/ts-0/data/instance:
uuid: "a2dd14f6d02f419e8500c47e8444313e"
format_stamp: "Formatted at 2026-08-08 14:48:56 on dist-test-slave-42z9"
server_key: "0fe20efdfc9e527a0d648070dec48fa0"
server_key_iv: "5cce33ca33d285cbdb61ffb21fcb8295"
server_key_version: "encryptionkey@0"
I20260808 14:48:56.601254 26671 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/minicluster-data/ts-0/wal/instance:
uuid: "a2dd14f6d02f419e8500c47e8444313e"
format_stamp: "Formatted at 2026-08-08 14:48:56 on dist-test-slave-42z9"
server_key: "0fe20efdfc9e527a0d648070dec48fa0"
server_key_iv: "5cce33ca33d285cbdb61ffb21fcb8295"
server_key_version: "encryptionkey@0"
I20260808 14:48:56.602706 26671 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:48:56.603538 26691 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:48:56.603703 26671 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:48:56.603790 26671 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/minicluster-data/ts-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/minicluster-data/ts-0/wal
uuid: "a2dd14f6d02f419e8500c47e8444313e"
format_stamp: "Formatted at 2026-08-08 14:48:56 on dist-test-slave-42z9"
server_key: "0fe20efdfc9e527a0d648070dec48fa0"
server_key_iv: "5cce33ca33d285cbdb61ffb21fcb8295"
server_key_version: "encryptionkey@0"
I20260808 14:48:56.603864 26671 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:48:56.619976 26671 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:48:56.621974 26671 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:48:56.622123 26671 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:48:56.622350 26671 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:48:56.622671 26671 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:48:56.622714 26671 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:48:56.622745 26671 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:48:56.622761 26671 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:48:56.628342 26671 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.129:45515
I20260808 14:48:56.628414 26865 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.129:45515 every 8 connection(s)
I20260808 14:48:56.628718 26671 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
Aug 08 14:48:56 dist-test-slave-42z9 krb5kdc[26502](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200536, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.129@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:48:56.636302 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 26671
I20260808 14:48:56.636412 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/minicluster-data/ts-0/wal/instance
I20260808 14:48:56.636618 31578 external_mini_cluster.cc:1428] Setting key 25c824d7d6b47850274eaa5af4eea58a
I20260808 14:48:56.638363 26869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:56.629401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:41015 (local address 127.30.214.129:42449)
0808 14:48:56.629585 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:56.629622 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 14:48:56.630122 (+ 500us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:48:56.630366 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:48:56.630370 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:48:56.630970 (+ 600us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:48:56.631187 (+ 217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:56.631192 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:56.631908 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:56.631909 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:56.632716 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:56.632718 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:56.633104 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:56.633105 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:56.633235 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:56.633766 (+ 531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:48:56.633774 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:48:56.635165 (+ 1391us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:48:56.636467 (+ 1302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:48:56.636476 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:48:56.636479 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:48:56.636763 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:48:56.636988 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:48:56.636989 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:48:56.636990 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:48:56.637136 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:48:56.637753 (+ 617us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:48:56.637761 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:48:56.637910 (+ 149us) client_negotiation.cc:769] Sending connection context
0808 14:48:56.638022 (+ 112us) client_negotiation.cc:240] Negotiation successful
0808 14:48:56.638180 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":106,"threads_started":1}
I20260808 14:48:56.638365 26635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:56.629431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.129:42449 (local address 127.30.214.190:41015)
0808 14:48:56.629512 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0808 14:48:56.629514 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:48:56.629706 (+ 192us) server_negotiation.cc:407] Connection header received
0808 14:48:56.630222 (+ 516us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:48:56.630224 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:48:56.630238 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:48:56.630286 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:48:56.631295 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:56.631817 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:56.632808 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:56.633025 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:56.633083 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:56.635269 (+ 2186us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:48:56.635271 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:48:56.635272 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:48:56.635281 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:48:56.636381 (+ 1100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:48:56.636857 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:48:56.636858 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:48:56.636858 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:48:56.636923 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:48:56.637248 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:48:56.637249 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:48:56.637250 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:48:56.637596 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:48:56.637754 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0808 14:48:56.638084 (+ 330us) server_negotiation.cc:299] Negotiation successful
0808 14:48:56.638248 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 14:48:56.639011 26866 heartbeater.cc:347] Connected to a master server at 127.30.214.190:41015
I20260808 14:48:56.639122 26866 heartbeater.cc:464] Registering TS with master...
I20260808 14:48:56.639313 26866 heartbeater.cc:511] Master 127.30.214.190:41015 requested a full tablet report, sending...
I20260808 14:48:56.639873 26572 ts_manager.cc:194] Registered new tserver with Master: a2dd14f6d02f419e8500c47e8444313e (127.30.214.129:45515)
I20260808 14:48:56.640532 26572 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.214.129@KRBTEST.COM'} at 127.30.214.129:42449
WARNING: no policy specified for kudu/127.30.214.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab.
Entry for principal kudu/127.30.214.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab.
I20260808 14:48:56.666311 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.130:0
--local_ip_for_outbound_sockets=127.30.214.130
--webserver_interface=127.30.214.130
--webserver_port=0
--tserver_master_addrs=127.30.214.190:41015
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab
--principal=kudu/127.30.214.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:38669
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:48:56.752018 26873 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:48:56.752242 26873 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:48:56.752269 26873 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:48:56.753490 26873 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:48:56.753536 26873 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:48:56.753563 26873 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.130
I20260808 14:48:56.755087 26873 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:38669
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab
--principal=kudu/127.30.214.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.214.130
--webserver_port=0
--tserver_master_addrs=127.30.214.190:41015
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26873
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.130
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:48:56.755328 26873 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:48:56.755564 26873 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:48:56.760743 26880 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:48:56.760743 26883 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:48:56.760744 26879 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:48:56.761183 26873 server_base.cc:1034] running on GCE node
I20260808 14:48:56.761380 26873 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:48:56.761653 26873 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:48:56.762811 26873 hybrid_clock.cc:648] HybridClock initialized: now 1786200536762795 us; error 33 us; skew 500 ppm
Aug 08 14:48:56 dist-test-slave-42z9 krb5kdc[26502](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200536, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:48:56.765425 26873 init.cc:377] Logged in from keytab as kudu/127.30.214.130@KRBTEST.COM (short username kudu)
I20260808 14:48:56.765945 26873 webserver.cc:460] Webserver started at http://127.30.214.130:35963/ using document root <none> and password file <none>
I20260808 14:48:56.766168 26873 fs_manager.cc:359] Metadata directory not provided
I20260808 14:48:56.766211 26873 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:48:56.766306 26873 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:48:56.767382 26873 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/minicluster-data/ts-1/data/instance:
uuid: "e594c2fd009a4a5fbc800d41202037ab"
format_stamp: "Formatted at 2026-08-08 14:48:56 on dist-test-slave-42z9"
server_key: "070b92310a89c6cac1645804dd9b6cbd"
server_key_iv: "aae4416b31dd11b0ea53c07c000bdc42"
server_key_version: "encryptionkey@0"
I20260808 14:48:56.767694 26873 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/minicluster-data/ts-1/wal/instance:
uuid: "e594c2fd009a4a5fbc800d41202037ab"
format_stamp: "Formatted at 2026-08-08 14:48:56 on dist-test-slave-42z9"
server_key: "070b92310a89c6cac1645804dd9b6cbd"
server_key_iv: "aae4416b31dd11b0ea53c07c000bdc42"
server_key_version: "encryptionkey@0"
I20260808 14:48:56.769063 26873 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260808 14:48:56.769790 26896 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:48:56.769954 26873 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 14:48:56.770040 26873 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/minicluster-data/ts-1/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/minicluster-data/ts-1/wal
uuid: "e594c2fd009a4a5fbc800d41202037ab"
format_stamp: "Formatted at 2026-08-08 14:48:56 on dist-test-slave-42z9"
server_key: "070b92310a89c6cac1645804dd9b6cbd"
server_key_iv: "aae4416b31dd11b0ea53c07c000bdc42"
server_key_version: "encryptionkey@0"
I20260808 14:48:56.770104 26873 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:48:56.777340 26873 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:48:56.779614 26873 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:48:56.779743 26873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:48:56.779987 26873 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:48:56.780303 26873 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:48:56.780337 26873 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:48:56.780360 26873 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:48:56.780383 26873 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:48:56.786229 26873 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.130:38251
I20260808 14:48:56.786290 27071 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.130:38251 every 8 connection(s)
I20260808 14:48:56.786603 26873 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
I20260808 14:48:56.793215 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 26873
Aug 08 14:48:56 dist-test-slave-42z9 krb5kdc[26502](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200536, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.130@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:48:56.793337 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/minicluster-data/ts-1/wal/instance
I20260808 14:48:56.793605 31578 external_mini_cluster.cc:1428] Setting key 2d21b81b20a3ece0eb4e722ef7b14697
I20260808 14:48:56.796851 26635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:56.787327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.130:36859 (local address 127.30.214.190:41015)
0808 14:48:56.787389 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 14:48:56.787392 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:48:56.787603 (+ 211us) server_negotiation.cc:407] Connection header received
0808 14:48:56.788134 (+ 531us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:48:56.788136 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:48:56.788147 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:48:56.788205 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:48:56.789180 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:56.789805 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:56.790874 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:56.791151 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:56.791279 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:56.793978 (+ 2699us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:48:56.793981 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:48:56.793981 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:48:56.793989 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:48:56.795298 (+ 1309us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:48:56.795810 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:48:56.795811 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:48:56.795811 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:48:56.795877 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:48:56.796146 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:48:56.796147 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:48:56.796147 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:48:56.796281 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:48:56.796354 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 14:48:56.796641 (+ 287us) server_negotiation.cc:299] Negotiation successful
0808 14:48:56.796755 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 14:48:56.796929 27081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:56.787298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:41015 (local address 127.30.214.130:36859)
0808 14:48:56.787476 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:56.787518 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 14:48:56.787991 (+ 473us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:48:56.788269 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:48:56.788273 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:48:56.788864 (+ 591us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:48:56.789080 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:56.789084 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:56.789880 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:56.789881 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:56.790705 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:56.790707 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:56.791296 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:56.791297 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:56.791415 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:56.792026 (+ 611us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:48:56.792035 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:48:56.793867 (+ 1832us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:48:56.795387 (+ 1520us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:48:56.795397 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:48:56.795399 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:48:56.795711 (+ 312us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:48:56.795943 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:48:56.795944 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:48:56.795944 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:48:56.796091 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:48:56.796348 (+ 257us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:48:56.796355 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:48:56.796515 (+ 160us) client_negotiation.cc:769] Sending connection context
0808 14:48:56.796607 (+ 92us) client_negotiation.cc:240] Negotiation successful
0808 14:48:56.796751 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":103,"threads_started":1}
I20260808 14:48:56.797683 27074 heartbeater.cc:347] Connected to a master server at 127.30.214.190:41015
I20260808 14:48:56.797801 27074 heartbeater.cc:464] Registering TS with master...
I20260808 14:48:56.798010 27074 heartbeater.cc:511] Master 127.30.214.190:41015 requested a full tablet report, sending...
I20260808 14:48:56.798425 26572 ts_manager.cc:194] Registered new tserver with Master: e594c2fd009a4a5fbc800d41202037ab (127.30.214.130:38251)
I20260808 14:48:56.798893 26572 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.214.130@KRBTEST.COM'} at 127.30.214.130:36859
WARNING: no policy specified for kudu/127.30.214.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab.
Entry for principal kudu/127.30.214.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab.
I20260808 14:48:56.819907 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.131:0
--local_ip_for_outbound_sockets=127.30.214.131
--webserver_interface=127.30.214.131
--webserver_port=0
--tserver_master_addrs=127.30.214.190:41015
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab
--principal=kudu/127.30.214.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:38669
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:48:56.903383 27089 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:48:56.903594 27089 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:48:56.903618 27089 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:48:56.904743 27089 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:48:56.904793 27089 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:48:56.904827 27089 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.131
I20260808 14:48:56.906421 27089 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:38669
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab
--principal=kudu/127.30.214.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.214.131
--webserver_port=0
--tserver_master_addrs=127.30.214.190:41015
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27089
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.131
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:48:56.906625 27089 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:48:56.906839 27089 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:48:56.912060 27099 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:48:56.912077 27097 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:48:56.912070 27096 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:48:56.912196 27089 server_base.cc:1034] running on GCE node
I20260808 14:48:56.912416 27089 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:48:56.912633 27089 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:48:56.913765 27089 hybrid_clock.cc:648] HybridClock initialized: now 1786200536913751 us; error 29 us; skew 500 ppm
Aug 08 14:48:56 dist-test-slave-42z9 krb5kdc[26502](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200536, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:48:56.916195 27089 init.cc:377] Logged in from keytab as kudu/127.30.214.131@KRBTEST.COM (short username kudu)
I20260808 14:48:56.916657 27089 webserver.cc:460] Webserver started at http://127.30.214.131:33357/ using document root <none> and password file <none>
I20260808 14:48:56.916885 27089 fs_manager.cc:359] Metadata directory not provided
I20260808 14:48:56.916935 27089 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:48:56.917069 27089 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:48:56.918218 27089 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/minicluster-data/ts-2/data/instance:
uuid: "1174de30c5014a83bfdaba873d1a9f88"
format_stamp: "Formatted at 2026-08-08 14:48:56 on dist-test-slave-42z9"
server_key: "0e3ecc13a52039e3bb315b0c2f284356"
server_key_iv: "1998124181a238a08f6f4625498062df"
server_key_version: "encryptionkey@0"
I20260808 14:48:56.918570 27089 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/minicluster-data/ts-2/wal/instance:
uuid: "1174de30c5014a83bfdaba873d1a9f88"
format_stamp: "Formatted at 2026-08-08 14:48:56 on dist-test-slave-42z9"
server_key: "0e3ecc13a52039e3bb315b0c2f284356"
server_key_iv: "1998124181a238a08f6f4625498062df"
server_key_version: "encryptionkey@0"
I20260808 14:48:56.919931 27089 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 14:48:56.920660 27109 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:48:56.920815 27089 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:48:56.920900 27089 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/minicluster-data/ts-2/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/minicluster-data/ts-2/wal
uuid: "1174de30c5014a83bfdaba873d1a9f88"
format_stamp: "Formatted at 2026-08-08 14:48:56 on dist-test-slave-42z9"
server_key: "0e3ecc13a52039e3bb315b0c2f284356"
server_key_iv: "1998124181a238a08f6f4625498062df"
server_key_version: "encryptionkey@0"
I20260808 14:48:56.920975 27089 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:48:56.930187 27089 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:48:56.932348 27089 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:48:56.932492 27089 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:48:56.932730 27089 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:48:56.933039 27089 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:48:56.933074 27089 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:48:56.933099 27089 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:48:56.933122 27089 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:48:56.939136 27089 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.131:46707
I20260808 14:48:56.939195 27273 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.131:46707 every 8 connection(s)
I20260808 14:48:56.939531 27089 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
Aug 08 14:48:56 dist-test-slave-42z9 krb5kdc[26502](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200536, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.131@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:48:56.945745 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 27089
I20260808 14:48:56.945823 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/minicluster-data/ts-2/wal/instance
I20260808 14:48:56.945996 31578 external_mini_cluster.cc:1428] Setting key 2414e6398f0a13c9911b71260502697c
I20260808 14:48:56.948719 26635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:56.940270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:44775 (local address 127.30.214.190:41015)
0808 14:48:56.940327 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 14:48:56.940330 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:48:56.940511 (+ 181us) server_negotiation.cc:407] Connection header received
0808 14:48:56.941021 (+ 510us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:48:56.941022 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:48:56.941034 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:48:56.941090 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:48:56.942127 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:56.942633 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:56.943635 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:56.943825 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:56.943882 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:56.946056 (+ 2174us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:48:56.946058 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:48:56.946058 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:48:56.946067 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:48:56.947385 (+ 1318us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:48:56.947782 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:48:56.947782 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:48:56.947783 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:48:56.947841 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:48:56.948070 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:48:56.948070 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:48:56.948071 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:48:56.948191 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:48:56.948248 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 14:48:56.948545 (+ 297us) server_negotiation.cc:299] Negotiation successful
0808 14:48:56.948628 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 14:48:56.948902 27278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:56.940228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:41015 (local address 127.30.214.131:44775)
0808 14:48:56.940378 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:56.940417 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 14:48:56.940913 (+ 496us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:48:56.941166 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:48:56.941169 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:48:56.941815 (+ 646us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:48:56.942019 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:56.942024 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:56.942727 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:56.942728 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:56.943544 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:56.943546 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:56.943901 (+ 355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:56.943901 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:56.944027 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:56.944503 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:48:56.944511 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:48:56.945961 (+ 1450us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:48:56.947472 (+ 1511us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:48:56.947482 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:48:56.947484 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:48:56.947712 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:48:56.947896 (+ 184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:48:56.947897 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:48:56.947897 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:48:56.948013 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:48:56.948248 (+ 235us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:48:56.948255 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:48:56.948397 (+ 142us) client_negotiation.cc:769] Sending connection context
0808 14:48:56.948500 (+ 103us) client_negotiation.cc:240] Negotiation successful
0808 14:48:56.948675 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":68,"threads_started":1}
I20260808 14:48:56.949368 27275 heartbeater.cc:347] Connected to a master server at 127.30.214.190:41015
I20260808 14:48:56.949497 27275 heartbeater.cc:464] Registering TS with master...
I20260808 14:48:56.949702 27275 heartbeater.cc:511] Master 127.30.214.190:41015 requested a full tablet report, sending...
I20260808 14:48:56.950071 26572 ts_manager.cc:194] Registered new tserver with Master: 1174de30c5014a83bfdaba873d1a9f88 (127.30.214.131:46707)
I20260808 14:48:56.950425 26572 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.214.131@KRBTEST.COM'} at 127.30.214.131:44775
I20260808 14:48:56.957782 31578 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:48:56.965056 26635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:56.959139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48824 (local address 127.30.214.190:41015)
0808 14:48:56.959193 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 14:48:56.959196 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:48:56.959299 (+ 103us) server_negotiation.cc:407] Connection header received
0808 14:48:56.959375 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:48:56.959376 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:48:56.959386 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:48:56.959448 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:48:56.960020 (+ 572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:56.960509 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:56.961213 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:56.961409 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:56.961495 (+ 86us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:56.962867 (+ 1372us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:48:56.962868 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:48:56.962869 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:48:56.962876 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:48:56.963881 (+ 1005us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:48:56.964259 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:48:56.964260 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:48:56.964260 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:48:56.964312 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:48:56.964511 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:48:56.964511 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:48:56.964512 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:48:56.964647 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:48:56.964739 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 14:48:56.964888 (+ 149us) server_negotiation.cc:299] Negotiation successful
0808 14:48:56.964949 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 14:48:56.966547 26572 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48824:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:48:56.968221 26572 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:48:56.974704 27288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:56.970505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.129:45515 (local address 127.0.0.1:47620)
0808 14:48:56.970824 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:56.970863 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 14:48:56.970921 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:48:56.971161 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:48:56.971165 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:48:56.971167 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:48:56.971247 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:56.971249 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:56.972271 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:56.972272 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:56.973408 (+ 1136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:56.973411 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:56.974362 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:56.974363 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:56.974445 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:56.974461 (+ 16us) client_negotiation.cc:769] Sending connection context
0808 14:48:56.974548 (+ 87us) client_negotiation.cc:240] Negotiation successful
0808 14:48:56.974620 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":292,"thread_start_us":94,"threads_started":1}
I20260808 14:48:56.974720 27291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:56.970647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47620 (local address 127.30.214.129:45515)
0808 14:48:56.970917 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0808 14:48:56.970921 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:48:56.970933 (+ 12us) server_negotiation.cc:407] Connection header received
0808 14:48:56.971051 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:48:56.971054 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:48:56.971070 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:48:56.971139 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:48:56.971328 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:56.972177 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:56.973558 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:56.974285 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:56.974360 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:56.974417 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 14:48:56.974577 (+ 160us) server_negotiation.cc:299] Negotiation successful
0808 14:48:56.974629 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":233,"thread_start_us":83,"threads_started":1}
I20260808 14:48:56.974987 27292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:56.970717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.131:46707 (local address 127.0.0.1:34362)
0808 14:48:56.971146 (+ 429us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:56.971153 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0808 14:48:56.971195 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:48:56.971375 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:48:56.971375 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:48:56.971377 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:48:56.971535 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:56.971538 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:56.972894 (+ 1356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:56.972895 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:56.973816 (+ 921us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:56.973819 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:56.974711 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:56.974712 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:56.974770 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:56.974775 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 14:48:56.974900 (+ 125us) client_negotiation.cc:240] Negotiation successful
0808 14:48:56.974932 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":412,"mutex_wait_us":95,"thread_start_us":67,"threads_started":1}
I20260808 14:48:56.975226 27296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:56.970826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34362 (local address 127.30.214.131:46707)
0808 14:48:56.971035 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0808 14:48:56.971040 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:48:56.971248 (+ 208us) server_negotiation.cc:407] Connection header received
0808 14:48:56.971292 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:48:56.971295 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:48:56.971309 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:48:56.971374 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:48:56.971615 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:56.972755 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:56.973902 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:56.974509 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:56.974627 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:56.974686 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 14:48:56.975091 (+ 405us) server_negotiation.cc:299] Negotiation successful
0808 14:48:56.975140 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":99,"threads_started":1}
I20260808 14:48:56.975234 27289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:56.970508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.130:38251 (local address 127.0.0.1:41408)
0808 14:48:56.970999 (+ 491us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:56.971009 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:48:56.971071 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:48:56.971407 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:48:56.971408 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:48:56.971410 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:48:56.971467 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:56.971469 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:56.972841 (+ 1372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:56.972842 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:56.974038 (+ 1196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:56.974041 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:56.974957 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:56.974958 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:56.975026 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:56.975030 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:48:56.975125 (+ 95us) client_negotiation.cc:240] Negotiation successful
0808 14:48:56.975164 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":471,"mutex_wait_us":2,"thread_start_us":65,"threads_started":1}
I20260808 14:48:56.975610 27290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:56.970645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41408 (local address 127.30.214.130:38251)
0808 14:48:56.970825 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0808 14:48:56.970830 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:48:56.971079 (+ 249us) server_negotiation.cc:407] Connection header received
0808 14:48:56.971132 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:48:56.971135 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:48:56.971152 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:48:56.971243 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:48:56.971625 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:56.972735 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:56.974126 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:56.974820 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:56.975376 (+ 556us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:56.975462 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 14:48:56.975489 (+ 27us) server_negotiation.cc:299] Negotiation successful
0808 14:48:56.975532 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":72,"threads_started":1}
I20260808 14:48:56.975900 26767 tablet_service.cc:1467] Processing CreateTablet for tablet 56adda5e97014e7f92009fe36d63115d (DEFAULT_TABLE table=test-table [id=7a2adcc94faa40a7bacd8d71ef2f1733]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:48:56.975908 27181 tablet_service.cc:1467] Processing CreateTablet for tablet 56adda5e97014e7f92009fe36d63115d (DEFAULT_TABLE table=test-table [id=7a2adcc94faa40a7bacd8d71ef2f1733]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:48:56.976212 26767 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56adda5e97014e7f92009fe36d63115d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:48:56.976213 27181 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56adda5e97014e7f92009fe36d63115d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:48:56.978894 27298 tablet_bootstrap.cc:492] T 56adda5e97014e7f92009fe36d63115d P a2dd14f6d02f419e8500c47e8444313e: Bootstrap starting.
I20260808 14:48:56.979267 26980 tablet_service.cc:1467] Processing CreateTablet for tablet 56adda5e97014e7f92009fe36d63115d (DEFAULT_TABLE table=test-table [id=7a2adcc94faa40a7bacd8d71ef2f1733]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:48:56.979596 27298 tablet_bootstrap.cc:654] T 56adda5e97014e7f92009fe36d63115d P a2dd14f6d02f419e8500c47e8444313e: Neither blocks nor log segments found. Creating new log.
I20260808 14:48:56.979631 26980 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56adda5e97014e7f92009fe36d63115d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:48:56.980058 27298 log.cc:824] T 56adda5e97014e7f92009fe36d63115d P a2dd14f6d02f419e8500c47e8444313e: Log is configured to *not* fsync() on all Append() calls
I20260808 14:48:56.980733 27298 tablet_bootstrap.cc:492] T 56adda5e97014e7f92009fe36d63115d P a2dd14f6d02f419e8500c47e8444313e: No bootstrap required, opened a new log
I20260808 14:48:56.980798 27298 ts_tablet_manager.cc:1397] T 56adda5e97014e7f92009fe36d63115d P a2dd14f6d02f419e8500c47e8444313e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:48:56.981732 27299 tablet_bootstrap.cc:492] T 56adda5e97014e7f92009fe36d63115d P 1174de30c5014a83bfdaba873d1a9f88: Bootstrap starting.
I20260808 14:48:56.982435 27299 tablet_bootstrap.cc:654] T 56adda5e97014e7f92009fe36d63115d P 1174de30c5014a83bfdaba873d1a9f88: Neither blocks nor log segments found. Creating new log.
I20260808 14:48:56.982760 27298 raft_consensus.cc:348] T 56adda5e97014e7f92009fe36d63115d P a2dd14f6d02f419e8500c47e8444313e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2dd14f6d02f419e8500c47e8444313e" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 45515 } } peers { permanent_uuid: "e594c2fd009a4a5fbc800d41202037ab" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 38251 } } peers { permanent_uuid: "1174de30c5014a83bfdaba873d1a9f88" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 46707 } }
I20260808 14:48:56.982966 27298 raft_consensus.cc:374] T 56adda5e97014e7f92009fe36d63115d P a2dd14f6d02f419e8500c47e8444313e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:48:56.983011 27298 raft_consensus.cc:729] T 56adda5e97014e7f92009fe36d63115d P a2dd14f6d02f419e8500c47e8444313e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2dd14f6d02f419e8500c47e8444313e, State: Initialized, Role: FOLLOWER
I20260808 14:48:56.983050 27299 log.cc:824] T 56adda5e97014e7f92009fe36d63115d P 1174de30c5014a83bfdaba873d1a9f88: Log is configured to *not* fsync() on all Append() calls
I20260808 14:48:56.983147 27298 consensus_queue.cc:260] T 56adda5e97014e7f92009fe36d63115d P a2dd14f6d02f419e8500c47e8444313e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2dd14f6d02f419e8500c47e8444313e" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 45515 } } peers { permanent_uuid: "e594c2fd009a4a5fbc800d41202037ab" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 38251 } } peers { permanent_uuid: "1174de30c5014a83bfdaba873d1a9f88" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 46707 } }
I20260808 14:48:56.983457 27298 ts_tablet_manager.cc:1428] T 56adda5e97014e7f92009fe36d63115d P a2dd14f6d02f419e8500c47e8444313e: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 14:48:56.983525 26866 heartbeater.cc:503] Master 127.30.214.190:41015 was elected leader, sending a full tablet report...
I20260808 14:48:56.983690 27301 tablet_bootstrap.cc:492] T 56adda5e97014e7f92009fe36d63115d P e594c2fd009a4a5fbc800d41202037ab: Bootstrap starting.
I20260808 14:48:56.983850 27299 tablet_bootstrap.cc:492] T 56adda5e97014e7f92009fe36d63115d P 1174de30c5014a83bfdaba873d1a9f88: No bootstrap required, opened a new log
I20260808 14:48:56.983920 27299 ts_tablet_manager.cc:1397] T 56adda5e97014e7f92009fe36d63115d P 1174de30c5014a83bfdaba873d1a9f88: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:48:56.984331 27301 tablet_bootstrap.cc:654] T 56adda5e97014e7f92009fe36d63115d P e594c2fd009a4a5fbc800d41202037ab: Neither blocks nor log segments found. Creating new log.
I20260808 14:48:56.984872 27301 log.cc:824] T 56adda5e97014e7f92009fe36d63115d P e594c2fd009a4a5fbc800d41202037ab: Log is configured to *not* fsync() on all Append() calls
I20260808 14:48:56.985671 27301 tablet_bootstrap.cc:492] T 56adda5e97014e7f92009fe36d63115d P e594c2fd009a4a5fbc800d41202037ab: No bootstrap required, opened a new log
I20260808 14:48:56.985744 27301 ts_tablet_manager.cc:1397] T 56adda5e97014e7f92009fe36d63115d P e594c2fd009a4a5fbc800d41202037ab: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:48:56.985911 27299 raft_consensus.cc:348] T 56adda5e97014e7f92009fe36d63115d P 1174de30c5014a83bfdaba873d1a9f88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2dd14f6d02f419e8500c47e8444313e" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 45515 } } peers { permanent_uuid: "e594c2fd009a4a5fbc800d41202037ab" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 38251 } } peers { permanent_uuid: "1174de30c5014a83bfdaba873d1a9f88" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 46707 } }
I20260808 14:48:56.986086 27299 raft_consensus.cc:374] T 56adda5e97014e7f92009fe36d63115d P 1174de30c5014a83bfdaba873d1a9f88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:48:56.986131 27299 raft_consensus.cc:729] T 56adda5e97014e7f92009fe36d63115d P 1174de30c5014a83bfdaba873d1a9f88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1174de30c5014a83bfdaba873d1a9f88, State: Initialized, Role: FOLLOWER
I20260808 14:48:56.986249 27299 consensus_queue.cc:260] T 56adda5e97014e7f92009fe36d63115d P 1174de30c5014a83bfdaba873d1a9f88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2dd14f6d02f419e8500c47e8444313e" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 45515 } } peers { permanent_uuid: "e594c2fd009a4a5fbc800d41202037ab" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 38251 } } peers { permanent_uuid: "1174de30c5014a83bfdaba873d1a9f88" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 46707 } }
I20260808 14:48:56.986529 27299 ts_tablet_manager.cc:1428] T 56adda5e97014e7f92009fe36d63115d P 1174de30c5014a83bfdaba873d1a9f88: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 14:48:56.986665 27275 heartbeater.cc:503] Master 127.30.214.190:41015 was elected leader, sending a full tablet report...
I20260808 14:48:56.987429 27301 raft_consensus.cc:348] T 56adda5e97014e7f92009fe36d63115d P e594c2fd009a4a5fbc800d41202037ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2dd14f6d02f419e8500c47e8444313e" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 45515 } } peers { permanent_uuid: "e594c2fd009a4a5fbc800d41202037ab" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 38251 } } peers { permanent_uuid: "1174de30c5014a83bfdaba873d1a9f88" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 46707 } }
I20260808 14:48:56.987577 27301 raft_consensus.cc:374] T 56adda5e97014e7f92009fe36d63115d P e594c2fd009a4a5fbc800d41202037ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:48:56.987623 27301 raft_consensus.cc:729] T 56adda5e97014e7f92009fe36d63115d P e594c2fd009a4a5fbc800d41202037ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e594c2fd009a4a5fbc800d41202037ab, State: Initialized, Role: FOLLOWER
I20260808 14:48:56.987733 27301 consensus_queue.cc:260] T 56adda5e97014e7f92009fe36d63115d P e594c2fd009a4a5fbc800d41202037ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2dd14f6d02f419e8500c47e8444313e" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 45515 } } peers { permanent_uuid: "e594c2fd009a4a5fbc800d41202037ab" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 38251 } } peers { permanent_uuid: "1174de30c5014a83bfdaba873d1a9f88" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 46707 } }
I20260808 14:48:56.987967 27301 ts_tablet_manager.cc:1428] T 56adda5e97014e7f92009fe36d63115d P e594c2fd009a4a5fbc800d41202037ab: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260808 14:48:56.988009 27074 heartbeater.cc:503] Master 127.30.214.190:41015 was elected leader, sending a full tablet report...
I20260808 14:48:56.988515 27305 raft_consensus.cc:482] T 56adda5e97014e7f92009fe36d63115d P 1174de30c5014a83bfdaba873d1a9f88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:48:56.988598 27305 raft_consensus.cc:504] T 56adda5e97014e7f92009fe36d63115d P 1174de30c5014a83bfdaba873d1a9f88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2dd14f6d02f419e8500c47e8444313e" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 45515 } } peers { permanent_uuid: "e594c2fd009a4a5fbc800d41202037ab" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 38251 } } peers { permanent_uuid: "1174de30c5014a83bfdaba873d1a9f88" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 46707 } }
I20260808 14:48:56.989058 27305 leader_election.cc:288] T 56adda5e97014e7f92009fe36d63115d P 1174de30c5014a83bfdaba873d1a9f88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2dd14f6d02f419e8500c47e8444313e (127.30.214.129:45515), e594c2fd009a4a5fbc800d41202037ab (127.30.214.130:38251)
I20260808 14:48:56.991655 27290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:56.989222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:57019 (local address 127.30.214.130:38251)
0808 14:48:56.989263 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 14:48:56.989265 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:48:56.989377 (+ 112us) server_negotiation.cc:407] Connection header received
0808 14:48:56.989433 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:48:56.989434 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:48:56.989462 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:48:56.989515 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:48:56.989648 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:56.990110 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:56.990994 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:56.991347 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:56.991410 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:56.991435 (+ 25us) server_negotiation.cc:1035] Waiting for connection context
0808 14:48:56.991557 (+ 122us) server_negotiation.cc:299] Negotiation successful
0808 14:48:56.991595 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 14:48:56.991667 27278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:56.988999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.129:45515 (local address 127.30.214.131:48233)
0808 14:48:56.989055 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:56.989068 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:48:56.989112 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:48:56.989297 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:48:56.989298 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:48:56.989300 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:48:56.989365 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:56.989367 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:56.990103 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:56.990104 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:56.990848 (+ 744us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:56.990850 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:56.991403 (+ 553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:56.991404 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:56.991490 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:56.991493 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:48:56.991542 (+ 49us) client_negotiation.cc:240] Negotiation successful
0808 14:48:56.991589 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260808 14:48:56.991675 27311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:56.989177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.130:38251 (local address 127.30.214.131:57019)
0808 14:48:56.989323 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:56.989334 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:48:56.989386 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:48:56.989516 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:48:56.989517 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:48:56.989518 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:48:56.989571 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:56.989588 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:56.990175 (+ 587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:56.990176 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:56.990904 (+ 728us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:56.990907 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:56.991420 (+ 513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:56.991421 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:56.991490 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:56.991493 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:48:56.991545 (+ 52us) client_negotiation.cc:240] Negotiation successful
0808 14:48:56.991585 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":87,"threads_started":1}
I20260808 14:48:56.991921 27291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:56.989078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:48233 (local address 127.30.214.129:45515)
0808 14:48:56.989124 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 14:48:56.989126 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:48:56.989135 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:48:56.989160 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:48:56.989161 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:48:56.989170 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:48:56.989222 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:48:56.989435 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:56.990033 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:56.990935 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:56.991331 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:56.991386 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:56.991396 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 14:48:56.991818 (+ 422us) server_negotiation.cc:299] Negotiation successful
0808 14:48:56.991862 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 14:48:56.992221 27008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56adda5e97014e7f92009fe36d63115d" candidate_uuid: "1174de30c5014a83bfdaba873d1a9f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e594c2fd009a4a5fbc800d41202037ab" is_pre_election: true
I20260808 14:48:56.992287 26801 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56adda5e97014e7f92009fe36d63115d" candidate_uuid: "1174de30c5014a83bfdaba873d1a9f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2dd14f6d02f419e8500c47e8444313e" is_pre_election: true
I20260808 14:48:56.992336 27008 raft_consensus.cc:2454] T 56adda5e97014e7f92009fe36d63115d P e594c2fd009a4a5fbc800d41202037ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1174de30c5014a83bfdaba873d1a9f88 in term 0.
I20260808 14:48:56.992420 26801 raft_consensus.cc:2454] T 56adda5e97014e7f92009fe36d63115d P a2dd14f6d02f419e8500c47e8444313e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1174de30c5014a83bfdaba873d1a9f88 in term 0.
I20260808 14:48:56.992540 27116 leader_election.cc:302] T 56adda5e97014e7f92009fe36d63115d P 1174de30c5014a83bfdaba873d1a9f88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1174de30c5014a83bfdaba873d1a9f88, e594c2fd009a4a5fbc800d41202037ab; no voters:
I20260808 14:48:56.992658 27305 raft_consensus.cc:2781] T 56adda5e97014e7f92009fe36d63115d P 1174de30c5014a83bfdaba873d1a9f88 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:48:56.992702 27305 raft_consensus.cc:482] T 56adda5e97014e7f92009fe36d63115d P 1174de30c5014a83bfdaba873d1a9f88 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:48:56.992728 27305 raft_consensus.cc:3037] T 56adda5e97014e7f92009fe36d63115d P 1174de30c5014a83bfdaba873d1a9f88 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:48:56.993396 27305 raft_consensus.cc:504] T 56adda5e97014e7f92009fe36d63115d P 1174de30c5014a83bfdaba873d1a9f88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2dd14f6d02f419e8500c47e8444313e" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 45515 } } peers { permanent_uuid: "e594c2fd009a4a5fbc800d41202037ab" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 38251 } } peers { permanent_uuid: "1174de30c5014a83bfdaba873d1a9f88" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 46707 } }
I20260808 14:48:56.993553 27305 leader_election.cc:288] T 56adda5e97014e7f92009fe36d63115d P 1174de30c5014a83bfdaba873d1a9f88 [CANDIDATE]: Term 1 election: Requested vote from peers a2dd14f6d02f419e8500c47e8444313e (127.30.214.129:45515), e594c2fd009a4a5fbc800d41202037ab (127.30.214.130:38251)
I20260808 14:48:56.993664 26801 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56adda5e97014e7f92009fe36d63115d" candidate_uuid: "1174de30c5014a83bfdaba873d1a9f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2dd14f6d02f419e8500c47e8444313e"
I20260808 14:48:56.993736 26801 raft_consensus.cc:3037] T 56adda5e97014e7f92009fe36d63115d P a2dd14f6d02f419e8500c47e8444313e [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:48:56.993731 27008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56adda5e97014e7f92009fe36d63115d" candidate_uuid: "1174de30c5014a83bfdaba873d1a9f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e594c2fd009a4a5fbc800d41202037ab"
I20260808 14:48:56.993801 27008 raft_consensus.cc:3037] T 56adda5e97014e7f92009fe36d63115d P e594c2fd009a4a5fbc800d41202037ab [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:48:56.994445 26801 raft_consensus.cc:2454] T 56adda5e97014e7f92009fe36d63115d P a2dd14f6d02f419e8500c47e8444313e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1174de30c5014a83bfdaba873d1a9f88 in term 1.
I20260808 14:48:56.994462 27008 raft_consensus.cc:2454] T 56adda5e97014e7f92009fe36d63115d P e594c2fd009a4a5fbc800d41202037ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1174de30c5014a83bfdaba873d1a9f88 in term 1.
I20260808 14:48:56.994624 27113 leader_election.cc:302] T 56adda5e97014e7f92009fe36d63115d P 1174de30c5014a83bfdaba873d1a9f88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1174de30c5014a83bfdaba873d1a9f88, a2dd14f6d02f419e8500c47e8444313e; no voters:
I20260808 14:48:56.994721 27305 raft_consensus.cc:2781] T 56adda5e97014e7f92009fe36d63115d P 1174de30c5014a83bfdaba873d1a9f88 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:48:56.994859 27305 raft_consensus.cc:686] T 56adda5e97014e7f92009fe36d63115d P 1174de30c5014a83bfdaba873d1a9f88 [term 1 LEADER]: Becoming Leader. State: Replica: 1174de30c5014a83bfdaba873d1a9f88, State: Running, Role: LEADER
I20260808 14:48:56.994946 27305 consensus_queue.cc:237] T 56adda5e97014e7f92009fe36d63115d P 1174de30c5014a83bfdaba873d1a9f88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2dd14f6d02f419e8500c47e8444313e" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 45515 } } peers { permanent_uuid: "e594c2fd009a4a5fbc800d41202037ab" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 38251 } } peers { permanent_uuid: "1174de30c5014a83bfdaba873d1a9f88" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 46707 } }
I20260808 14:48:56.995780 26572 catalog_manager.cc:5495] T 56adda5e97014e7f92009fe36d63115d P 1174de30c5014a83bfdaba873d1a9f88 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1174de30c5014a83bfdaba873d1a9f88 (127.30.214.131). New cstate: current_term: 1 leader_uuid: "1174de30c5014a83bfdaba873d1a9f88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2dd14f6d02f419e8500c47e8444313e" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 45515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e594c2fd009a4a5fbc800d41202037ab" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 38251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1174de30c5014a83bfdaba873d1a9f88" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 46707 } health_report { overall_health: HEALTHY } } }
I20260808 14:48:57.002003 27296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:56.999722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34366 (local address 127.30.214.131:46707)
0808 14:48:56.999766 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 14:48:56.999768 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:48:56.999776 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:48:56.999861 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:48:56.999862 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:48:56.999879 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:48:56.999936 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:48:57.000060 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:57.000515 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:57.001250 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:57.001436 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:57.001535 (+ 99us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:57.001691 (+ 156us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:48:57.001780 (+ 89us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:48:57.001865 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 14:48:57.001915 (+ 50us) server_negotiation.cc:299] Negotiation successful
0808 14:48:57.001925 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 14:48:57.003703 26801 raft_consensus.cc:1261] T 56adda5e97014e7f92009fe36d63115d P a2dd14f6d02f419e8500c47e8444313e [term 1 FOLLOWER]: Refusing update from remote peer 1174de30c5014a83bfdaba873d1a9f88: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:48:57.003706 27008 raft_consensus.cc:1261] T 56adda5e97014e7f92009fe36d63115d P e594c2fd009a4a5fbc800d41202037ab [term 1 FOLLOWER]: Refusing update from remote peer 1174de30c5014a83bfdaba873d1a9f88: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:48:57.004014 27312 consensus_queue.cc:1035] T 56adda5e97014e7f92009fe36d63115d P 1174de30c5014a83bfdaba873d1a9f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e594c2fd009a4a5fbc800d41202037ab" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 38251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:48:57.004138 27305 consensus_queue.cc:1035] T 56adda5e97014e7f92009fe36d63115d P 1174de30c5014a83bfdaba873d1a9f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2dd14f6d02f419e8500c47e8444313e" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 45515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:48:57.006454 27315 mvcc.cc:205] Tried to move back new op lower bound from 7316277399564869632 to 7316277399532134400. Current Snapshot: MvccSnapshot[applied={T|T < 7316277399564869632}]
I20260808 14:48:57.006634 27317 mvcc.cc:205] Tried to move back new op lower bound from 7316277399564869632 to 7316277399532134400. Current Snapshot: MvccSnapshot[applied={T|T < 7316277399564869632}]
I20260808 14:48:57.008872 26572 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48824:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:48:57.008975 26572 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48824:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:48:57.009709 26572 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c9002693d8f940f08d3f476d794f3cd3: Sending DeleteTablet for 3 replicas of tablet 56adda5e97014e7f92009fe36d63115d
I20260808 14:48:57.010040 26767 tablet_service.cc:1514] Processing DeleteTablet for tablet 56adda5e97014e7f92009fe36d63115d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:48:57 UTC) from {username='kudu', principal='kudu/127.30.214.190@KRBTEST.COM'} at 127.0.0.1:47620
I20260808 14:48:57.010072 26980 tablet_service.cc:1514] Processing DeleteTablet for tablet 56adda5e97014e7f92009fe36d63115d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:48:57 UTC) from {username='kudu', principal='kudu/127.30.214.190@KRBTEST.COM'} at 127.0.0.1:41408
I20260808 14:48:57.010092 27181 tablet_service.cc:1514] Processing DeleteTablet for tablet 56adda5e97014e7f92009fe36d63115d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:48:57 UTC) from {username='kudu', principal='kudu/127.30.214.190@KRBTEST.COM'} at 127.0.0.1:34362
I20260808 14:48:57.010350 27327 tablet_replica.cc:330] T 56adda5e97014e7f92009fe36d63115d P e594c2fd009a4a5fbc800d41202037ab: stopping tablet replica
I20260808 14:48:57.010456 27327 raft_consensus.cc:2229] T 56adda5e97014e7f92009fe36d63115d P e594c2fd009a4a5fbc800d41202037ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:48:57.010558 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 26671
I20260808 14:48:57.017715 27327 raft_consensus.cc:2258] T 56adda5e97014e7f92009fe36d63115d P e594c2fd009a4a5fbc800d41202037ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:48:57.022666 27327 ts_tablet_manager.cc:1905] T 56adda5e97014e7f92009fe36d63115d P e594c2fd009a4a5fbc800d41202037ab: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:48:57.024982 27327 ts_tablet_manager.cc:1918] T 56adda5e97014e7f92009fe36d63115d P e594c2fd009a4a5fbc800d41202037ab: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:48:57.025044 27330 tablet_replica.cc:330] T 56adda5e97014e7f92009fe36d63115d P 1174de30c5014a83bfdaba873d1a9f88: stopping tablet replica
I20260808 14:48:57.025080 27327 log.cc:1196] T 56adda5e97014e7f92009fe36d63115d P e594c2fd009a4a5fbc800d41202037ab: Deleting WAL directory at /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/minicluster-data/ts-1/wal/wals/56adda5e97014e7f92009fe36d63115d
I20260808 14:48:57.025174 27330 raft_consensus.cc:2229] T 56adda5e97014e7f92009fe36d63115d P 1174de30c5014a83bfdaba873d1a9f88 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:48:57.025297 27330 raft_consensus.cc:2258] T 56adda5e97014e7f92009fe36d63115d P 1174de30c5014a83bfdaba873d1a9f88 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:48:57.025354 27327 ts_tablet_manager.cc:1939] T 56adda5e97014e7f92009fe36d63115d P e594c2fd009a4a5fbc800d41202037ab: Deleting consensus metadata
I20260808 14:48:57.025846 27330 ts_tablet_manager.cc:1905] T 56adda5e97014e7f92009fe36d63115d P 1174de30c5014a83bfdaba873d1a9f88: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:48:57.025871 26553 catalog_manager.cc:4841] TS e594c2fd009a4a5fbc800d41202037ab (127.30.214.130:38251): tablet 56adda5e97014e7f92009fe36d63115d (table test-table [id=7a2adcc94faa40a7bacd8d71ef2f1733]) successfully deleted
I20260808 14:48:57.027153 27330 ts_tablet_manager.cc:1918] T 56adda5e97014e7f92009fe36d63115d P 1174de30c5014a83bfdaba873d1a9f88: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:48:57.027227 27330 log.cc:1196] T 56adda5e97014e7f92009fe36d63115d P 1174de30c5014a83bfdaba873d1a9f88: Deleting WAL directory at /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786200295877777-31578-0/minicluster-data/ts-2/wal/wals/56adda5e97014e7f92009fe36d63115d
I20260808 14:48:57.027513 27330 ts_tablet_manager.cc:1939] T 56adda5e97014e7f92009fe36d63115d P 1174de30c5014a83bfdaba873d1a9f88: Deleting consensus metadata
I20260808 14:48:57.027920 26553 catalog_manager.cc:4841] TS 1174de30c5014a83bfdaba873d1a9f88 (127.30.214.131:46707): tablet 56adda5e97014e7f92009fe36d63115d (table test-table [id=7a2adcc94faa40a7bacd8d71ef2f1733]) successfully deleted
W20260808 14:48:57.030892 26550 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.30.214.129:45515 (error 108)
I20260808 14:48:57.031430 27289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:57.031308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.129:45515 (local address 127.0.0.1:47636)
0808 14:48:57.031361 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:57.031398 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.129:45515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260808 14:48:57.031572 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 26873
W20260808 14:48:57.031551 26550 catalog_manager.cc:4584] TS a2dd14f6d02f419e8500c47e8444313e (127.30.214.129:45515): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 56adda5e97014e7f92009fe36d63115d: Network error: Client connection negotiation failed: client connection to 127.30.214.129:45515: connect: Connection refused (error 111)
I20260808 14:48:57.039955 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 27089
I20260808 14:48:57.053045 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 26523
2026-08-08T14:48:57Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2062 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-08T14:48:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:48:57Z Disabled control of system clock
I20260808 14:48:57.090342 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200295877777-31578-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200295877777-31578-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200295877777-31578-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:37109
--webserver_interface=127.30.214.190
--webserver_port=0
--builtin_ntp_servers=127.30.214.148:43665
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.214.190:37109
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 14:48:57.174907 27335 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:48:57.175153 27335 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:48:57.175174 27335 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:48:57.176339 27335 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:48:57.176383 27335 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:48:57.176393 27335 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:48:57.176405 27335 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:48:57.176416 27335 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:48:57.177870 27335 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:43665
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200295877777-31578-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200295877777-31578-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.214.190:37109
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:37109
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27335
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200295877777-31578-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:48:57.178107 27335 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:48:57.178361 27335 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:48:57.183207 27344 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:48:57.183199 27345 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:48:57.183199 27348 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:48:57.183871 27335 server_base.cc:1034] running on GCE node
I20260808 14:48:57.184120 27335 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:48:57.184419 27335 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:48:57.185562 27335 hybrid_clock.cc:648] HybridClock initialized: now 1786200537185545 us; error 29 us; skew 500 ppm
I20260808 14:48:57.186813 27335 webserver.cc:460] Webserver started at http://127.30.214.190:46719/ using document root <none> and password file <none>
I20260808 14:48:57.187050 27335 fs_manager.cc:359] Metadata directory not provided
I20260808 14:48:57.187101 27335 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:48:57.187233 27335 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:48:57.188339 27335 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200295877777-31578-0/minicluster-data/master-0/data/instance:
uuid: "33ddf2af4aae439b9d57bf60254cc016"
format_stamp: "Formatted at 2026-08-08 14:48:57 on dist-test-slave-42z9"
server_key: "332effe2f899a7728d45b9e022152c82"
server_key_iv: "2e884cd20683976d5ae002e753d2d652"
server_key_version: "encryptionkey@0"
I20260808 14:48:57.188689 27335 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200295877777-31578-0/minicluster-data/master-0/wal/instance:
uuid: "33ddf2af4aae439b9d57bf60254cc016"
format_stamp: "Formatted at 2026-08-08 14:48:57 on dist-test-slave-42z9"
server_key: "332effe2f899a7728d45b9e022152c82"
server_key_iv: "2e884cd20683976d5ae002e753d2d652"
server_key_version: "encryptionkey@0"
I20260808 14:48:57.190192 27335 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 14:48:57.190964 27355 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:48:57.191141 27335 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:48:57.191229 27335 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200295877777-31578-0/minicluster-data/master-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200295877777-31578-0/minicluster-data/master-0/wal
uuid: "33ddf2af4aae439b9d57bf60254cc016"
format_stamp: "Formatted at 2026-08-08 14:48:57 on dist-test-slave-42z9"
server_key: "332effe2f899a7728d45b9e022152c82"
server_key_iv: "2e884cd20683976d5ae002e753d2d652"
server_key_version: "encryptionkey@0"
I20260808 14:48:57.191294 27335 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200295877777-31578-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200295877777-31578-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200295877777-31578-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:48:57.201704 27335 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:48:57.202014 27335 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:48:57.202139 27335 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:48:57.206080 27335 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.190:37109
I20260808 14:48:57.206123 27441 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.190:37109 every 8 connection(s)
I20260808 14:48:57.206463 27335 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
I20260808 14:48:57.207497 27442 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:48:57.209962 27442 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 33ddf2af4aae439b9d57bf60254cc016: Bootstrap starting.
I20260808 14:48:57.210565 27442 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 33ddf2af4aae439b9d57bf60254cc016: Neither blocks nor log segments found. Creating new log.
I20260808 14:48:57.210857 27442 log.cc:824] T 00000000000000000000000000000000 P 33ddf2af4aae439b9d57bf60254cc016: Log is configured to *not* fsync() on all Append() calls
I20260808 14:48:57.211577 27442 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 33ddf2af4aae439b9d57bf60254cc016: No bootstrap required, opened a new log
I20260808 14:48:57.213253 27442 raft_consensus.cc:348] T 00000000000000000000000000000000 P 33ddf2af4aae439b9d57bf60254cc016 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33ddf2af4aae439b9d57bf60254cc016" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 37109 } }
I20260808 14:48:57.213419 27442 raft_consensus.cc:374] T 00000000000000000000000000000000 P 33ddf2af4aae439b9d57bf60254cc016 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:48:57.213487 27442 raft_consensus.cc:729] T 00000000000000000000000000000000 P 33ddf2af4aae439b9d57bf60254cc016 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33ddf2af4aae439b9d57bf60254cc016, State: Initialized, Role: FOLLOWER
I20260808 14:48:57.213644 27442 consensus_queue.cc:260] T 00000000000000000000000000000000 P 33ddf2af4aae439b9d57bf60254cc016 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33ddf2af4aae439b9d57bf60254cc016" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 37109 } }
I20260808 14:48:57.213724 27442 raft_consensus.cc:388] T 00000000000000000000000000000000 P 33ddf2af4aae439b9d57bf60254cc016 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:48:57.213766 27442 raft_consensus.cc:482] T 00000000000000000000000000000000 P 33ddf2af4aae439b9d57bf60254cc016 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:48:57.213816 27442 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 33ddf2af4aae439b9d57bf60254cc016 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:48:57.214403 27442 raft_consensus.cc:504] T 00000000000000000000000000000000 P 33ddf2af4aae439b9d57bf60254cc016 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33ddf2af4aae439b9d57bf60254cc016" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 37109 } }
I20260808 14:48:57.214498 27442 leader_election.cc:302] T 00000000000000000000000000000000 P 33ddf2af4aae439b9d57bf60254cc016 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 33ddf2af4aae439b9d57bf60254cc016; no voters:
I20260808 14:48:57.214694 27442 leader_election.cc:288] T 00000000000000000000000000000000 P 33ddf2af4aae439b9d57bf60254cc016 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:48:57.214761 27447 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 33ddf2af4aae439b9d57bf60254cc016 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:48:57.214958 27442 sys_catalog.cc:564] T 00000000000000000000000000000000 P 33ddf2af4aae439b9d57bf60254cc016 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:48:57.214995 27447 raft_consensus.cc:686] T 00000000000000000000000000000000 P 33ddf2af4aae439b9d57bf60254cc016 [term 1 LEADER]: Becoming Leader. State: Replica: 33ddf2af4aae439b9d57bf60254cc016, State: Running, Role: LEADER
I20260808 14:48:57.215161 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 27335
I20260808 14:48:57.215204 27447 consensus_queue.cc:237] T 00000000000000000000000000000000 P 33ddf2af4aae439b9d57bf60254cc016 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33ddf2af4aae439b9d57bf60254cc016" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 37109 } }
I20260808 14:48:57.215256 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200295877777-31578-0/minicluster-data/master-0/wal/instance
I20260808 14:48:57.215489 31578 external_mini_cluster.cc:1428] Setting key 1904d5c8d2b38d58a76f93ca083f06a8
I20260808 14:48:57.215730 27450 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33ddf2af4aae439b9d57bf60254cc016 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 33ddf2af4aae439b9d57bf60254cc016. Latest consensus state: current_term: 1 leader_uuid: "33ddf2af4aae439b9d57bf60254cc016" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33ddf2af4aae439b9d57bf60254cc016" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 37109 } } }
I20260808 14:48:57.215814 27450 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33ddf2af4aae439b9d57bf60254cc016 [sys.catalog]: This master's current role is: LEADER
I20260808 14:48:57.216225 27449 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33ddf2af4aae439b9d57bf60254cc016 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "33ddf2af4aae439b9d57bf60254cc016" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33ddf2af4aae439b9d57bf60254cc016" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 37109 } } }
I20260808 14:48:57.216298 27449 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33ddf2af4aae439b9d57bf60254cc016 [sys.catalog]: This master's current role is: LEADER
W20260808 14:48:57.216892 27465 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 33ddf2af4aae439b9d57bf60254cc016: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:48:57.216991 27465 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:48:57.217083 27457 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:48:57.217329 27457 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:48:57.219028 27457 catalog_manager.cc:1347] Generated new cluster ID: c1f20ae495fb4a4293da52940f0b6aa8
I20260808 14:48:57.219089 27457 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:48:57.221475 27459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:57.215990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40336 (local address 127.30.214.190:37109)
0808 14:48:57.216181 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0808 14:48:57.216192 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 14:48:57.216678 (+ 486us) server_negotiation.cc:407] Connection header received
0808 14:48:57.216809 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:48:57.216816 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:48:57.216903 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:48:57.217059 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:48:57.217394 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:57.218632 (+ 1238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:57.219533 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:57.219967 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:57.220077 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:57.220745 (+ 668us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:48:57.220748 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:48:57.220749 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:48:57.220940 (+ 191us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:48:57.220974 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:48:57.220986 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:48:57.221042 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 14:48:57.221148 (+ 106us) server_negotiation.cc:299] Negotiation successful
0808 14:48:57.221237 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106,"thread_start_us":75,"threads_started":1}
I20260808 14:48:57.232197 27457 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:48:57.232916 27457 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:48:57.243813 27457 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 33ddf2af4aae439b9d57bf60254cc016: Generated new TSK 0
I20260808 14:48:57.244033 27457 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:48:57.250475 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200295877777-31578-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200295877777-31578-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200295877777-31578-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.129:0
--local_ip_for_outbound_sockets=127.30.214.129
--webserver_interface=127.30.214.129
--webserver_port=0
--tserver_master_addrs=127.30.214.190:37109
--builtin_ntp_servers=127.30.214.148:43665
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 14:48:57.342918 27471 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:48:57.343142 27471 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:48:57.343164 27471 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:48:57.344372 27471 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:48:57.344419 27471 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:48:57.344444 27471 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.129
I20260808 14:48:57.345894 27471 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:43665
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200295877777-31578-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200295877777-31578-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.214.129
--webserver_port=0
--tserver_master_addrs=127.30.214.190:37109
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27471
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.129
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200295877777-31578-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:48:57.346148 27471 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:48:57.346462 27471 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:48:57.351493 27483 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:48:57.351531 27486 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:48:57.351534 27480 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:48:57.351933 27471 server_base.cc:1034] running on GCE node
I20260808 14:48:57.352138 27471 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:48:57.352372 27471 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:48:57.353497 27471 hybrid_clock.cc:648] HybridClock initialized: now 1786200537353481 us; error 34 us; skew 500 ppm
I20260808 14:48:57.354809 27471 webserver.cc:460] Webserver started at http://127.30.214.129:41997/ using document root <none> and password file <none>
I20260808 14:48:57.355046 27471 fs_manager.cc:359] Metadata directory not provided
I20260808 14:48:57.355100 27471 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:48:57.355238 27471 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:48:57.356328 27471 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200295877777-31578-0/minicluster-data/ts-0/data/instance:
uuid: "cd319a23b5cb42e6a0ef521e81e12e03"
format_stamp: "Formatted at 2026-08-08 14:48:57 on dist-test-slave-42z9"
server_key: "2c4e4cf0a01ef56edf63cfdd06da320e"
server_key_iv: "ef91fbab9eb826327072f8aba0cd017b"
server_key_version: "encryptionkey@0"
I20260808 14:48:57.356711 27471 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200295877777-31578-0/minicluster-data/ts-0/wal/instance:
uuid: "cd319a23b5cb42e6a0ef521e81e12e03"
format_stamp: "Formatted at 2026-08-08 14:48:57 on dist-test-slave-42z9"
server_key: "2c4e4cf0a01ef56edf63cfdd06da320e"
server_key_iv: "ef91fbab9eb826327072f8aba0cd017b"
server_key_version: "encryptionkey@0"
I20260808 14:48:57.358119 27471 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:48:57.358872 27494 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:48:57.359055 27471 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:48:57.359164 27471 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200295877777-31578-0/minicluster-data/ts-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200295877777-31578-0/minicluster-data/ts-0/wal
uuid: "cd319a23b5cb42e6a0ef521e81e12e03"
format_stamp: "Formatted at 2026-08-08 14:48:57 on dist-test-slave-42z9"
server_key: "2c4e4cf0a01ef56edf63cfdd06da320e"
server_key_iv: "ef91fbab9eb826327072f8aba0cd017b"
server_key_version: "encryptionkey@0"
I20260808 14:48:57.359246 27471 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200295877777-31578-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200295877777-31578-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200295877777-31578-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:48:57.380620 27471 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:48:57.380939 27471 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:48:57.381042 27471 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:48:57.381240 27471 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:48:57.381634 27471 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:48:57.381672 27471 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:48:57.381695 27471 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:48:57.381718 27471 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:48:57.387395 27471 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.129:40655
I20260808 14:48:57.387442 27668 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.129:40655 every 8 connection(s)
I20260808 14:48:57.387785 27471 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
I20260808 14:48:57.392755 27459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:57.388476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.129:52295 (local address 127.30.214.190:37109)
0808 14:48:57.388529 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 14:48:57.388530 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:48:57.388765 (+ 235us) server_negotiation.cc:407] Connection header received
0808 14:48:57.389249 (+ 484us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:48:57.389250 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:48:57.389264 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:48:57.389303 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:48:57.390005 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:57.390502 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:57.391487 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:57.391685 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:57.391748 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:57.392558 (+ 810us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:48:57.392559 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:48:57.392559 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:48:57.392564 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:48:57.392574 (+ 10us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:48:57.392577 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:48:57.392609 (+ 32us) server_negotiation.cc:1035] Waiting for connection context
0808 14:48:57.392664 (+ 55us) server_negotiation.cc:299] Negotiation successful
0808 14:48:57.392690 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 14:48:57.392957 27672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:57.388462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:37109 (local address 127.30.214.129:52295)
0808 14:48:57.388633 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:57.388668 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 14:48:57.389158 (+ 490us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:48:57.389360 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:48:57.389363 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:48:57.389371 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:48:57.389928 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:57.389935 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:57.390578 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:57.390579 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:57.391376 (+ 797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:57.391378 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:57.391777 (+ 399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:57.391778 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:57.391897 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:57.392436 (+ 539us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:48:57.392437 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:48:57.392466 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:48:57.392492 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:48:57.392611 (+ 119us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:48:57.392613 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:48:57.392615 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 14:48:57.392661 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 14:48:57.392743 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":76,"threads_started":1}
I20260808 14:48:57.393488 27669 heartbeater.cc:347] Connected to a master server at 127.30.214.190:37109
I20260808 14:48:57.393600 27669 heartbeater.cc:464] Registering TS with master...
I20260808 14:48:57.393787 27669 heartbeater.cc:511] Master 127.30.214.190:37109 requested a full tablet report, sending...
I20260808 14:48:57.394284 27383 ts_manager.cc:194] Registered new tserver with Master: cd319a23b5cb42e6a0ef521e81e12e03 (127.30.214.129:40655)
I20260808 14:48:57.394884 27383 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.30.214.129:52295
I20260808 14:48:57.397302 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 27471
I20260808 14:48:57.397398 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200295877777-31578-0/minicluster-data/ts-0/wal/instance
I20260808 14:48:57.397614 31578 external_mini_cluster.cc:1428] Setting key 066466da8a34df44f549e5f72cf01824
I20260808 14:48:57.398428 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200295877777-31578-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200295877777-31578-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200295877777-31578-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.130:0
--local_ip_for_outbound_sockets=127.30.214.130
--webserver_interface=127.30.214.130
--webserver_port=0
--tserver_master_addrs=127.30.214.190:37109
--builtin_ntp_servers=127.30.214.148:43665
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 14:48:57.480623 27673 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:48:57.480852 27673 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:48:57.480875 27673 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:48:57.482180 27673 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:48:57.482232 27673 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:48:57.482260 27673 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.130
I20260808 14:48:57.483753 27673 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:43665
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200295877777-31578-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200295877777-31578-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.214.130
--webserver_port=0
--tserver_master_addrs=127.30.214.190:37109
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27673
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.130
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200295877777-31578-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:48:57.484001 27673 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:48:57.484306 27673 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 14:48:57.489665 27673 server_base.cc:1034] running on GCE node
W20260808 14:48:57.489686 27679 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:48:57.489826 27680 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:48:57.489668 27683 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:48:57.490127 27673 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:48:57.490360 27673 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:48:57.491523 27673 hybrid_clock.cc:648] HybridClock initialized: now 1786200537491510 us; error 31 us; skew 500 ppm
I20260808 14:48:57.492722 27673 webserver.cc:460] Webserver started at http://127.30.214.130:34367/ using document root <none> and password file <none>
I20260808 14:48:57.492952 27673 fs_manager.cc:359] Metadata directory not provided
I20260808 14:48:57.493002 27673 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:48:57.493136 27673 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:48:57.494297 27673 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200295877777-31578-0/minicluster-data/ts-1/data/instance:
uuid: "5fc3aaeecfc84b64b38d094a996c21af"
format_stamp: "Formatted at 2026-08-08 14:48:57 on dist-test-slave-42z9"
server_key: "4681be487a1fb7636a4addb2e8f74b51"
server_key_iv: "e60cfc974f2f0ba78dcdb95f8ec2577e"
server_key_version: "encryptionkey@0"
I20260808 14:48:57.494665 27673 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200295877777-31578-0/minicluster-data/ts-1/wal/instance:
uuid: "5fc3aaeecfc84b64b38d094a996c21af"
format_stamp: "Formatted at 2026-08-08 14:48:57 on dist-test-slave-42z9"
server_key: "4681be487a1fb7636a4addb2e8f74b51"
server_key_iv: "e60cfc974f2f0ba78dcdb95f8ec2577e"
server_key_version: "encryptionkey@0"
I20260808 14:48:57.495983 27673 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 14:48:57.496667 27694 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:48:57.496827 27673 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:48:57.496915 27673 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200295877777-31578-0/minicluster-data/ts-1/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200295877777-31578-0/minicluster-data/ts-1/wal
uuid: "5fc3aaeecfc84b64b38d094a996c21af"
format_stamp: "Formatted at 2026-08-08 14:48:57 on dist-test-slave-42z9"
server_key: "4681be487a1fb7636a4addb2e8f74b51"
server_key_iv: "e60cfc974f2f0ba78dcdb95f8ec2577e"
server_key_version: "encryptionkey@0"
I20260808 14:48:57.496981 27673 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200295877777-31578-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200295877777-31578-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200295877777-31578-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:48:57.508296 27673 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:48:57.508627 27673 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:48:57.508757 27673 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:48:57.508986 27673 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:48:57.509317 27673 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:48:57.509361 27673 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:48:57.509394 27673 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:48:57.509418 27673 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:48:57.515246 27673 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.130:40971
I20260808 14:48:57.515317 27872 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.130:40971 every 8 connection(s)
I20260808 14:48:57.515666 27673 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
I20260808 14:48:57.520965 27459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:57.516406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.130:50177 (local address 127.30.214.190:37109)
0808 14:48:57.516474 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0808 14:48:57.516476 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:48:57.516733 (+ 257us) server_negotiation.cc:407] Connection header received
0808 14:48:57.517276 (+ 543us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:48:57.517277 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:48:57.517290 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:48:57.517345 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:48:57.518109 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:57.518622 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:57.519633 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:57.519838 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:57.519900 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:57.520692 (+ 792us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:48:57.520694 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:48:57.520694 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:48:57.520701 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:48:57.520717 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:48:57.520722 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:48:57.520768 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 14:48:57.520845 (+ 77us) server_negotiation.cc:299] Negotiation successful
0808 14:48:57.520879 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 14:48:57.521179 27876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:57.516426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:37109 (local address 127.30.214.130:50177)
0808 14:48:57.516611 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:57.516647 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 14:48:57.517164 (+ 517us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:48:57.517422 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:48:57.517427 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:48:57.517463 (+ 36us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:48:57.518007 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:57.518012 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:57.518725 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:57.518726 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:57.519538 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:57.519541 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:57.519926 (+ 385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:57.519927 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:57.520061 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:57.520551 (+ 490us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:48:57.520552 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:48:57.520583 (+ 31us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:48:57.520608 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:48:57.520774 (+ 166us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:48:57.520781 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:48:57.520784 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:48:57.520845 (+ 61us) client_negotiation.cc:240] Negotiation successful
0808 14:48:57.520978 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":78,"threads_started":1}
I20260808 14:48:57.521659 27874 heartbeater.cc:347] Connected to a master server at 127.30.214.190:37109
I20260808 14:48:57.521762 27874 heartbeater.cc:464] Registering TS with master...
I20260808 14:48:57.521972 27874 heartbeater.cc:511] Master 127.30.214.190:37109 requested a full tablet report, sending...
I20260808 14:48:57.522337 27383 ts_manager.cc:194] Registered new tserver with Master: 5fc3aaeecfc84b64b38d094a996c21af (127.30.214.130:40971)
I20260808 14:48:57.522712 27383 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.30.214.130:50177
I20260808 14:48:57.524048 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 27673
I20260808 14:48:57.524143 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200295877777-31578-0/minicluster-data/ts-1/wal/instance
I20260808 14:48:57.524325 31578 external_mini_cluster.cc:1428] Setting key 6cab946250359d494060f798c2dd617b
I20260808 14:48:57.525154 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200295877777-31578-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200295877777-31578-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200295877777-31578-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.131:0
--local_ip_for_outbound_sockets=127.30.214.131
--webserver_interface=127.30.214.131
--webserver_port=0
--tserver_master_addrs=127.30.214.190:37109
--builtin_ntp_servers=127.30.214.148:43665
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 14:48:57.609167 27877 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:48:57.609401 27877 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:48:57.609433 27877 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:48:57.610646 27877 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:48:57.610690 27877 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:48:57.610723 27877 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.131
I20260808 14:48:57.612121 27877 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:43665
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200295877777-31578-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200295877777-31578-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.214.131
--webserver_port=0
--tserver_master_addrs=127.30.214.190:37109
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27877
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.131
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200295877777-31578-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:48:57.612380 27877 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:48:57.612674 27877 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:48:57.617862 27884 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:48:57.617905 27877 server_base.cc:1034] running on GCE node
W20260808 14:48:57.617849 27883 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:48:57.617846 27888 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:48:57.618263 27877 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:48:57.618487 27877 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:48:57.619643 27877 hybrid_clock.cc:648] HybridClock initialized: now 1786200537619628 us; error 29 us; skew 500 ppm
I20260808 14:48:57.621002 27877 webserver.cc:460] Webserver started at http://127.30.214.131:38595/ using document root <none> and password file <none>
I20260808 14:48:57.621261 27877 fs_manager.cc:359] Metadata directory not provided
I20260808 14:48:57.621313 27877 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:48:57.621487 27877 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:48:57.622598 27877 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200295877777-31578-0/minicluster-data/ts-2/data/instance:
uuid: "92d977c0b754499c9cc097089214abe3"
format_stamp: "Formatted at 2026-08-08 14:48:57 on dist-test-slave-42z9"
server_key: "cca86ecda98d54d8fcac6cda1b2b97c8"
server_key_iv: "ce071e1edb81636ca8e9954b46e1e753"
server_key_version: "encryptionkey@0"
I20260808 14:48:57.622957 27877 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200295877777-31578-0/minicluster-data/ts-2/wal/instance:
uuid: "92d977c0b754499c9cc097089214abe3"
format_stamp: "Formatted at 2026-08-08 14:48:57 on dist-test-slave-42z9"
server_key: "cca86ecda98d54d8fcac6cda1b2b97c8"
server_key_iv: "ce071e1edb81636ca8e9954b46e1e753"
server_key_version: "encryptionkey@0"
I20260808 14:48:57.624231 27877 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 14:48:57.624955 27896 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:48:57.625121 27877 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:48:57.625198 27877 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200295877777-31578-0/minicluster-data/ts-2/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200295877777-31578-0/minicluster-data/ts-2/wal
uuid: "92d977c0b754499c9cc097089214abe3"
format_stamp: "Formatted at 2026-08-08 14:48:57 on dist-test-slave-42z9"
server_key: "cca86ecda98d54d8fcac6cda1b2b97c8"
server_key_iv: "ce071e1edb81636ca8e9954b46e1e753"
server_key_version: "encryptionkey@0"
I20260808 14:48:57.625272 27877 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200295877777-31578-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200295877777-31578-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200295877777-31578-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:48:57.637372 27877 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:48:57.637727 27877 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:48:57.637861 27877 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:48:57.638103 27877 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:48:57.638466 27877 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:48:57.638504 27877 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:48:57.638533 27877 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:48:57.638558 27877 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:48:57.644385 27877 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.131:36881
I20260808 14:48:57.644441 28075 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.131:36881 every 8 connection(s)
I20260808 14:48:57.644783 27877 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
I20260808 14:48:57.650014 27459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:57.645582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:56001 (local address 127.30.214.190:37109)
0808 14:48:57.645645 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 14:48:57.645647 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:48:57.645898 (+ 251us) server_negotiation.cc:407] Connection header received
0808 14:48:57.646403 (+ 505us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:48:57.646404 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:48:57.646417 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:48:57.646471 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:48:57.647152 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:57.647660 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:57.648634 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:57.648831 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:57.648888 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:57.649734 (+ 846us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:48:57.649735 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:48:57.649736 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:48:57.649741 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:48:57.649758 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:48:57.649763 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:48:57.649809 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 14:48:57.649885 (+ 76us) server_negotiation.cc:299] Negotiation successful
0808 14:48:57.649927 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 14:48:57.650198 28078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:57.645572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:37109 (local address 127.30.214.131:56001)
0808 14:48:57.645772 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:57.645808 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 14:48:57.646302 (+ 494us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:48:57.646540 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:48:57.646543 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:48:57.646552 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:48:57.647057 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:57.647062 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:57.647749 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:57.647750 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:57.648541 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:57.648544 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:57.648905 (+ 361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:57.648905 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:57.649037 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:57.649598 (+ 561us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:48:57.649598 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:48:57.649629 (+ 31us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:48:57.649653 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:48:57.649814 (+ 161us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:48:57.649820 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:48:57.649824 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:48:57.649884 (+ 60us) client_negotiation.cc:240] Negotiation successful
0808 14:48:57.649993 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":91,"threads_started":1}
I20260808 14:48:57.650681 28076 heartbeater.cc:347] Connected to a master server at 127.30.214.190:37109
I20260808 14:48:57.650772 28076 heartbeater.cc:464] Registering TS with master...
I20260808 14:48:57.650949 28076 heartbeater.cc:511] Master 127.30.214.190:37109 requested a full tablet report, sending...
I20260808 14:48:57.651134 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 27877
I20260808 14:48:57.651237 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200295877777-31578-0/minicluster-data/ts-2/wal/instance
I20260808 14:48:57.651376 27383 ts_manager.cc:194] Registered new tserver with Master: 92d977c0b754499c9cc097089214abe3 (127.30.214.131:36881)
I20260808 14:48:57.651438 31578 external_mini_cluster.cc:1428] Setting key e68244e783a77ef2d68646f03101bde2
I20260808 14:48:57.651841 27383 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.30.214.131:56001
I20260808 14:48:57.652320 31578 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:48:57.656234 27459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:57.653731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40342 (local address 127.30.214.190:37109)
0808 14:48:57.653800 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0808 14:48:57.653802 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:48:57.653875 (+ 73us) server_negotiation.cc:407] Connection header received
0808 14:48:57.653921 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:48:57.653921 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:48:57.653931 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:48:57.653975 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:48:57.654092 (+ 117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:57.654545 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:57.655225 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:57.655397 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:57.655443 (+ 46us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:57.656010 (+ 567us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:48:57.656011 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:48:57.656011 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:48:57.656016 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:48:57.656031 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:48:57.656035 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:48:57.656102 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 14:48:57.656144 (+ 42us) server_negotiation.cc:299] Negotiation successful
0808 14:48:57.656153 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 14:48:57.657902 27383 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40342:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:48:57.659502 27383 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:48:57.666265 28090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:57.662291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53824 (local address 127.30.214.131:36881)
0808 14:48:57.662558 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0808 14:48:57.662561 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:48:57.662572 (+ 11us) server_negotiation.cc:407] Connection header received
0808 14:48:57.662611 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:48:57.662613 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:48:57.662628 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:48:57.662699 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:48:57.662950 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:57.664148 (+ 1198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:57.665274 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:57.665855 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:57.665929 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:57.666038 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0808 14:48:57.666126 (+ 88us) server_negotiation.cc:299] Negotiation successful
0808 14:48:57.666168 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":232,"thread_start_us":74,"threads_started":1}
I20260808 14:48:57.666253 28086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:57.662049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.131:36881 (local address 127.0.0.1:53824)
0808 14:48:57.662230 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:57.662274 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 14:48:57.662346 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:48:57.662779 (+ 433us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:48:57.662782 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:48:57.662784 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:48:57.662864 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:57.662866 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:57.664241 (+ 1375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:57.664242 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:57.665187 (+ 945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:57.665191 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:57.665936 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:57.665937 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:57.666020 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:57.666036 (+ 16us) client_negotiation.cc:769] Sending connection context
0808 14:48:57.666111 (+ 75us) client_negotiation.cc:240] Negotiation successful
0808 14:48:57.666168 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"mutex_wait_us":34,"thread_start_us":60,"threads_started":1}
I20260808 14:48:57.666420 28089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:57.662261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38086 (local address 127.30.214.129:40655)
0808 14:48:57.662478 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0808 14:48:57.662482 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:48:57.662610 (+ 128us) server_negotiation.cc:407] Connection header received
0808 14:48:57.662684 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:48:57.662687 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:48:57.662701 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:48:57.662764 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:48:57.662971 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:57.663741 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:57.665119 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:57.665879 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:57.665952 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:57.666040 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 14:48:57.666295 (+ 255us) server_negotiation.cc:299] Negotiation successful
0808 14:48:57.666339 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":106,"threads_started":1}
I20260808 14:48:57.666514 28087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:57.662052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.130:40971 (local address 127.0.0.1:51238)
0808 14:48:57.662452 (+ 400us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:57.662460 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 14:48:57.662497 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:48:57.662819 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:48:57.662820 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:48:57.662822 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:48:57.662893 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:57.662895 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:57.664233 (+ 1338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:57.664234 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:57.665287 (+ 1053us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:57.665289 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:57.666286 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:57.666287 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:57.666342 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:57.666345 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:48:57.666391 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 14:48:57.666426 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":383,"mutex_wait_us":29,"thread_start_us":105,"threads_started":1}
I20260808 14:48:57.666764 28088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:57.662244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51238 (local address 127.30.214.130:40971)
0808 14:48:57.662636 (+ 392us) server_negotiation.cc:206] Beginning negotiation
0808 14:48:57.662641 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:48:57.662651 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:48:57.662688 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:48:57.662690 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:48:57.662705 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:48:57.662822 (+ 117us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:48:57.662970 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:57.664148 (+ 1178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:57.665368 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:57.666111 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:57.666174 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:57.666252 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 14:48:57.666654 (+ 402us) server_negotiation.cc:299] Negotiation successful
0808 14:48:57.666698 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":356,"thread_start_us":97,"threads_started":1}
I20260808 14:48:57.666525 28084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:57.662052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.129:40655 (local address 127.0.0.1:38086)
0808 14:48:57.662465 (+ 413us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:57.662476 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:48:57.662556 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:48:57.662830 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:48:57.662831 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:48:57.662834 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:48:57.662896 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:57.662897 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:57.663807 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:57.663808 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:57.665024 (+ 1216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:57.665027 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:57.666079 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:57.666080 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:57.666139 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:57.666143 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:48:57.666188 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 14:48:57.666231 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":397,"mutex_wait_us":28,"thread_start_us":95,"threads_started":1}
I20260808 14:48:57.667480 27966 tablet_service.cc:1467] Processing CreateTablet for tablet f35f3732990d4eba844b0c73b3afb6b2 (DEFAULT_TABLE table=test-table [id=af1a44eba80d4eff94e617b1f76cb412]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:48:57.667584 27763 tablet_service.cc:1467] Processing CreateTablet for tablet f35f3732990d4eba844b0c73b3afb6b2 (DEFAULT_TABLE table=test-table [id=af1a44eba80d4eff94e617b1f76cb412]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:48:57.667718 27568 tablet_service.cc:1467] Processing CreateTablet for tablet f35f3732990d4eba844b0c73b3afb6b2 (DEFAULT_TABLE table=test-table [id=af1a44eba80d4eff94e617b1f76cb412]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:48:57.667855 27966 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f35f3732990d4eba844b0c73b3afb6b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:48:57.667960 27763 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f35f3732990d4eba844b0c73b3afb6b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:48:57.668037 27568 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f35f3732990d4eba844b0c73b3afb6b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:48:57.670835 28091 tablet_bootstrap.cc:492] T f35f3732990d4eba844b0c73b3afb6b2 P 92d977c0b754499c9cc097089214abe3: Bootstrap starting.
I20260808 14:48:57.671379 28092 tablet_bootstrap.cc:492] T f35f3732990d4eba844b0c73b3afb6b2 P 5fc3aaeecfc84b64b38d094a996c21af: Bootstrap starting.
I20260808 14:48:57.671604 28091 tablet_bootstrap.cc:654] T f35f3732990d4eba844b0c73b3afb6b2 P 92d977c0b754499c9cc097089214abe3: Neither blocks nor log segments found. Creating new log.
I20260808 14:48:57.671936 28091 log.cc:824] T f35f3732990d4eba844b0c73b3afb6b2 P 92d977c0b754499c9cc097089214abe3: Log is configured to *not* fsync() on all Append() calls
I20260808 14:48:57.672045 28092 tablet_bootstrap.cc:654] T f35f3732990d4eba844b0c73b3afb6b2 P 5fc3aaeecfc84b64b38d094a996c21af: Neither blocks nor log segments found. Creating new log.
I20260808 14:48:57.672334 28092 log.cc:824] T f35f3732990d4eba844b0c73b3afb6b2 P 5fc3aaeecfc84b64b38d094a996c21af: Log is configured to *not* fsync() on all Append() calls
I20260808 14:48:57.672539 28093 tablet_bootstrap.cc:492] T f35f3732990d4eba844b0c73b3afb6b2 P cd319a23b5cb42e6a0ef521e81e12e03: Bootstrap starting.
I20260808 14:48:57.672739 28091 tablet_bootstrap.cc:492] T f35f3732990d4eba844b0c73b3afb6b2 P 92d977c0b754499c9cc097089214abe3: No bootstrap required, opened a new log
I20260808 14:48:57.672816 28091 ts_tablet_manager.cc:1397] T f35f3732990d4eba844b0c73b3afb6b2 P 92d977c0b754499c9cc097089214abe3: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:48:57.673202 28093 tablet_bootstrap.cc:654] T f35f3732990d4eba844b0c73b3afb6b2 P cd319a23b5cb42e6a0ef521e81e12e03: Neither blocks nor log segments found. Creating new log.
I20260808 14:48:57.673550 28093 log.cc:824] T f35f3732990d4eba844b0c73b3afb6b2 P cd319a23b5cb42e6a0ef521e81e12e03: Log is configured to *not* fsync() on all Append() calls
I20260808 14:48:57.674367 28092 tablet_bootstrap.cc:492] T f35f3732990d4eba844b0c73b3afb6b2 P 5fc3aaeecfc84b64b38d094a996c21af: No bootstrap required, opened a new log
I20260808 14:48:57.674435 28092 ts_tablet_manager.cc:1397] T f35f3732990d4eba844b0c73b3afb6b2 P 5fc3aaeecfc84b64b38d094a996c21af: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260808 14:48:57.674615 28093 tablet_bootstrap.cc:492] T f35f3732990d4eba844b0c73b3afb6b2 P cd319a23b5cb42e6a0ef521e81e12e03: No bootstrap required, opened a new log
I20260808 14:48:57.674690 28093 ts_tablet_manager.cc:1397] T f35f3732990d4eba844b0c73b3afb6b2 P cd319a23b5cb42e6a0ef521e81e12e03: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260808 14:48:57.675676 28091 raft_consensus.cc:348] T f35f3732990d4eba844b0c73b3afb6b2 P 92d977c0b754499c9cc097089214abe3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fc3aaeecfc84b64b38d094a996c21af" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 40971 } } peers { permanent_uuid: "cd319a23b5cb42e6a0ef521e81e12e03" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 40655 } } peers { permanent_uuid: "92d977c0b754499c9cc097089214abe3" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 36881 } }
I20260808 14:48:57.675870 28091 raft_consensus.cc:374] T f35f3732990d4eba844b0c73b3afb6b2 P 92d977c0b754499c9cc097089214abe3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:48:57.675907 28091 raft_consensus.cc:729] T f35f3732990d4eba844b0c73b3afb6b2 P 92d977c0b754499c9cc097089214abe3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d977c0b754499c9cc097089214abe3, State: Initialized, Role: FOLLOWER
I20260808 14:48:57.676071 28091 consensus_queue.cc:260] T f35f3732990d4eba844b0c73b3afb6b2 P 92d977c0b754499c9cc097089214abe3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fc3aaeecfc84b64b38d094a996c21af" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 40971 } } peers { permanent_uuid: "cd319a23b5cb42e6a0ef521e81e12e03" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 40655 } } peers { permanent_uuid: "92d977c0b754499c9cc097089214abe3" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 36881 } }
I20260808 14:48:57.676388 28091 ts_tablet_manager.cc:1428] T f35f3732990d4eba844b0c73b3afb6b2 P 92d977c0b754499c9cc097089214abe3: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260808 14:48:57.676441 28076 heartbeater.cc:503] Master 127.30.214.190:37109 was elected leader, sending a full tablet report...
I20260808 14:48:57.676517 28092 raft_consensus.cc:348] T f35f3732990d4eba844b0c73b3afb6b2 P 5fc3aaeecfc84b64b38d094a996c21af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fc3aaeecfc84b64b38d094a996c21af" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 40971 } } peers { permanent_uuid: "cd319a23b5cb42e6a0ef521e81e12e03" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 40655 } } peers { permanent_uuid: "92d977c0b754499c9cc097089214abe3" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 36881 } }
I20260808 14:48:57.676663 28092 raft_consensus.cc:374] T f35f3732990d4eba844b0c73b3afb6b2 P 5fc3aaeecfc84b64b38d094a996c21af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:48:57.676723 28092 raft_consensus.cc:729] T f35f3732990d4eba844b0c73b3afb6b2 P 5fc3aaeecfc84b64b38d094a996c21af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5fc3aaeecfc84b64b38d094a996c21af, State: Initialized, Role: FOLLOWER
I20260808 14:48:57.676892 28092 consensus_queue.cc:260] T f35f3732990d4eba844b0c73b3afb6b2 P 5fc3aaeecfc84b64b38d094a996c21af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fc3aaeecfc84b64b38d094a996c21af" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 40971 } } peers { permanent_uuid: "cd319a23b5cb42e6a0ef521e81e12e03" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 40655 } } peers { permanent_uuid: "92d977c0b754499c9cc097089214abe3" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 36881 } }
I20260808 14:48:57.677161 28092 ts_tablet_manager.cc:1428] T f35f3732990d4eba844b0c73b3afb6b2 P 5fc3aaeecfc84b64b38d094a996c21af: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 14:48:57.677206 27874 heartbeater.cc:503] Master 127.30.214.190:37109 was elected leader, sending a full tablet report...
I20260808 14:48:57.677809 28093 raft_consensus.cc:348] T f35f3732990d4eba844b0c73b3afb6b2 P cd319a23b5cb42e6a0ef521e81e12e03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fc3aaeecfc84b64b38d094a996c21af" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 40971 } } peers { permanent_uuid: "cd319a23b5cb42e6a0ef521e81e12e03" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 40655 } } peers { permanent_uuid: "92d977c0b754499c9cc097089214abe3" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 36881 } }
I20260808 14:48:57.678020 28093 raft_consensus.cc:374] T f35f3732990d4eba844b0c73b3afb6b2 P cd319a23b5cb42e6a0ef521e81e12e03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:48:57.678074 28093 raft_consensus.cc:729] T f35f3732990d4eba844b0c73b3afb6b2 P cd319a23b5cb42e6a0ef521e81e12e03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd319a23b5cb42e6a0ef521e81e12e03, State: Initialized, Role: FOLLOWER
I20260808 14:48:57.678218 28093 consensus_queue.cc:260] T f35f3732990d4eba844b0c73b3afb6b2 P cd319a23b5cb42e6a0ef521e81e12e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fc3aaeecfc84b64b38d094a996c21af" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 40971 } } peers { permanent_uuid: "cd319a23b5cb42e6a0ef521e81e12e03" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 40655 } } peers { permanent_uuid: "92d977c0b754499c9cc097089214abe3" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 36881 } }
I20260808 14:48:57.678463 28093 ts_tablet_manager.cc:1428] T f35f3732990d4eba844b0c73b3afb6b2 P cd319a23b5cb42e6a0ef521e81e12e03: Time spent starting tablet: real 0.004s user 0.002s sys 0.001s
I20260808 14:48:57.678521 27669 heartbeater.cc:503] Master 127.30.214.190:37109 was elected leader, sending a full tablet report...
W20260808 14:48:57.766299 27875 tablet.cc:2369] T f35f3732990d4eba844b0c73b3afb6b2 P 5fc3aaeecfc84b64b38d094a996c21af: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:48:57.888459 27671 tablet.cc:2369] T f35f3732990d4eba844b0c73b3afb6b2 P cd319a23b5cb42e6a0ef521e81e12e03: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:48:57.893579 28100 raft_consensus.cc:482] T f35f3732990d4eba844b0c73b3afb6b2 P 5fc3aaeecfc84b64b38d094a996c21af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:48:57.893700 28100 raft_consensus.cc:504] T f35f3732990d4eba844b0c73b3afb6b2 P 5fc3aaeecfc84b64b38d094a996c21af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fc3aaeecfc84b64b38d094a996c21af" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 40971 } } peers { permanent_uuid: "cd319a23b5cb42e6a0ef521e81e12e03" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 40655 } } peers { permanent_uuid: "92d977c0b754499c9cc097089214abe3" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 36881 } }
I20260808 14:48:57.894024 28100 leader_election.cc:288] T f35f3732990d4eba844b0c73b3afb6b2 P 5fc3aaeecfc84b64b38d094a996c21af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd319a23b5cb42e6a0ef521e81e12e03 (127.30.214.129:40655), 92d977c0b754499c9cc097089214abe3 (127.30.214.131:36881)
W20260808 14:48:57.895349 28077 tablet.cc:2369] T f35f3732990d4eba844b0c73b3afb6b2 P 92d977c0b754499c9cc097089214abe3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:48:57.897315 28104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:57.894210 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.131:36881 (local address 127.30.214.130:40907)
0808 14:48:57.894374 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:57.894394 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 14:48:57.894446 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:48:57.894593 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:48:57.894594 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:48:57.894595 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:48:57.894666 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:57.894668 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:57.895256 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:57.895257 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:57.896612 (+ 1355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:57.896614 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:57.897118 (+ 504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:57.897118 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:57.897174 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:57.897178 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:48:57.897217 (+ 39us) client_negotiation.cc:240] Negotiation successful
0808 14:48:57.897248 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"mutex_wait_us":51,"thread_start_us":100,"threads_started":1}
I20260808 14:48:57.897356 28090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:57.894287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.130:40907 (local address 127.30.214.131:36881)
0808 14:48:57.894329 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 14:48:57.894331 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:48:57.894450 (+ 119us) server_negotiation.cc:407] Connection header received
0808 14:48:57.894521 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:48:57.894522 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:48:57.894532 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:48:57.894584 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:48:57.894740 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:57.895185 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:57.896687 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:57.897049 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:57.897111 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:57.897118 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0808 14:48:57.897246 (+ 128us) server_negotiation.cc:299] Negotiation successful
0808 14:48:57.897288 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 14:48:57.897682 27996 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f35f3732990d4eba844b0c73b3afb6b2" candidate_uuid: "5fc3aaeecfc84b64b38d094a996c21af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d977c0b754499c9cc097089214abe3" is_pre_election: true
I20260808 14:48:57.897863 27996 raft_consensus.cc:2454] T f35f3732990d4eba844b0c73b3afb6b2 P 92d977c0b754499c9cc097089214abe3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5fc3aaeecfc84b64b38d094a996c21af in term 0.
I20260808 14:48:57.897960 27876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:57.894198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.129:40655 (local address 127.30.214.130:37837)
0808 14:48:57.894259 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:57.894270 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:48:57.894313 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:48:57.894454 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:48:57.894455 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:48:57.894457 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:48:57.894541 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:57.894544 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:57.895319 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:57.895320 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:57.896603 (+ 1283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:57.896606 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:57.897712 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:57.897713 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:57.897783 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:57.897789 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 14:48:57.897845 (+ 56us) client_negotiation.cc:240] Negotiation successful
0808 14:48:57.897897 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40,"mutex_wait_us":33}
I20260808 14:48:57.898017 28089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:57.894254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.130:37837 (local address 127.30.214.129:40655)
0808 14:48:57.894317 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 14:48:57.894319 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:48:57.894333 (+ 14us) server_negotiation.cc:407] Connection header received
0808 14:48:57.894367 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:48:57.894368 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:48:57.894379 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:48:57.894448 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:48:57.894609 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:57.895227 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:57.897155 (+ 1928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:57.897649 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:57.897706 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:57.897712 (+ 6us) server_negotiation.cc:1035] Waiting for connection context
0808 14:48:57.897908 (+ 196us) server_negotiation.cc:299] Negotiation successful
0808 14:48:57.897953 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 14:48:57.898154 27700 leader_election.cc:302] T f35f3732990d4eba844b0c73b3afb6b2 P 5fc3aaeecfc84b64b38d094a996c21af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5fc3aaeecfc84b64b38d094a996c21af, 92d977c0b754499c9cc097089214abe3; no voters:
I20260808 14:48:57.898272 28100 raft_consensus.cc:2781] T f35f3732990d4eba844b0c73b3afb6b2 P 5fc3aaeecfc84b64b38d094a996c21af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:48:57.898347 28100 raft_consensus.cc:482] T f35f3732990d4eba844b0c73b3afb6b2 P 5fc3aaeecfc84b64b38d094a996c21af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:48:57.898372 28100 raft_consensus.cc:3037] T f35f3732990d4eba844b0c73b3afb6b2 P 5fc3aaeecfc84b64b38d094a996c21af [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:48:57.898330 27600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f35f3732990d4eba844b0c73b3afb6b2" candidate_uuid: "5fc3aaeecfc84b64b38d094a996c21af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd319a23b5cb42e6a0ef521e81e12e03" is_pre_election: true
I20260808 14:48:57.898473 27600 raft_consensus.cc:2454] T f35f3732990d4eba844b0c73b3afb6b2 P cd319a23b5cb42e6a0ef521e81e12e03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5fc3aaeecfc84b64b38d094a996c21af in term 0.
I20260808 14:48:57.899137 28100 raft_consensus.cc:504] T f35f3732990d4eba844b0c73b3afb6b2 P 5fc3aaeecfc84b64b38d094a996c21af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fc3aaeecfc84b64b38d094a996c21af" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 40971 } } peers { permanent_uuid: "cd319a23b5cb42e6a0ef521e81e12e03" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 40655 } } peers { permanent_uuid: "92d977c0b754499c9cc097089214abe3" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 36881 } }
I20260808 14:48:57.899271 28100 leader_election.cc:288] T f35f3732990d4eba844b0c73b3afb6b2 P 5fc3aaeecfc84b64b38d094a996c21af [CANDIDATE]: Term 1 election: Requested vote from peers cd319a23b5cb42e6a0ef521e81e12e03 (127.30.214.129:40655), 92d977c0b754499c9cc097089214abe3 (127.30.214.131:36881)
I20260808 14:48:57.899425 27600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f35f3732990d4eba844b0c73b3afb6b2" candidate_uuid: "5fc3aaeecfc84b64b38d094a996c21af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd319a23b5cb42e6a0ef521e81e12e03"
I20260808 14:48:57.899490 27600 raft_consensus.cc:3037] T f35f3732990d4eba844b0c73b3afb6b2 P cd319a23b5cb42e6a0ef521e81e12e03 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:48:57.900238 27600 raft_consensus.cc:2454] T f35f3732990d4eba844b0c73b3afb6b2 P cd319a23b5cb42e6a0ef521e81e12e03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5fc3aaeecfc84b64b38d094a996c21af in term 1.
I20260808 14:48:57.900352 27996 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f35f3732990d4eba844b0c73b3afb6b2" candidate_uuid: "5fc3aaeecfc84b64b38d094a996c21af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d977c0b754499c9cc097089214abe3"
I20260808 14:48:57.900434 27701 leader_election.cc:302] T f35f3732990d4eba844b0c73b3afb6b2 P 5fc3aaeecfc84b64b38d094a996c21af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5fc3aaeecfc84b64b38d094a996c21af, cd319a23b5cb42e6a0ef521e81e12e03; no voters:
I20260808 14:48:57.900451 27996 raft_consensus.cc:3037] T f35f3732990d4eba844b0c73b3afb6b2 P 92d977c0b754499c9cc097089214abe3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:48:57.900523 28100 raft_consensus.cc:2781] T f35f3732990d4eba844b0c73b3afb6b2 P 5fc3aaeecfc84b64b38d094a996c21af [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:48:57.900678 28100 raft_consensus.cc:686] T f35f3732990d4eba844b0c73b3afb6b2 P 5fc3aaeecfc84b64b38d094a996c21af [term 1 LEADER]: Becoming Leader. State: Replica: 5fc3aaeecfc84b64b38d094a996c21af, State: Running, Role: LEADER
I20260808 14:48:57.900894 28100 consensus_queue.cc:237] T f35f3732990d4eba844b0c73b3afb6b2 P 5fc3aaeecfc84b64b38d094a996c21af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fc3aaeecfc84b64b38d094a996c21af" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 40971 } } peers { permanent_uuid: "cd319a23b5cb42e6a0ef521e81e12e03" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 40655 } } peers { permanent_uuid: "92d977c0b754499c9cc097089214abe3" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 36881 } }
I20260808 14:48:57.901376 27996 raft_consensus.cc:2454] T f35f3732990d4eba844b0c73b3afb6b2 P 92d977c0b754499c9cc097089214abe3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5fc3aaeecfc84b64b38d094a996c21af in term 1.
I20260808 14:48:57.901829 27380 catalog_manager.cc:5495] T f35f3732990d4eba844b0c73b3afb6b2 P 5fc3aaeecfc84b64b38d094a996c21af reported cstate change: term changed from 0 to 1, leader changed from <none> to 5fc3aaeecfc84b64b38d094a996c21af (127.30.214.130). New cstate: current_term: 1 leader_uuid: "5fc3aaeecfc84b64b38d094a996c21af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fc3aaeecfc84b64b38d094a996c21af" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 40971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd319a23b5cb42e6a0ef521e81e12e03" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 40655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92d977c0b754499c9cc097089214abe3" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 36881 } health_report { overall_health: UNKNOWN } } }
I20260808 14:48:57.949730 28088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:57.947157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51250 (local address 127.30.214.130:40971)
0808 14:48:57.947224 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0808 14:48:57.947226 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:48:57.947235 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:48:57.947275 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:48:57.947276 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:48:57.947298 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:48:57.947363 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:48:57.947474 (+ 111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:57.947943 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:57.948781 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:57.948979 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:57.949042 (+ 63us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:57.949165 (+ 123us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:48:57.949255 (+ 90us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:48:57.949326 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 14:48:57.949604 (+ 278us) server_negotiation.cc:299] Negotiation successful
0808 14:48:57.949613 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 14:48:57.951705 27996 raft_consensus.cc:1261] T f35f3732990d4eba844b0c73b3afb6b2 P 92d977c0b754499c9cc097089214abe3 [term 1 FOLLOWER]: Refusing update from remote peer 5fc3aaeecfc84b64b38d094a996c21af: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:48:57.951705 27600 raft_consensus.cc:1261] T f35f3732990d4eba844b0c73b3afb6b2 P cd319a23b5cb42e6a0ef521e81e12e03 [term 1 FOLLOWER]: Refusing update from remote peer 5fc3aaeecfc84b64b38d094a996c21af: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:48:57.952078 28100 consensus_queue.cc:1035] T f35f3732990d4eba844b0c73b3afb6b2 P 5fc3aaeecfc84b64b38d094a996c21af [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd319a23b5cb42e6a0ef521e81e12e03" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 40655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:48:57.952229 28106 consensus_queue.cc:1035] T f35f3732990d4eba844b0c73b3afb6b2 P 5fc3aaeecfc84b64b38d094a996c21af [LEADER]: Connected to new peer: Peer: permanent_uuid: "92d977c0b754499c9cc097089214abe3" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 36881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:48:57.954851 28113 mvcc.cc:205] Tried to move back new op lower bound from 7316277403447242752 to 7316277403242815488. Current Snapshot: MvccSnapshot[applied={T|T < 7316277403447242752}]
I20260808 14:48:57.955152 28116 mvcc.cc:205] Tried to move back new op lower bound from 7316277403447242752 to 7316277403242815488. Current Snapshot: MvccSnapshot[applied={T|T < 7316277403447242752}]
I20260808 14:48:57.958215 27383 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40342:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:48:57.958333 27383 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40342:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:48:57.959085 27383 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 33ddf2af4aae439b9d57bf60254cc016: Sending DeleteTablet for 3 replicas of tablet f35f3732990d4eba844b0c73b3afb6b2
I20260808 14:48:57.959442 27568 tablet_service.cc:1514] Processing DeleteTablet for tablet f35f3732990d4eba844b0c73b3afb6b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:48:57 UTC) from {username='slave'} at 127.0.0.1:38086
I20260808 14:48:57.959479 27966 tablet_service.cc:1514] Processing DeleteTablet for tablet f35f3732990d4eba844b0c73b3afb6b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:48:57 UTC) from {username='slave'} at 127.0.0.1:53824
I20260808 14:48:57.959731 27763 tablet_service.cc:1514] Processing DeleteTablet for tablet f35f3732990d4eba844b0c73b3afb6b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:48:57 UTC) from {username='slave'} at 127.0.0.1:51238
I20260808 14:48:57.959780 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 27471
I20260808 14:48:57.959838 28125 tablet_replica.cc:330] T f35f3732990d4eba844b0c73b3afb6b2 P cd319a23b5cb42e6a0ef521e81e12e03: stopping tablet replica
I20260808 14:48:57.959939 28125 raft_consensus.cc:2229] T f35f3732990d4eba844b0c73b3afb6b2 P cd319a23b5cb42e6a0ef521e81e12e03 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:48:57.960078 28125 raft_consensus.cc:2258] T f35f3732990d4eba844b0c73b3afb6b2 P cd319a23b5cb42e6a0ef521e81e12e03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:48:57.968977 28127 tablet_replica.cc:330] T f35f3732990d4eba844b0c73b3afb6b2 P 5fc3aaeecfc84b64b38d094a996c21af: stopping tablet replica
I20260808 14:48:57.969218 28127 raft_consensus.cc:2229] T f35f3732990d4eba844b0c73b3afb6b2 P 5fc3aaeecfc84b64b38d094a996c21af [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:48:57.969393 28127 raft_consensus.cc:2258] T f35f3732990d4eba844b0c73b3afb6b2 P 5fc3aaeecfc84b64b38d094a996c21af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:48:57.969636 28126 tablet_replica.cc:330] T f35f3732990d4eba844b0c73b3afb6b2 P 92d977c0b754499c9cc097089214abe3: stopping tablet replica
I20260808 14:48:57.970136 28127 ts_tablet_manager.cc:1905] T f35f3732990d4eba844b0c73b3afb6b2 P 5fc3aaeecfc84b64b38d094a996c21af: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:48:57.970300 28126 raft_consensus.cc:2229] T f35f3732990d4eba844b0c73b3afb6b2 P 92d977c0b754499c9cc097089214abe3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:48:57.970439 28126 raft_consensus.cc:2258] T f35f3732990d4eba844b0c73b3afb6b2 P 92d977c0b754499c9cc097089214abe3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:48:57.972389 28126 ts_tablet_manager.cc:1905] T f35f3732990d4eba844b0c73b3afb6b2 P 92d977c0b754499c9cc097089214abe3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:48:57.973999 28126 ts_tablet_manager.cc:1918] T f35f3732990d4eba844b0c73b3afb6b2 P 92d977c0b754499c9cc097089214abe3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:48:57.974097 28126 log.cc:1196] T f35f3732990d4eba844b0c73b3afb6b2 P 92d977c0b754499c9cc097089214abe3: Deleting WAL directory at /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200295877777-31578-0/minicluster-data/ts-2/wal/wals/f35f3732990d4eba844b0c73b3afb6b2
I20260808 14:48:57.974337 28126 ts_tablet_manager.cc:1939] T f35f3732990d4eba844b0c73b3afb6b2 P 92d977c0b754499c9cc097089214abe3: Deleting consensus metadata
I20260808 14:48:57.974797 28127 ts_tablet_manager.cc:1918] T f35f3732990d4eba844b0c73b3afb6b2 P 5fc3aaeecfc84b64b38d094a996c21af: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:48:57.974928 28127 log.cc:1196] T f35f3732990d4eba844b0c73b3afb6b2 P 5fc3aaeecfc84b64b38d094a996c21af: Deleting WAL directory at /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786200295877777-31578-0/minicluster-data/ts-1/wal/wals/f35f3732990d4eba844b0c73b3afb6b2
I20260808 14:48:57.974890 27360 catalog_manager.cc:4841] TS 92d977c0b754499c9cc097089214abe3 (127.30.214.131:36881): tablet f35f3732990d4eba844b0c73b3afb6b2 (table test-table [id=af1a44eba80d4eff94e617b1f76cb412]) successfully deleted
I20260808 14:48:57.975234 28127 ts_tablet_manager.cc:1939] T f35f3732990d4eba844b0c73b3afb6b2 P 5fc3aaeecfc84b64b38d094a996c21af: Deleting consensus metadata
I20260808 14:48:57.975701 27358 catalog_manager.cc:4841] TS 5fc3aaeecfc84b64b38d094a996c21af (127.30.214.130:40971): tablet f35f3732990d4eba844b0c73b3afb6b2 (table test-table [id=af1a44eba80d4eff94e617b1f76cb412]) successfully deleted
W20260808 14:48:57.977185 27362 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.30.214.129:40655 (error 108)
I20260808 14:48:57.977738 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 27673
I20260808 14:48:57.977754 28084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:57.977603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.129:40655 (local address 127.0.0.1:38088)
0808 14:48:57.977662 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:57.977719 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.129:40655: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260808 14:48:57.977872 27362 catalog_manager.cc:4584] TS cd319a23b5cb42e6a0ef521e81e12e03 (127.30.214.129:40655): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f35f3732990d4eba844b0c73b3afb6b2: Network error: Client connection negotiation failed: client connection to 127.30.214.129:40655: connect: Connection refused (error 111)
I20260808 14:48:57.999322 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 27877
I20260808 14:48:58.020205 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 27335
2026-08-08T14:48:58Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (965 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:48:58 dist-test-slave-42z9 krb5kdc[28132](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:48:58 dist-test-slave-42z9 krb5kdc[28132](info): set up 2 sockets
Aug 08 14:48:58 dist-test-slave-42z9 krb5kdc[28132](info): commencing operation
krb5kdc: starting...
W20260808 14:48:59.164073 31578 mini_kdc.cc:121] Time spent starting KDC: real 1.116s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Aug 08 14:48:59 dist-test-slave-42z9 krb5kdc[28132](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200539, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:48:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:48:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.214.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab.
Entry for principal kudu/127.30.214.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab.
I20260808 14:48:59.292484 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:40987
--webserver_interface=127.30.214.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab
--principal=kudu/127.30.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:33201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.214.190:40987
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:48:59.377130 28151 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:48:59.377352 28151 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:48:59.377375 28151 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:48:59.378647 28151 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:48:59.378693 28151 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:48:59.378706 28151 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:48:59.378717 28151 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:48:59.378738 28151 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:48:59.380321 28151 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:33201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.214.190:40987
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab
--principal=kudu/127.30.214.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:40987
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28151
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:48:59.380569 28151 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:48:59.380800 28151 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:48:59.385764 28160 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:48:59.385798 28166 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:48:59.385798 28162 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:48:59.386308 28151 server_base.cc:1034] running on GCE node
I20260808 14:48:59.386691 28151 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:48:59.387066 28151 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:48:59.388267 28151 hybrid_clock.cc:648] HybridClock initialized: now 1786200539388230 us; error 46 us; skew 500 ppm
Aug 08 14:48:59 dist-test-slave-42z9 krb5kdc[28132](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200539, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:48:59.390939 28151 init.cc:377] Logged in from keytab as kudu/127.30.214.190@KRBTEST.COM (short username kudu)
I20260808 14:48:59.391431 28151 webserver.cc:460] Webserver started at http://127.30.214.190:45357/ using document root <none> and password file <none>
I20260808 14:48:59.391676 28151 fs_manager.cc:359] Metadata directory not provided
I20260808 14:48:59.391729 28151 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:48:59.391865 28151 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:48:59.392992 28151 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/minicluster-data/master-0/data/instance:
uuid: "3a9c92688dba4cb9ab18aa24daaec1df"
format_stamp: "Formatted at 2026-08-08 14:48:59 on dist-test-slave-42z9"
server_key: "11c5f84d88cd24b64dd604364eb680a0"
server_key_iv: "86086cd5383a0a9a422b552c604ef7d6"
server_key_version: "encryptionkey@0"
I20260808 14:48:59.393353 28151 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/minicluster-data/master-0/wal/instance:
uuid: "3a9c92688dba4cb9ab18aa24daaec1df"
format_stamp: "Formatted at 2026-08-08 14:48:59 on dist-test-slave-42z9"
server_key: "11c5f84d88cd24b64dd604364eb680a0"
server_key_iv: "86086cd5383a0a9a422b552c604ef7d6"
server_key_version: "encryptionkey@0"
I20260808 14:48:59.394747 28151 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:48:59.395484 28181 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:48:59.395653 28151 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 14:48:59.395744 28151 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/minicluster-data/master-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/minicluster-data/master-0/wal
uuid: "3a9c92688dba4cb9ab18aa24daaec1df"
format_stamp: "Formatted at 2026-08-08 14:48:59 on dist-test-slave-42z9"
server_key: "11c5f84d88cd24b64dd604364eb680a0"
server_key_iv: "86086cd5383a0a9a422b552c604ef7d6"
server_key_version: "encryptionkey@0"
I20260808 14:48:59.395810 28151 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:48:59.408756 28151 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:48:59.410697 28151 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:48:59.410849 28151 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:48:59.415017 28151 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.190:40987
I20260808 14:48:59.415081 28261 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.190:40987 every 8 connection(s)
I20260808 14:48:59.415442 28151 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
I20260808 14:48:59.416390 28262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:48:59.418416 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 28151
I20260808 14:48:59.418538 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/minicluster-data/master-0/wal/instance
I20260808 14:48:59.418747 31578 external_mini_cluster.cc:1428] Setting key 3befd267a2e70e9c67fc2e1c649caa8a
I20260808 14:48:59.419032 28262 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a9c92688dba4cb9ab18aa24daaec1df: Bootstrap starting.
I20260808 14:48:59.419754 28262 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3a9c92688dba4cb9ab18aa24daaec1df: Neither blocks nor log segments found. Creating new log.
I20260808 14:48:59.420033 28262 log.cc:824] T 00000000000000000000000000000000 P 3a9c92688dba4cb9ab18aa24daaec1df: Log is configured to *not* fsync() on all Append() calls
I20260808 14:48:59.420837 28262 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a9c92688dba4cb9ab18aa24daaec1df: No bootstrap required, opened a new log
I20260808 14:48:59.423075 28262 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3a9c92688dba4cb9ab18aa24daaec1df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a9c92688dba4cb9ab18aa24daaec1df" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 40987 } }
I20260808 14:48:59.423223 28262 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3a9c92688dba4cb9ab18aa24daaec1df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:48:59.423244 28262 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3a9c92688dba4cb9ab18aa24daaec1df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a9c92688dba4cb9ab18aa24daaec1df, State: Initialized, Role: FOLLOWER
I20260808 14:48:59.423374 28262 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3a9c92688dba4cb9ab18aa24daaec1df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a9c92688dba4cb9ab18aa24daaec1df" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 40987 } }
I20260808 14:48:59.423452 28262 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3a9c92688dba4cb9ab18aa24daaec1df [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:48:59.423476 28262 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3a9c92688dba4cb9ab18aa24daaec1df [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:48:59.423523 28262 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3a9c92688dba4cb9ab18aa24daaec1df [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:48:59.424189 28262 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3a9c92688dba4cb9ab18aa24daaec1df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a9c92688dba4cb9ab18aa24daaec1df" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 40987 } }
I20260808 14:48:59.424295 28262 leader_election.cc:302] T 00000000000000000000000000000000 P 3a9c92688dba4cb9ab18aa24daaec1df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3a9c92688dba4cb9ab18aa24daaec1df; no voters:
I20260808 14:48:59.424467 28262 leader_election.cc:288] T 00000000000000000000000000000000 P 3a9c92688dba4cb9ab18aa24daaec1df [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:48:59.424499 28269 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3a9c92688dba4cb9ab18aa24daaec1df [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:48:59.424631 28269 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3a9c92688dba4cb9ab18aa24daaec1df [term 1 LEADER]: Becoming Leader. State: Replica: 3a9c92688dba4cb9ab18aa24daaec1df, State: Running, Role: LEADER
I20260808 14:48:59.424757 28262 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3a9c92688dba4cb9ab18aa24daaec1df [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:48:59.424777 28269 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3a9c92688dba4cb9ab18aa24daaec1df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a9c92688dba4cb9ab18aa24daaec1df" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 40987 } }
I20260808 14:48:59.425391 28271 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a9c92688dba4cb9ab18aa24daaec1df [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3a9c92688dba4cb9ab18aa24daaec1df. Latest consensus state: current_term: 1 leader_uuid: "3a9c92688dba4cb9ab18aa24daaec1df" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a9c92688dba4cb9ab18aa24daaec1df" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 40987 } } }
I20260808 14:48:59.425566 28271 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a9c92688dba4cb9ab18aa24daaec1df [sys.catalog]: This master's current role is: LEADER
I20260808 14:48:59.425782 28270 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a9c92688dba4cb9ab18aa24daaec1df [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3a9c92688dba4cb9ab18aa24daaec1df" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a9c92688dba4cb9ab18aa24daaec1df" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 40987 } } }
Aug 08 14:48:59 dist-test-slave-42z9 krb5kdc[28132](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200539, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:48:59.425920 28270 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a9c92688dba4cb9ab18aa24daaec1df [sys.catalog]: This master's current role is: LEADER
I20260808 14:48:59.426090 28284 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:48:59.426689 28284 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:48:59.429884 28267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:59.419292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48552 (local address 127.30.214.190:40987)
0808 14:48:59.419510 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0808 14:48:59.419520 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:48:59.419548 (+ 28us) server_negotiation.cc:407] Connection header received
0808 14:48:59.420018 (+ 470us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:48:59.420026 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:48:59.420077 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:48:59.420215 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:48:59.420955 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:59.421900 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:59.423001 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:59.423493 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:59.423608 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:59.426419 (+ 2811us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:48:59.426423 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:48:59.426423 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:48:59.426433 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:48:59.428309 (+ 1876us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:48:59.428658 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:48:59.428661 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:48:59.428661 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:48:59.428770 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:48:59.428949 (+ 179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:48:59.428950 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:48:59.428950 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:48:59.429259 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:48:59.429419 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0808 14:48:59.429517 (+ 98us) server_negotiation.cc:299] Negotiation successful
0808 14:48:59.429663 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":110,"threads_started":1}
I20260808 14:48:59.430135 28284 catalog_manager.cc:1347] Generated new cluster ID: 6fa1ce0703284b8994bedd726114904d
I20260808 14:48:59.430214 28284 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:48:59.449842 28284 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:48:59.450662 28284 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:48:59.456483 28284 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3a9c92688dba4cb9ab18aa24daaec1df: Generated new TSK 0
I20260808 14:48:59.456700 28284 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.214.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab.
Entry for principal kudu/127.30.214.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab.
I20260808 14:48:59.489104 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.129:0
--local_ip_for_outbound_sockets=127.30.214.129
--webserver_interface=127.30.214.129
--webserver_port=0
--tserver_master_addrs=127.30.214.190:40987
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab
--principal=kudu/127.30.214.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:33201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:48:59.575124 28300 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:48:59.575347 28300 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:48:59.575372 28300 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:48:59.576538 28300 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:48:59.576574 28300 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:48:59.576601 28300 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.129
I20260808 14:48:59.578109 28300 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:33201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.129.keytab
--principal=kudu/127.30.214.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.214.129
--webserver_port=0
--tserver_master_addrs=127.30.214.190:40987
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28300
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.129
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:48:59.578315 28300 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:48:59.578508 28300 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:48:59.583650 28307 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:48:59.583781 28300 server_base.cc:1034] running on GCE node
W20260808 14:48:59.583634 28316 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:48:59.583634 28308 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:48:59.584153 28300 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:48:59.584430 28300 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:48:59.585584 28300 hybrid_clock.cc:648] HybridClock initialized: now 1786200539585565 us; error 35 us; skew 500 ppm
Aug 08 14:48:59 dist-test-slave-42z9 krb5kdc[28132](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200539, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:48:59.588141 28300 init.cc:377] Logged in from keytab as kudu/127.30.214.129@KRBTEST.COM (short username kudu)
I20260808 14:48:59.588634 28300 webserver.cc:460] Webserver started at http://127.30.214.129:34155/ using document root <none> and password file <none>
I20260808 14:48:59.588852 28300 fs_manager.cc:359] Metadata directory not provided
I20260808 14:48:59.588900 28300 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:48:59.589036 28300 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:48:59.590197 28300 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/minicluster-data/ts-0/data/instance:
uuid: "90daab27c0bd4cb99733da39f50613bc"
format_stamp: "Formatted at 2026-08-08 14:48:59 on dist-test-slave-42z9"
server_key: "0ae122037ad846d53155a5a7930670c4"
server_key_iv: "301b90ae7177087dbf9603b8cec9e8b7"
server_key_version: "encryptionkey@0"
I20260808 14:48:59.590541 28300 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/minicluster-data/ts-0/wal/instance:
uuid: "90daab27c0bd4cb99733da39f50613bc"
format_stamp: "Formatted at 2026-08-08 14:48:59 on dist-test-slave-42z9"
server_key: "0ae122037ad846d53155a5a7930670c4"
server_key_iv: "301b90ae7177087dbf9603b8cec9e8b7"
server_key_version: "encryptionkey@0"
I20260808 14:48:59.591842 28300 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 14:48:59.592532 28323 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:48:59.592696 28300 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:48:59.592782 28300 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/minicluster-data/ts-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/minicluster-data/ts-0/wal
uuid: "90daab27c0bd4cb99733da39f50613bc"
format_stamp: "Formatted at 2026-08-08 14:48:59 on dist-test-slave-42z9"
server_key: "0ae122037ad846d53155a5a7930670c4"
server_key_iv: "301b90ae7177087dbf9603b8cec9e8b7"
server_key_version: "encryptionkey@0"
I20260808 14:48:59.592851 28300 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:48:59.623538 28300 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:48:59.625862 28300 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:48:59.626009 28300 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:48:59.626257 28300 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:48:59.626581 28300 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:48:59.626626 28300 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:48:59.626658 28300 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:48:59.626682 28300 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:48:59.632319 28300 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.129:37005
I20260808 14:48:59.632382 28495 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.129:37005 every 8 connection(s)
I20260808 14:48:59.632694 28300 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
I20260808 14:48:59.635280 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 28300
I20260808 14:48:59.635402 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/minicluster-data/ts-0/wal/instance
I20260808 14:48:59.635612 31578 external_mini_cluster.cc:1428] Setting key 20cb082950f26cff1b7f8f8db92c5aee
Aug 08 14:48:59 dist-test-slave-42z9 krb5kdc[28132](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200539, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.129@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:48:59.643237 28267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:59.633435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.129:46315 (local address 127.30.214.190:40987)
0808 14:48:59.633541 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0808 14:48:59.633543 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:48:59.633703 (+ 160us) server_negotiation.cc:407] Connection header received
0808 14:48:59.634191 (+ 488us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:48:59.634192 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:48:59.634203 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:48:59.634250 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:48:59.635237 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:59.635930 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:59.637097 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:59.637390 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:59.637499 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:59.639839 (+ 2340us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:48:59.639841 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:48:59.639841 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:48:59.639850 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:48:59.641337 (+ 1487us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:48:59.641812 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:48:59.641813 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:48:59.641814 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:48:59.641882 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:48:59.642429 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:48:59.642431 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:48:59.642431 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:48:59.642606 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:48:59.642699 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0808 14:48:59.643031 (+ 332us) server_negotiation.cc:299] Negotiation successful
0808 14:48:59.643136 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 14:48:59.643335 28503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:59.633400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:40987 (local address 127.30.214.129:46315)
0808 14:48:59.633580 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:59.633622 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 14:48:59.634110 (+ 488us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:48:59.634313 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:48:59.634317 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:48:59.634917 (+ 600us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:48:59.635129 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:59.635134 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:59.636037 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:59.636038 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:59.636973 (+ 935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:59.636976 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:59.637510 (+ 534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:59.637511 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:59.637638 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:59.638166 (+ 528us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:48:59.638178 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:48:59.639739 (+ 1561us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:48:59.641431 (+ 1692us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:48:59.641474 (+ 43us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:48:59.641476 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:48:59.641726 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:48:59.642049 (+ 323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:48:59.642052 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:48:59.642052 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:48:59.642303 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:48:59.642726 (+ 423us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:48:59.642735 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:48:59.642885 (+ 150us) client_negotiation.cc:769] Sending connection context
0808 14:48:59.642982 (+ 97us) client_negotiation.cc:240] Negotiation successful
0808 14:48:59.643131 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":101,"threads_started":1}
I20260808 14:48:59.644071 28497 heartbeater.cc:347] Connected to a master server at 127.30.214.190:40987
I20260808 14:48:59.644178 28497 heartbeater.cc:464] Registering TS with master...
I20260808 14:48:59.644369 28497 heartbeater.cc:511] Master 127.30.214.190:40987 requested a full tablet report, sending...
I20260808 14:48:59.644994 28205 ts_manager.cc:194] Registered new tserver with Master: 90daab27c0bd4cb99733da39f50613bc (127.30.214.129:37005)
WARNING: no policy specified for kudu/127.30.214.130@KRBTEST.COM; defaulting to no policy
I20260808 14:48:59.645823 28205 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.214.129@KRBTEST.COM'} at 127.30.214.129:46315
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab.
Entry for principal kudu/127.30.214.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab.
I20260808 14:48:59.662729 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.130:0
--local_ip_for_outbound_sockets=127.30.214.130
--webserver_interface=127.30.214.130
--webserver_port=0
--tserver_master_addrs=127.30.214.190:40987
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab
--principal=kudu/127.30.214.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:33201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:48:59.746382 28507 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:48:59.746627 28507 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:48:59.746663 28507 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:48:59.747872 28507 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:48:59.747920 28507 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:48:59.747959 28507 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.130
I20260808 14:48:59.749536 28507 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:33201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.130.keytab
--principal=kudu/127.30.214.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.214.130
--webserver_port=0
--tserver_master_addrs=127.30.214.190:40987
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28507
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.130
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:48:59.749802 28507 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:48:59.750041 28507 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:48:59.755100 28513 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:48:59.755105 28519 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:48:59.755110 28516 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:48:59.755308 28507 server_base.cc:1034] running on GCE node
I20260808 14:48:59.755561 28507 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:48:59.755801 28507 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:48:59.756942 28507 hybrid_clock.cc:648] HybridClock initialized: now 1786200539756927 us; error 31 us; skew 500 ppm
Aug 08 14:48:59 dist-test-slave-42z9 krb5kdc[28132](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200539, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:48:59.759559 28507 init.cc:377] Logged in from keytab as kudu/127.30.214.130@KRBTEST.COM (short username kudu)
I20260808 14:48:59.760051 28507 webserver.cc:460] Webserver started at http://127.30.214.130:37267/ using document root <none> and password file <none>
I20260808 14:48:59.760269 28507 fs_manager.cc:359] Metadata directory not provided
I20260808 14:48:59.760321 28507 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:48:59.760457 28507 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:48:59.761600 28507 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/minicluster-data/ts-1/data/instance:
uuid: "707db08f143e417681d5057136b49d65"
format_stamp: "Formatted at 2026-08-08 14:48:59 on dist-test-slave-42z9"
server_key: "f7810a94e94f4e2026fa08d2e5b26664"
server_key_iv: "9c8031d62582170c35df14876f08b5f9"
server_key_version: "encryptionkey@0"
I20260808 14:48:59.761951 28507 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/minicluster-data/ts-1/wal/instance:
uuid: "707db08f143e417681d5057136b49d65"
format_stamp: "Formatted at 2026-08-08 14:48:59 on dist-test-slave-42z9"
server_key: "f7810a94e94f4e2026fa08d2e5b26664"
server_key_iv: "9c8031d62582170c35df14876f08b5f9"
server_key_version: "encryptionkey@0"
I20260808 14:48:59.763286 28507 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260808 14:48:59.763991 28528 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:48:59.764163 28507 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 14:48:59.764248 28507 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/minicluster-data/ts-1/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/minicluster-data/ts-1/wal
uuid: "707db08f143e417681d5057136b49d65"
format_stamp: "Formatted at 2026-08-08 14:48:59 on dist-test-slave-42z9"
server_key: "f7810a94e94f4e2026fa08d2e5b26664"
server_key_iv: "9c8031d62582170c35df14876f08b5f9"
server_key_version: "encryptionkey@0"
I20260808 14:48:59.764317 28507 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:48:59.781251 28507 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:48:59.783571 28507 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:48:59.783710 28507 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:48:59.783943 28507 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:48:59.784251 28507 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:48:59.784286 28507 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:48:59.784307 28507 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:48:59.784329 28507 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:48:59.790526 28507 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.130:35803
I20260808 14:48:59.790757 28704 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.130:35803 every 8 connection(s)
I20260808 14:48:59.790910 28507 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
Aug 08 14:48:59 dist-test-slave-42z9 krb5kdc[28132](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200539, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.130@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:48:59.798903 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 28507
I20260808 14:48:59.799023 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/minicluster-data/ts-1/wal/instance
I20260808 14:48:59.799244 31578 external_mini_cluster.cc:1428] Setting key ddab20bec365640a0cd022f8cf984c4e
I20260808 14:48:59.800544 28267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:59.791685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.130:37219 (local address 127.30.214.190:40987)
0808 14:48:59.791750 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 14:48:59.791752 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:48:59.791980 (+ 228us) server_negotiation.cc:407] Connection header received
0808 14:48:59.792949 (+ 969us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:48:59.792951 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:48:59.792964 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:48:59.793016 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:48:59.793709 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:59.794214 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:59.795208 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:59.795413 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:59.795471 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:59.797679 (+ 2208us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:48:59.797681 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:48:59.797681 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:48:59.797689 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:48:59.799014 (+ 1325us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:48:59.799592 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:48:59.799593 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:48:59.799594 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:48:59.799650 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:48:59.799909 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:48:59.799910 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:48:59.799910 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:48:59.800040 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:48:59.800112 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 14:48:59.800374 (+ 262us) server_negotiation.cc:299] Negotiation successful
0808 14:48:59.800464 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 14:48:59.800648 28712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:59.791652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:40987 (local address 127.30.214.130:37219)
0808 14:48:59.791824 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:59.791873 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 14:48:59.792820 (+ 947us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:48:59.793089 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:48:59.793093 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:48:59.793370 (+ 277us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:48:59.793621 (+ 251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:59.793626 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:59.794306 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:59.794307 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:59.795115 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:59.795118 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:59.795493 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:59.795494 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:59.795636 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:59.796173 (+ 537us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:48:59.796181 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:48:59.797582 (+ 1401us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:48:59.799114 (+ 1532us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:48:59.799124 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:48:59.799126 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:48:59.799455 (+ 329us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:48:59.799700 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:48:59.799700 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:48:59.799701 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:48:59.799845 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:48:59.800104 (+ 259us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:48:59.800109 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:48:59.800234 (+ 125us) client_negotiation.cc:769] Sending connection context
0808 14:48:59.800320 (+ 86us) client_negotiation.cc:240] Negotiation successful
0808 14:48:59.800460 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":91,"threads_started":1}
I20260808 14:48:59.801059 28705 heartbeater.cc:347] Connected to a master server at 127.30.214.190:40987
I20260808 14:48:59.801154 28705 heartbeater.cc:464] Registering TS with master...
I20260808 14:48:59.801335 28705 heartbeater.cc:511] Master 127.30.214.190:40987 requested a full tablet report, sending...
I20260808 14:48:59.801733 28205 ts_manager.cc:194] Registered new tserver with Master: 707db08f143e417681d5057136b49d65 (127.30.214.130:35803)
I20260808 14:48:59.802217 28205 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.214.130@KRBTEST.COM'} at 127.30.214.130:37219
WARNING: no policy specified for kudu/127.30.214.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab.
Entry for principal kudu/127.30.214.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab.
I20260808 14:48:59.825613 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.131:0
--local_ip_for_outbound_sockets=127.30.214.131
--webserver_interface=127.30.214.131
--webserver_port=0
--tserver_master_addrs=127.30.214.190:40987
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab
--principal=kudu/127.30.214.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:33201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:48:59.909426 28716 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:48:59.909708 28716 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:48:59.909734 28716 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:48:59.910884 28716 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:48:59.910923 28716 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:48:59.910948 28716 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.131
I20260808 14:48:59.912513 28716 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:33201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.131.keytab
--principal=kudu/127.30.214.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.214.131
--webserver_port=0
--tserver_master_addrs=127.30.214.190:40987
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28716
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.131
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:48:59.912729 28716 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:48:59.912911 28716 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:48:59.918177 28725 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:48:59.918239 28716 server_base.cc:1034] running on GCE node
W20260808 14:48:59.918195 28733 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:48:59.918183 28726 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:48:59.918654 28716 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:48:59.918918 28716 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:48:59.920076 28716 hybrid_clock.cc:648] HybridClock initialized: now 1786200539920066 us; error 28 us; skew 500 ppm
Aug 08 14:48:59 dist-test-slave-42z9 krb5kdc[28132](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200539, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:48:59.922550 28716 init.cc:377] Logged in from keytab as kudu/127.30.214.131@KRBTEST.COM (short username kudu)
I20260808 14:48:59.922968 28716 webserver.cc:460] Webserver started at http://127.30.214.131:34527/ using document root <none> and password file <none>
I20260808 14:48:59.923147 28716 fs_manager.cc:359] Metadata directory not provided
I20260808 14:48:59.923185 28716 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:48:59.923278 28716 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:48:59.924309 28716 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/minicluster-data/ts-2/data/instance:
uuid: "2bf60f1879f6419fac142e526a024357"
format_stamp: "Formatted at 2026-08-08 14:48:59 on dist-test-slave-42z9"
server_key: "b0f02d45293f0c4cd257f32d62a65db1"
server_key_iv: "4e170468f865bcae06bc0ce5f88f4789"
server_key_version: "encryptionkey@0"
I20260808 14:48:59.924625 28716 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/minicluster-data/ts-2/wal/instance:
uuid: "2bf60f1879f6419fac142e526a024357"
format_stamp: "Formatted at 2026-08-08 14:48:59 on dist-test-slave-42z9"
server_key: "b0f02d45293f0c4cd257f32d62a65db1"
server_key_iv: "4e170468f865bcae06bc0ce5f88f4789"
server_key_version: "encryptionkey@0"
I20260808 14:48:59.926115 28716 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:48:59.926882 28745 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:48:59.927050 28716 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:48:59.927136 28716 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/minicluster-data/ts-2/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/minicluster-data/ts-2/wal
uuid: "2bf60f1879f6419fac142e526a024357"
format_stamp: "Formatted at 2026-08-08 14:48:59 on dist-test-slave-42z9"
server_key: "b0f02d45293f0c4cd257f32d62a65db1"
server_key_iv: "4e170468f865bcae06bc0ce5f88f4789"
server_key_version: "encryptionkey@0"
I20260808 14:48:59.927197 28716 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:48:59.942886 28716 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:48:59.944943 28716 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:48:59.945068 28716 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:48:59.945286 28716 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:48:59.945657 28716 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:48:59.945698 28716 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:48:59.945721 28716 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:48:59.945739 28716 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:48:59.951558 28716 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.131:38353
I20260808 14:48:59.951640 28919 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.131:38353 every 8 connection(s)
I20260808 14:48:59.951923 28716 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
Aug 08 14:48:59 dist-test-slave-42z9 krb5kdc[28132](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200539, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.131@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:48:59.961284 28267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:59.952671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:57839 (local address 127.30.214.190:40987)
0808 14:48:59.952717 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 14:48:59.952719 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:48:59.952942 (+ 223us) server_negotiation.cc:407] Connection header received
0808 14:48:59.953933 (+ 991us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:48:59.953935 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:48:59.953946 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:48:59.954007 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:48:59.954989 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:59.955483 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:59.956461 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:59.956726 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:59.956783 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:59.958995 (+ 2212us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:48:59.958997 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:48:59.958998 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:48:59.959004 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:48:59.960143 (+ 1139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:48:59.960541 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:48:59.960541 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:48:59.960542 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:48:59.960593 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:48:59.960783 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:48:59.960784 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:48:59.960784 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:48:59.960885 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:48:59.960930 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 14:48:59.961153 (+ 223us) server_negotiation.cc:299] Negotiation successful
0808 14:48:59.961216 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 14:48:59.961500 28924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:59.952610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:40987 (local address 127.30.214.131:57839)
0808 14:48:59.952801 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:59.952845 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 14:48:59.953797 (+ 952us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:48:59.954075 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:48:59.954079 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:48:59.954704 (+ 625us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:48:59.954912 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:59.954918 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:59.955562 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:59.955562 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:59.956384 (+ 822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:59.956387 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:59.956807 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:59.956808 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:59.956926 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:59.957519 (+ 593us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:48:59.957528 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:48:59.958902 (+ 1374us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:48:59.960218 (+ 1316us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:48:59.960224 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:48:59.960226 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:48:59.960481 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:48:59.960643 (+ 162us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:48:59.960644 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:48:59.960644 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:48:59.960740 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:48:59.960930 (+ 190us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:48:59.960933 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:48:59.961055 (+ 122us) client_negotiation.cc:769] Sending connection context
0808 14:48:59.961132 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 14:48:59.961257 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":97,"threads_started":1}
I20260808 14:48:59.961997 28920 heartbeater.cc:347] Connected to a master server at 127.30.214.190:40987
I20260808 14:48:59.962086 28920 heartbeater.cc:464] Registering TS with master...
I20260808 14:48:59.962064 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 28716
I20260808 14:48:59.962173 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/minicluster-data/ts-2/wal/instance
I20260808 14:48:59.962288 28920 heartbeater.cc:511] Master 127.30.214.190:40987 requested a full tablet report, sending...
I20260808 14:48:59.962340 31578 external_mini_cluster.cc:1428] Setting key 9ada076f03152666f87dd907488c779b
I20260808 14:48:59.962734 28203 ts_manager.cc:194] Registered new tserver with Master: 2bf60f1879f6419fac142e526a024357 (127.30.214.131:38353)
I20260808 14:48:59.963200 28203 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.214.131@KRBTEST.COM'} at 127.30.214.131:57839
I20260808 14:48:59.963224 31578 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:48:59.970093 28267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:59.964660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52722 (local address 127.30.214.190:40987)
0808 14:48:59.964702 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 14:48:59.964704 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:48:59.964781 (+ 77us) server_negotiation.cc:407] Connection header received
0808 14:48:59.964837 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:48:59.964838 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:48:59.964846 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:48:59.964881 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:48:59.965366 (+ 485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:59.965901 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:59.966589 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:59.966764 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:59.966808 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:59.968031 (+ 1223us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:48:59.968032 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:48:59.968032 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:48:59.968040 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:48:59.969117 (+ 1077us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:48:59.969472 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:48:59.969473 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:48:59.969474 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:48:59.969534 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:48:59.969674 (+ 140us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:48:59.969674 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:48:59.969674 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:48:59.969811 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:48:59.969884 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 14:48:59.969966 (+ 82us) server_negotiation.cc:299] Negotiation successful
0808 14:48:59.970028 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 14:48:59.971673 28203 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52722:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:48:59.973230 28203 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:48:59.980062 28943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:59.975866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53076 (local address 127.30.214.130:35803)
0808 14:48:59.976089 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0808 14:48:59.976093 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:48:59.976107 (+ 14us) server_negotiation.cc:407] Connection header received
0808 14:48:59.976439 (+ 332us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:48:59.976442 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:48:59.976458 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:48:59.976528 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:48:59.976677 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:59.977385 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:59.978948 (+ 1563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:59.979635 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:59.979700 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:59.979755 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 14:48:59.979917 (+ 162us) server_negotiation.cc:299] Negotiation successful
0808 14:48:59.979963 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":193,"thread_start_us":100,"threads_started":1}
I20260808 14:48:59.980067 28938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:59.975569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.131:38353 (local address 127.0.0.1:51910)
0808 14:48:59.975850 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:59.975881 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0808 14:48:59.975950 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:48:59.976179 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:48:59.976182 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:48:59.976184 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:48:59.976625 (+ 441us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:59.976629 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:59.977871 (+ 1242us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:59.977872 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:59.978765 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:59.978767 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:59.979697 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:59.979698 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:59.979797 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:59.979813 (+ 16us) client_negotiation.cc:769] Sending connection context
0808 14:48:59.979888 (+ 75us) client_negotiation.cc:240] Negotiation successful
0808 14:48:59.979956 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":108,"threads_started":1}
I20260808 14:48:59.980067 28940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:59.975569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.130:35803 (local address 127.0.0.1:53076)
0808 14:48:59.976066 (+ 497us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:59.976074 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 14:48:59.976113 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:48:59.976558 (+ 445us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:48:59.976559 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:48:59.976560 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:48:59.976607 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:59.976609 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:59.977522 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:59.977523 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:59.978853 (+ 1330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:59.978856 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:59.979703 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:59.979704 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:59.979799 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:59.979813 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 14:48:59.979888 (+ 75us) client_negotiation.cc:240] Negotiation successful
0808 14:48:59.979956 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":475,"mutex_wait_us":34,"spinlock_wait_cycles":768,"thread_start_us":106,"threads_started":1}
I20260808 14:48:59.980347 28942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:59.975820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51910 (local address 127.30.214.131:38353)
0808 14:48:59.976009 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0808 14:48:59.976014 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:48:59.976025 (+ 11us) server_negotiation.cc:407] Connection header received
0808 14:48:59.976064 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:48:59.976066 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:48:59.976084 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:48:59.976158 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:48:59.976716 (+ 558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:59.977768 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:59.978846 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:59.979607 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:59.979693 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:59.979755 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 14:48:59.980218 (+ 463us) server_negotiation.cc:299] Negotiation successful
0808 14:48:59.980271 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":90,"threads_started":1}
I20260808 14:48:59.980962 28822 tablet_service.cc:1467] Processing CreateTablet for tablet df0b71a0cdfe4aca8d91e99547b39c2c (DEFAULT_TABLE table=test-table [id=769645f53b234330916e09677256bac2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:48:59.981001 28601 tablet_service.cc:1467] Processing CreateTablet for tablet df0b71a0cdfe4aca8d91e99547b39c2c (DEFAULT_TABLE table=test-table [id=769645f53b234330916e09677256bac2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:48:59.981310 28939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:59.975567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.129:37005 (local address 127.0.0.1:54282)
0808 14:48:59.975840 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0808 14:48:59.975881 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 14:48:59.975950 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:48:59.976264 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:48:59.976265 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:48:59.976267 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:48:59.976317 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:59.976318 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:59.977658 (+ 1340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:59.977659 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:59.978869 (+ 1210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:48:59.978871 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:48:59.981077 (+ 2206us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:48:59.981078 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:48:59.981142 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:59.981147 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 14:48:59.981202 (+ 55us) client_negotiation.cc:240] Negotiation successful
0808 14:48:59.981245 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":239,"mutex_wait_us":28,"thread_start_us":68,"threads_started":1}
I20260808 14:48:59.981364 28601 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df0b71a0cdfe4aca8d91e99547b39c2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:48:59.981369 28822 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df0b71a0cdfe4aca8d91e99547b39c2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:48:59.981599 28941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:48:59.975668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54282 (local address 127.30.214.129:37005)
0808 14:48:59.976108 (+ 440us) server_negotiation.cc:206] Beginning negotiation
0808 14:48:59.976112 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:48:59.976121 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:48:59.976159 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:48:59.976161 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:48:59.976176 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:48:59.976254 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:48:59.976385 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:59.977554 (+ 1169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:59.979794 (+ 2240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:48:59.980976 (+ 1182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:48:59.981058 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:48:59.981114 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 14:48:59.981422 (+ 308us) server_negotiation.cc:299] Negotiation successful
0808 14:48:59.981518 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":407,"thread_start_us":95,"threads_started":1}
I20260808 14:48:59.984180 28946 tablet_bootstrap.cc:492] T df0b71a0cdfe4aca8d91e99547b39c2c P 707db08f143e417681d5057136b49d65: Bootstrap starting.
I20260808 14:48:59.984186 28947 tablet_bootstrap.cc:492] T df0b71a0cdfe4aca8d91e99547b39c2c P 2bf60f1879f6419fac142e526a024357: Bootstrap starting.
I20260808 14:48:59.984905 28947 tablet_bootstrap.cc:654] T df0b71a0cdfe4aca8d91e99547b39c2c P 2bf60f1879f6419fac142e526a024357: Neither blocks nor log segments found. Creating new log.
I20260808 14:48:59.984943 28946 tablet_bootstrap.cc:654] T df0b71a0cdfe4aca8d91e99547b39c2c P 707db08f143e417681d5057136b49d65: Neither blocks nor log segments found. Creating new log.
I20260808 14:48:59.985159 28395 tablet_service.cc:1467] Processing CreateTablet for tablet df0b71a0cdfe4aca8d91e99547b39c2c (DEFAULT_TABLE table=test-table [id=769645f53b234330916e09677256bac2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:48:59.985395 28947 log.cc:824] T df0b71a0cdfe4aca8d91e99547b39c2c P 2bf60f1879f6419fac142e526a024357: Log is configured to *not* fsync() on all Append() calls
I20260808 14:48:59.985580 28395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df0b71a0cdfe4aca8d91e99547b39c2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:48:59.985738 28946 log.cc:824] T df0b71a0cdfe4aca8d91e99547b39c2c P 707db08f143e417681d5057136b49d65: Log is configured to *not* fsync() on all Append() calls
I20260808 14:48:59.986539 28946 tablet_bootstrap.cc:492] T df0b71a0cdfe4aca8d91e99547b39c2c P 707db08f143e417681d5057136b49d65: No bootstrap required, opened a new log
I20260808 14:48:59.986544 28947 tablet_bootstrap.cc:492] T df0b71a0cdfe4aca8d91e99547b39c2c P 2bf60f1879f6419fac142e526a024357: No bootstrap required, opened a new log
I20260808 14:48:59.986615 28947 ts_tablet_manager.cc:1397] T df0b71a0cdfe4aca8d91e99547b39c2c P 2bf60f1879f6419fac142e526a024357: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:48:59.986615 28946 ts_tablet_manager.cc:1397] T df0b71a0cdfe4aca8d91e99547b39c2c P 707db08f143e417681d5057136b49d65: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260808 14:48:59.988565 28952 tablet_bootstrap.cc:492] T df0b71a0cdfe4aca8d91e99547b39c2c P 90daab27c0bd4cb99733da39f50613bc: Bootstrap starting.
I20260808 14:48:59.988571 28946 raft_consensus.cc:348] T df0b71a0cdfe4aca8d91e99547b39c2c P 707db08f143e417681d5057136b49d65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf60f1879f6419fac142e526a024357" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 38353 } } peers { permanent_uuid: "90daab27c0bd4cb99733da39f50613bc" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 37005 } } peers { permanent_uuid: "707db08f143e417681d5057136b49d65" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35803 } }
I20260808 14:48:59.988571 28947 raft_consensus.cc:348] T df0b71a0cdfe4aca8d91e99547b39c2c P 2bf60f1879f6419fac142e526a024357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf60f1879f6419fac142e526a024357" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 38353 } } peers { permanent_uuid: "90daab27c0bd4cb99733da39f50613bc" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 37005 } } peers { permanent_uuid: "707db08f143e417681d5057136b49d65" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35803 } }
I20260808 14:48:59.988768 28947 raft_consensus.cc:374] T df0b71a0cdfe4aca8d91e99547b39c2c P 2bf60f1879f6419fac142e526a024357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:48:59.988768 28946 raft_consensus.cc:374] T df0b71a0cdfe4aca8d91e99547b39c2c P 707db08f143e417681d5057136b49d65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:48:59.988807 28947 raft_consensus.cc:729] T df0b71a0cdfe4aca8d91e99547b39c2c P 2bf60f1879f6419fac142e526a024357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf60f1879f6419fac142e526a024357, State: Initialized, Role: FOLLOWER
I20260808 14:48:59.988807 28946 raft_consensus.cc:729] T df0b71a0cdfe4aca8d91e99547b39c2c P 707db08f143e417681d5057136b49d65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 707db08f143e417681d5057136b49d65, State: Initialized, Role: FOLLOWER
I20260808 14:48:59.988932 28946 consensus_queue.cc:260] T df0b71a0cdfe4aca8d91e99547b39c2c P 707db08f143e417681d5057136b49d65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf60f1879f6419fac142e526a024357" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 38353 } } peers { permanent_uuid: "90daab27c0bd4cb99733da39f50613bc" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 37005 } } peers { permanent_uuid: "707db08f143e417681d5057136b49d65" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35803 } }
I20260808 14:48:59.988968 28947 consensus_queue.cc:260] T df0b71a0cdfe4aca8d91e99547b39c2c P 2bf60f1879f6419fac142e526a024357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf60f1879f6419fac142e526a024357" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 38353 } } peers { permanent_uuid: "90daab27c0bd4cb99733da39f50613bc" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 37005 } } peers { permanent_uuid: "707db08f143e417681d5057136b49d65" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35803 } }
I20260808 14:48:59.989244 28946 ts_tablet_manager.cc:1428] T df0b71a0cdfe4aca8d91e99547b39c2c P 707db08f143e417681d5057136b49d65: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260808 14:48:59.989267 28947 ts_tablet_manager.cc:1428] T df0b71a0cdfe4aca8d91e99547b39c2c P 2bf60f1879f6419fac142e526a024357: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 14:48:59.989264 28705 heartbeater.cc:503] Master 127.30.214.190:40987 was elected leader, sending a full tablet report...
I20260808 14:48:59.989378 28920 heartbeater.cc:503] Master 127.30.214.190:40987 was elected leader, sending a full tablet report...
I20260808 14:48:59.989310 28952 tablet_bootstrap.cc:654] T df0b71a0cdfe4aca8d91e99547b39c2c P 90daab27c0bd4cb99733da39f50613bc: Neither blocks nor log segments found. Creating new log.
I20260808 14:48:59.990099 28952 log.cc:824] T df0b71a0cdfe4aca8d91e99547b39c2c P 90daab27c0bd4cb99733da39f50613bc: Log is configured to *not* fsync() on all Append() calls
I20260808 14:48:59.990922 28952 tablet_bootstrap.cc:492] T df0b71a0cdfe4aca8d91e99547b39c2c P 90daab27c0bd4cb99733da39f50613bc: No bootstrap required, opened a new log
I20260808 14:48:59.991005 28952 ts_tablet_manager.cc:1397] T df0b71a0cdfe4aca8d91e99547b39c2c P 90daab27c0bd4cb99733da39f50613bc: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 14:48:59.992408 28952 raft_consensus.cc:348] T df0b71a0cdfe4aca8d91e99547b39c2c P 90daab27c0bd4cb99733da39f50613bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf60f1879f6419fac142e526a024357" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 38353 } } peers { permanent_uuid: "90daab27c0bd4cb99733da39f50613bc" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 37005 } } peers { permanent_uuid: "707db08f143e417681d5057136b49d65" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35803 } }
I20260808 14:48:59.992556 28952 raft_consensus.cc:374] T df0b71a0cdfe4aca8d91e99547b39c2c P 90daab27c0bd4cb99733da39f50613bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:48:59.992579 28952 raft_consensus.cc:729] T df0b71a0cdfe4aca8d91e99547b39c2c P 90daab27c0bd4cb99733da39f50613bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90daab27c0bd4cb99733da39f50613bc, State: Initialized, Role: FOLLOWER
I20260808 14:48:59.992676 28952 consensus_queue.cc:260] T df0b71a0cdfe4aca8d91e99547b39c2c P 90daab27c0bd4cb99733da39f50613bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf60f1879f6419fac142e526a024357" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 38353 } } peers { permanent_uuid: "90daab27c0bd4cb99733da39f50613bc" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 37005 } } peers { permanent_uuid: "707db08f143e417681d5057136b49d65" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35803 } }
I20260808 14:48:59.992919 28952 ts_tablet_manager.cc:1428] T df0b71a0cdfe4aca8d91e99547b39c2c P 90daab27c0bd4cb99733da39f50613bc: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:48:59.992976 28497 heartbeater.cc:503] Master 127.30.214.190:40987 was elected leader, sending a full tablet report...
W20260808 14:49:00.041595 28711 tablet.cc:2369] T df0b71a0cdfe4aca8d91e99547b39c2c P 707db08f143e417681d5057136b49d65: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:49:00.133461 28502 tablet.cc:2369] T df0b71a0cdfe4aca8d91e99547b39c2c P 90daab27c0bd4cb99733da39f50613bc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:49:00.188364 28954 raft_consensus.cc:482] T df0b71a0cdfe4aca8d91e99547b39c2c P 2bf60f1879f6419fac142e526a024357 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:49:00.188508 28954 raft_consensus.cc:504] T df0b71a0cdfe4aca8d91e99547b39c2c P 2bf60f1879f6419fac142e526a024357 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf60f1879f6419fac142e526a024357" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 38353 } } peers { permanent_uuid: "90daab27c0bd4cb99733da39f50613bc" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 37005 } } peers { permanent_uuid: "707db08f143e417681d5057136b49d65" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35803 } }
I20260808 14:49:00.188892 28954 leader_election.cc:288] T df0b71a0cdfe4aca8d91e99547b39c2c P 2bf60f1879f6419fac142e526a024357 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 90daab27c0bd4cb99733da39f50613bc (127.30.214.129:37005), 707db08f143e417681d5057136b49d65 (127.30.214.130:35803)
I20260808 14:49:00.192909 28943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:00.189204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:56869 (local address 127.30.214.130:35803)
0808 14:49:00.189260 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:00.189263 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:00.189566 (+ 303us) server_negotiation.cc:407] Connection header received
0808 14:49:00.189615 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:00.189616 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:00.189626 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:00.189685 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:49:00.189790 (+ 105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:00.190451 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:00.191935 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:00.192516 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:00.192596 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:00.192605 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:00.192788 (+ 183us) server_negotiation.cc:299] Negotiation successful
0808 14:49:00.192828 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 14:49:00.192909 28941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:00.189259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:44569 (local address 127.30.214.129:37005)
0808 14:49:00.189312 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:00.189314 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:00.189325 (+ 11us) server_negotiation.cc:407] Connection header received
0808 14:49:00.189353 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:00.189353 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:00.189361 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:00.189455 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:49:00.189637 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:00.190402 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:00.191928 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:00.192516 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:00.192596 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:00.192605 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:00.192788 (+ 183us) server_negotiation.cc:299] Negotiation successful
0808 14:49:00.192828 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 14:49:00.192943 28924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:00.189152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.129:37005 (local address 127.30.214.131:44569)
0808 14:49:00.189201 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:00.189213 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:49:00.189258 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:49:00.189474 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:49:00.189475 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:49:00.189478 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:49:00.189572 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:00.189574 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:00.190492 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:00.190493 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:00.191818 (+ 1325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:00.191822 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:00.192599 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:00.192600 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:00.192706 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:00.192714 (+ 8us) client_negotiation.cc:769] Sending connection context
0808 14:49:00.192773 (+ 59us) client_negotiation.cc:240] Negotiation successful
0808 14:49:00.192826 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28,"mutex_wait_us":57}
I20260808 14:49:00.192948 28962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:00.189152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.130:35803 (local address 127.30.214.131:56869)
0808 14:49:00.189489 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:00.189498 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:49:00.189562 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:49:00.189695 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:49:00.189695 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:49:00.189696 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:49:00.189746 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:00.189747 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:00.190528 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:00.190528 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:00.191818 (+ 1290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:00.191822 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:00.192599 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:00.192600 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:00.192706 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:00.192714 (+ 8us) client_negotiation.cc:769] Sending connection context
0808 14:49:00.192773 (+ 59us) client_negotiation.cc:240] Negotiation successful
0808 14:49:00.192825 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":319,"mutex_wait_us":186,"thread_start_us":93,"threads_started":1}
I20260808 14:49:00.193506 28423 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df0b71a0cdfe4aca8d91e99547b39c2c" candidate_uuid: "2bf60f1879f6419fac142e526a024357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90daab27c0bd4cb99733da39f50613bc" is_pre_election: true
I20260808 14:49:00.193472 28639 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df0b71a0cdfe4aca8d91e99547b39c2c" candidate_uuid: "2bf60f1879f6419fac142e526a024357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707db08f143e417681d5057136b49d65" is_pre_election: true
I20260808 14:49:00.193670 28639 raft_consensus.cc:2454] T df0b71a0cdfe4aca8d91e99547b39c2c P 707db08f143e417681d5057136b49d65 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf60f1879f6419fac142e526a024357 in term 0.
I20260808 14:49:00.193670 28423 raft_consensus.cc:2454] T df0b71a0cdfe4aca8d91e99547b39c2c P 90daab27c0bd4cb99733da39f50613bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf60f1879f6419fac142e526a024357 in term 0.
I20260808 14:49:00.193928 28747 leader_election.cc:302] T df0b71a0cdfe4aca8d91e99547b39c2c P 2bf60f1879f6419fac142e526a024357 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf60f1879f6419fac142e526a024357, 707db08f143e417681d5057136b49d65; no voters:
I20260808 14:49:00.194063 28954 raft_consensus.cc:2781] T df0b71a0cdfe4aca8d91e99547b39c2c P 2bf60f1879f6419fac142e526a024357 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:49:00.194136 28954 raft_consensus.cc:482] T df0b71a0cdfe4aca8d91e99547b39c2c P 2bf60f1879f6419fac142e526a024357 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:49:00.194154 28954 raft_consensus.cc:3037] T df0b71a0cdfe4aca8d91e99547b39c2c P 2bf60f1879f6419fac142e526a024357 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:49:00.194926 28954 raft_consensus.cc:504] T df0b71a0cdfe4aca8d91e99547b39c2c P 2bf60f1879f6419fac142e526a024357 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf60f1879f6419fac142e526a024357" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 38353 } } peers { permanent_uuid: "90daab27c0bd4cb99733da39f50613bc" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 37005 } } peers { permanent_uuid: "707db08f143e417681d5057136b49d65" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35803 } }
I20260808 14:49:00.195067 28954 leader_election.cc:288] T df0b71a0cdfe4aca8d91e99547b39c2c P 2bf60f1879f6419fac142e526a024357 [CANDIDATE]: Term 1 election: Requested vote from peers 90daab27c0bd4cb99733da39f50613bc (127.30.214.129:37005), 707db08f143e417681d5057136b49d65 (127.30.214.130:35803)
I20260808 14:49:00.195264 28639 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df0b71a0cdfe4aca8d91e99547b39c2c" candidate_uuid: "2bf60f1879f6419fac142e526a024357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "707db08f143e417681d5057136b49d65"
I20260808 14:49:00.195274 28423 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df0b71a0cdfe4aca8d91e99547b39c2c" candidate_uuid: "2bf60f1879f6419fac142e526a024357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90daab27c0bd4cb99733da39f50613bc"
I20260808 14:49:00.195346 28639 raft_consensus.cc:3037] T df0b71a0cdfe4aca8d91e99547b39c2c P 707db08f143e417681d5057136b49d65 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:49:00.195364 28423 raft_consensus.cc:3037] T df0b71a0cdfe4aca8d91e99547b39c2c P 90daab27c0bd4cb99733da39f50613bc [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:49:00.196069 28423 raft_consensus.cc:2454] T df0b71a0cdfe4aca8d91e99547b39c2c P 90daab27c0bd4cb99733da39f50613bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf60f1879f6419fac142e526a024357 in term 1.
I20260808 14:49:00.196172 28639 raft_consensus.cc:2454] T df0b71a0cdfe4aca8d91e99547b39c2c P 707db08f143e417681d5057136b49d65 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf60f1879f6419fac142e526a024357 in term 1.
I20260808 14:49:00.196287 28746 leader_election.cc:302] T df0b71a0cdfe4aca8d91e99547b39c2c P 2bf60f1879f6419fac142e526a024357 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf60f1879f6419fac142e526a024357, 90daab27c0bd4cb99733da39f50613bc; no voters:
I20260808 14:49:00.196380 28954 raft_consensus.cc:2781] T df0b71a0cdfe4aca8d91e99547b39c2c P 2bf60f1879f6419fac142e526a024357 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:49:00.196557 28954 raft_consensus.cc:686] T df0b71a0cdfe4aca8d91e99547b39c2c P 2bf60f1879f6419fac142e526a024357 [term 1 LEADER]: Becoming Leader. State: Replica: 2bf60f1879f6419fac142e526a024357, State: Running, Role: LEADER
I20260808 14:49:00.196663 28954 consensus_queue.cc:237] T df0b71a0cdfe4aca8d91e99547b39c2c P 2bf60f1879f6419fac142e526a024357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf60f1879f6419fac142e526a024357" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 38353 } } peers { permanent_uuid: "90daab27c0bd4cb99733da39f50613bc" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 37005 } } peers { permanent_uuid: "707db08f143e417681d5057136b49d65" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35803 } }
I20260808 14:49:00.197574 28203 catalog_manager.cc:5495] T df0b71a0cdfe4aca8d91e99547b39c2c P 2bf60f1879f6419fac142e526a024357 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bf60f1879f6419fac142e526a024357 (127.30.214.131). New cstate: current_term: 1 leader_uuid: "2bf60f1879f6419fac142e526a024357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf60f1879f6419fac142e526a024357" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 38353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "90daab27c0bd4cb99733da39f50613bc" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 37005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "707db08f143e417681d5057136b49d65" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35803 } health_report { overall_health: UNKNOWN } } }
W20260808 14:49:00.202453 28923 tablet.cc:2369] T df0b71a0cdfe4aca8d91e99547b39c2c P 2bf60f1879f6419fac142e526a024357: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:49:00.210228 28942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:00.207998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51926 (local address 127.30.214.131:38353)
0808 14:49:00.208047 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:00.208048 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:00.208059 (+ 11us) server_negotiation.cc:407] Connection header received
0808 14:49:00.208104 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:00.208105 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:00.208122 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:00.208183 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:49:00.208289 (+ 106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:00.208761 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:00.209564 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:00.209754 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:00.209806 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:00.209924 (+ 118us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:49:00.210031 (+ 107us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:49:00.210094 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:00.210122 (+ 28us) server_negotiation.cc:299] Negotiation successful
0808 14:49:00.210141 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 14:49:00.212780 28639 raft_consensus.cc:1261] T df0b71a0cdfe4aca8d91e99547b39c2c P 707db08f143e417681d5057136b49d65 [term 1 FOLLOWER]: Refusing update from remote peer 2bf60f1879f6419fac142e526a024357: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:49:00.212780 28423 raft_consensus.cc:1261] T df0b71a0cdfe4aca8d91e99547b39c2c P 90daab27c0bd4cb99733da39f50613bc [term 1 FOLLOWER]: Refusing update from remote peer 2bf60f1879f6419fac142e526a024357: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:49:00.213275 28954 consensus_queue.cc:1035] T df0b71a0cdfe4aca8d91e99547b39c2c P 2bf60f1879f6419fac142e526a024357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90daab27c0bd4cb99733da39f50613bc" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 37005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:49:00.213486 28963 consensus_queue.cc:1035] T df0b71a0cdfe4aca8d91e99547b39c2c P 2bf60f1879f6419fac142e526a024357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "707db08f143e417681d5057136b49d65" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 35803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:49:00.216946 28971 mvcc.cc:205] Tried to move back new op lower bound from 7316277412706693120 to 7316277412646105088. Current Snapshot: MvccSnapshot[applied={T|T < 7316277412706693120 or (T in {7316277412706693120})}]
I20260808 14:49:00.218636 28205 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52722:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:49:00.218750 28205 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52722:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:49:00.219524 28205 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3a9c92688dba4cb9ab18aa24daaec1df: Sending DeleteTablet for 3 replicas of tablet df0b71a0cdfe4aca8d91e99547b39c2c
I20260808 14:49:00.219821 28822 tablet_service.cc:1514] Processing DeleteTablet for tablet df0b71a0cdfe4aca8d91e99547b39c2c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:49:00 UTC) from {username='kudu', principal='kudu/127.30.214.190@KRBTEST.COM'} at 127.0.0.1:51910
I20260808 14:49:00.219885 28395 tablet_service.cc:1514] Processing DeleteTablet for tablet df0b71a0cdfe4aca8d91e99547b39c2c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:49:00 UTC) from {username='kudu', principal='kudu/127.30.214.190@KRBTEST.COM'} at 127.0.0.1:54282
I20260808 14:49:00.219885 28601 tablet_service.cc:1514] Processing DeleteTablet for tablet df0b71a0cdfe4aca8d91e99547b39c2c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:49:00 UTC) from {username='kudu', principal='kudu/127.30.214.190@KRBTEST.COM'} at 127.0.0.1:53076
I20260808 14:49:00.220120 28988 tablet_replica.cc:330] T df0b71a0cdfe4aca8d91e99547b39c2c P 707db08f143e417681d5057136b49d65: stopping tablet replica
I20260808 14:49:00.220227 28988 raft_consensus.cc:2229] T df0b71a0cdfe4aca8d91e99547b39c2c P 707db08f143e417681d5057136b49d65 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:49:00.220329 28988 raft_consensus.cc:2258] T df0b71a0cdfe4aca8d91e99547b39c2c P 707db08f143e417681d5057136b49d65 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:49:00.220451 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 28300
I20260808 14:49:00.223413 28988 ts_tablet_manager.cc:1905] T df0b71a0cdfe4aca8d91e99547b39c2c P 707db08f143e417681d5057136b49d65: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:49:00.226187 28988 ts_tablet_manager.cc:1918] T df0b71a0cdfe4aca8d91e99547b39c2c P 707db08f143e417681d5057136b49d65: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:49:00.226284 28988 log.cc:1196] T df0b71a0cdfe4aca8d91e99547b39c2c P 707db08f143e417681d5057136b49d65: Deleting WAL directory at /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/minicluster-data/ts-1/wal/wals/df0b71a0cdfe4aca8d91e99547b39c2c
I20260808 14:49:00.226567 28988 ts_tablet_manager.cc:1939] T df0b71a0cdfe4aca8d91e99547b39c2c P 707db08f143e417681d5057136b49d65: Deleting consensus metadata
I20260808 14:49:00.227079 28184 catalog_manager.cc:4841] TS 707db08f143e417681d5057136b49d65 (127.30.214.130:35803): tablet df0b71a0cdfe4aca8d91e99547b39c2c (table test-table [id=769645f53b234330916e09677256bac2]) successfully deleted
I20260808 14:49:00.227162 28986 tablet_replica.cc:330] T df0b71a0cdfe4aca8d91e99547b39c2c P 2bf60f1879f6419fac142e526a024357: stopping tablet replica
I20260808 14:49:00.227270 28986 raft_consensus.cc:2229] T df0b71a0cdfe4aca8d91e99547b39c2c P 2bf60f1879f6419fac142e526a024357 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:49:00.227389 28986 raft_consensus.cc:2258] T df0b71a0cdfe4aca8d91e99547b39c2c P 2bf60f1879f6419fac142e526a024357 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:49:00.227867 28986 ts_tablet_manager.cc:1905] T df0b71a0cdfe4aca8d91e99547b39c2c P 2bf60f1879f6419fac142e526a024357: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:49:00.229552 28986 ts_tablet_manager.cc:1918] T df0b71a0cdfe4aca8d91e99547b39c2c P 2bf60f1879f6419fac142e526a024357: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:49:00.229636 28986 log.cc:1196] T df0b71a0cdfe4aca8d91e99547b39c2c P 2bf60f1879f6419fac142e526a024357: Deleting WAL directory at /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786200295877777-31578-0/minicluster-data/ts-2/wal/wals/df0b71a0cdfe4aca8d91e99547b39c2c
I20260808 14:49:00.229947 28986 ts_tablet_manager.cc:1939] T df0b71a0cdfe4aca8d91e99547b39c2c P 2bf60f1879f6419fac142e526a024357: Deleting consensus metadata
I20260808 14:49:00.230434 28190 catalog_manager.cc:4841] TS 2bf60f1879f6419fac142e526a024357 (127.30.214.131:38353): tablet df0b71a0cdfe4aca8d91e99547b39c2c (table test-table [id=769645f53b234330916e09677256bac2]) successfully deleted
W20260808 14:49:00.231449 28182 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.30.214.129:37005 (error 108)
I20260808 14:49:00.231683 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 28507
I20260808 14:49:00.234275 28939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:00.234099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.129:37005 (local address 127.0.0.1:54294)
0808 14:49:00.234176 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:00.234231 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.129:37005: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260808 14:49:00.234442 28182 catalog_manager.cc:4584] TS 90daab27c0bd4cb99733da39f50613bc (127.30.214.129:37005): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet df0b71a0cdfe4aca8d91e99547b39c2c: Network error: Client connection negotiation failed: client connection to 127.30.214.129:37005: connect: Connection refused (error 111)
I20260808 14:49:00.245676 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 28716
I20260808 14:49:00.262959 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 28151
2026-08-08T14:49:00Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2244 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-08T14:49:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:49:00Z Disabled control of system clock
I20260808 14:49:00.300446 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200295877777-31578-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200295877777-31578-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200295877777-31578-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:44981
--webserver_interface=127.30.214.190
--webserver_port=0
--builtin_ntp_servers=127.30.214.148:41519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.214.190:44981
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 14:49:00.383754 28996 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:49:00.384003 28996 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:49:00.384024 28996 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:49:00.385331 28996 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:49:00.385380 28996 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:49:00.385398 28996 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:49:00.385412 28996 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:49:00.385466 28996 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:49:00.386945 28996 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:41519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200295877777-31578-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200295877777-31578-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.214.190:44981
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:44981
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28996
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200295877777-31578-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:49:00.387223 28996 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:49:00.387569 28996 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:49:00.392853 29006 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:49:00.392910 28996 server_base.cc:1034] running on GCE node
W20260808 14:49:00.392870 29003 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:00.392824 29004 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:49:00.393573 28996 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:49:00.394013 28996 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:49:00.395186 28996 hybrid_clock.cc:648] HybridClock initialized: now 1786200540395166 us; error 45 us; skew 500 ppm
I20260808 14:49:00.396509 28996 webserver.cc:460] Webserver started at http://127.30.214.190:44179/ using document root <none> and password file <none>
I20260808 14:49:00.396771 28996 fs_manager.cc:359] Metadata directory not provided
I20260808 14:49:00.396826 28996 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:49:00.396966 28996 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:49:00.398155 28996 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200295877777-31578-0/minicluster-data/master-0/data/instance:
uuid: "5bf0553d0f7c4678888ebe578a8da29f"
format_stamp: "Formatted at 2026-08-08 14:49:00 on dist-test-slave-42z9"
server_key: "35417b07f22f6e3c773635cc1bf332a1"
server_key_iv: "43da708222beef246cbbe4d4ef607516"
server_key_version: "encryptionkey@0"
I20260808 14:49:00.398537 28996 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200295877777-31578-0/minicluster-data/master-0/wal/instance:
uuid: "5bf0553d0f7c4678888ebe578a8da29f"
format_stamp: "Formatted at 2026-08-08 14:49:00 on dist-test-slave-42z9"
server_key: "35417b07f22f6e3c773635cc1bf332a1"
server_key_iv: "43da708222beef246cbbe4d4ef607516"
server_key_version: "encryptionkey@0"
I20260808 14:49:00.399880 28996 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 14:49:00.400604 29015 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:49:00.400774 28996 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:49:00.400861 28996 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200295877777-31578-0/minicluster-data/master-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200295877777-31578-0/minicluster-data/master-0/wal
uuid: "5bf0553d0f7c4678888ebe578a8da29f"
format_stamp: "Formatted at 2026-08-08 14:49:00 on dist-test-slave-42z9"
server_key: "35417b07f22f6e3c773635cc1bf332a1"
server_key_iv: "43da708222beef246cbbe4d4ef607516"
server_key_version: "encryptionkey@0"
I20260808 14:49:00.400933 28996 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200295877777-31578-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200295877777-31578-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200295877777-31578-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:49:00.414052 28996 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:49:00.414400 28996 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:49:00.414534 28996 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:49:00.418859 28996 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.190:44981
I20260808 14:49:00.418905 29098 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.190:44981 every 8 connection(s)
I20260808 14:49:00.419245 28996 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
I20260808 14:49:00.420284 29099 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:49:00.422761 29099 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5bf0553d0f7c4678888ebe578a8da29f: Bootstrap starting.
I20260808 14:49:00.423334 29099 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5bf0553d0f7c4678888ebe578a8da29f: Neither blocks nor log segments found. Creating new log.
I20260808 14:49:00.423588 29099 log.cc:824] T 00000000000000000000000000000000 P 5bf0553d0f7c4678888ebe578a8da29f: Log is configured to *not* fsync() on all Append() calls
I20260808 14:49:00.424242 29099 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5bf0553d0f7c4678888ebe578a8da29f: No bootstrap required, opened a new log
I20260808 14:49:00.425426 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 28996
I20260808 14:49:00.425557 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200295877777-31578-0/minicluster-data/master-0/wal/instance
I20260808 14:49:00.425738 31578 external_mini_cluster.cc:1428] Setting key 1f6b512dd80544165d1c1fe631d9188b
I20260808 14:49:00.426064 29099 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5bf0553d0f7c4678888ebe578a8da29f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5bf0553d0f7c4678888ebe578a8da29f" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 44981 } }
I20260808 14:49:00.426331 29099 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5bf0553d0f7c4678888ebe578a8da29f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:49:00.426390 29099 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5bf0553d0f7c4678888ebe578a8da29f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bf0553d0f7c4678888ebe578a8da29f, State: Initialized, Role: FOLLOWER
I20260808 14:49:00.426599 29099 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5bf0553d0f7c4678888ebe578a8da29f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5bf0553d0f7c4678888ebe578a8da29f" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 44981 } }
I20260808 14:49:00.426694 29099 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5bf0553d0f7c4678888ebe578a8da29f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:49:00.426738 29099 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5bf0553d0f7c4678888ebe578a8da29f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:49:00.426782 29099 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5bf0553d0f7c4678888ebe578a8da29f [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:49:00.427542 29099 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5bf0553d0f7c4678888ebe578a8da29f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5bf0553d0f7c4678888ebe578a8da29f" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 44981 } }
I20260808 14:49:00.427655 29099 leader_election.cc:302] T 00000000000000000000000000000000 P 5bf0553d0f7c4678888ebe578a8da29f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5bf0553d0f7c4678888ebe578a8da29f; no voters:
I20260808 14:49:00.427807 29099 leader_election.cc:288] T 00000000000000000000000000000000 P 5bf0553d0f7c4678888ebe578a8da29f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:49:00.427855 29108 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5bf0553d0f7c4678888ebe578a8da29f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:49:00.428010 29108 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5bf0553d0f7c4678888ebe578a8da29f [term 1 LEADER]: Becoming Leader. State: Replica: 5bf0553d0f7c4678888ebe578a8da29f, State: Running, Role: LEADER
I20260808 14:49:00.428082 29099 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5bf0553d0f7c4678888ebe578a8da29f [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:49:00.428140 29108 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5bf0553d0f7c4678888ebe578a8da29f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5bf0553d0f7c4678888ebe578a8da29f" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 44981 } }
I20260808 14:49:00.428560 29108 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5bf0553d0f7c4678888ebe578a8da29f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5bf0553d0f7c4678888ebe578a8da29f. Latest consensus state: current_term: 1 leader_uuid: "5bf0553d0f7c4678888ebe578a8da29f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5bf0553d0f7c4678888ebe578a8da29f" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 44981 } } }
I20260808 14:49:00.428568 29109 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5bf0553d0f7c4678888ebe578a8da29f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5bf0553d0f7c4678888ebe578a8da29f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5bf0553d0f7c4678888ebe578a8da29f" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 44981 } } }
I20260808 14:49:00.428723 29108 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5bf0553d0f7c4678888ebe578a8da29f [sys.catalog]: This master's current role is: LEADER
I20260808 14:49:00.428730 29109 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5bf0553d0f7c4678888ebe578a8da29f [sys.catalog]: This master's current role is: LEADER
I20260808 14:49:00.428977 29123 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:49:00.429716 29123 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:49:00.431435 29123 catalog_manager.cc:1347] Generated new cluster ID: 99c7c88274714adc8881c5a70958f3d3
I20260808 14:49:00.431491 29123 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:49:00.432145 29107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:00.426288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50100 (local address 127.30.214.190:44981)
0808 14:49:00.426579 (+ 291us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:00.426587 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:00.426621 (+ 34us) server_negotiation.cc:407] Connection header received
0808 14:49:00.426735 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:00.426742 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:00.426814 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:00.426963 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:00.427126 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:00.428875 (+ 1749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:00.430003 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:00.430533 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:00.430652 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:00.431435 (+ 783us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:00.431439 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:00.431440 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:49:00.431646 (+ 206us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:00.431684 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:49:00.431696 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:00.431754 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:00.431843 (+ 89us) server_negotiation.cc:299] Negotiation successful
0808 14:49:00.431927 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":214,"thread_start_us":130,"threads_started":1}
I20260808 14:49:00.441813 29123 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:49:00.442533 29123 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:49:00.445310 29123 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5bf0553d0f7c4678888ebe578a8da29f: Generated new TSK 0
I20260808 14:49:00.445521 29123 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:49:00.450052 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200295877777-31578-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200295877777-31578-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200295877777-31578-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.129:0
--local_ip_for_outbound_sockets=127.30.214.129
--webserver_interface=127.30.214.129
--webserver_port=0
--tserver_master_addrs=127.30.214.190:44981
--builtin_ntp_servers=127.30.214.148:41519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 14:49:00.535076 29139 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:49:00.535302 29139 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:49:00.535326 29139 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:49:00.536549 29139 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:49:00.536597 29139 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:49:00.536623 29139 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.129
I20260808 14:49:00.538084 29139 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:41519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200295877777-31578-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200295877777-31578-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.214.129
--webserver_port=0
--tserver_master_addrs=127.30.214.190:44981
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29139
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.129
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200295877777-31578-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:49:00.538329 29139 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:49:00.538679 29139 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:49:00.543807 29149 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:00.543820 29151 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:00.543820 29146 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:49:00.544380 29139 server_base.cc:1034] running on GCE node
I20260808 14:49:00.544591 29139 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:49:00.544833 29139 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:49:00.545981 29139 hybrid_clock.cc:648] HybridClock initialized: now 1786200540545965 us; error 33 us; skew 500 ppm
I20260808 14:49:00.547644 29139 webserver.cc:460] Webserver started at http://127.30.214.129:45299/ using document root <none> and password file <none>
I20260808 14:49:00.548038 29139 fs_manager.cc:359] Metadata directory not provided
I20260808 14:49:00.548095 29139 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:49:00.548233 29139 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:49:00.549350 29139 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200295877777-31578-0/minicluster-data/ts-0/data/instance:
uuid: "d1563178a6894622b2cb02a3514e64d1"
format_stamp: "Formatted at 2026-08-08 14:49:00 on dist-test-slave-42z9"
server_key: "edc9151676e9e179bc61a4c4a9dfcccb"
server_key_iv: "d837afa74187d44bd25a97fead0965c7"
server_key_version: "encryptionkey@0"
I20260808 14:49:00.549770 29139 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200295877777-31578-0/minicluster-data/ts-0/wal/instance:
uuid: "d1563178a6894622b2cb02a3514e64d1"
format_stamp: "Formatted at 2026-08-08 14:49:00 on dist-test-slave-42z9"
server_key: "edc9151676e9e179bc61a4c4a9dfcccb"
server_key_iv: "d837afa74187d44bd25a97fead0965c7"
server_key_version: "encryptionkey@0"
I20260808 14:49:00.551132 29139 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:49:00.551868 29161 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:49:00.552057 29139 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:49:00.552165 29139 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200295877777-31578-0/minicluster-data/ts-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200295877777-31578-0/minicluster-data/ts-0/wal
uuid: "d1563178a6894622b2cb02a3514e64d1"
format_stamp: "Formatted at 2026-08-08 14:49:00 on dist-test-slave-42z9"
server_key: "edc9151676e9e179bc61a4c4a9dfcccb"
server_key_iv: "d837afa74187d44bd25a97fead0965c7"
server_key_version: "encryptionkey@0"
I20260808 14:49:00.552242 29139 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200295877777-31578-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200295877777-31578-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200295877777-31578-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:49:00.622743 29139 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:49:00.623066 29139 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:49:00.623173 29139 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:49:00.623389 29139 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:49:00.623752 29139 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:49:00.623788 29139 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:49:00.623814 29139 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:49:00.623837 29139 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:49:00.629630 29139 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.129:43687
I20260808 14:49:00.629691 29331 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.129:43687 every 8 connection(s)
I20260808 14:49:00.630053 29139 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200295877777-31578-0/minicluster-data/ts-0/data/info.pb
I20260808 14:49:00.635087 29107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:00.630771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.129:51493 (local address 127.30.214.190:44981)
0808 14:49:00.630823 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:00.630825 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:00.631057 (+ 232us) server_negotiation.cc:407] Connection header received
0808 14:49:00.631575 (+ 518us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:00.631576 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:00.631588 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:00.631632 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:00.632292 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:00.632799 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:00.633842 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:00.634040 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:00.634103 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:00.634882 (+ 779us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:00.634883 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:00.634883 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:49:00.634887 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:00.634898 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:49:00.634901 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:00.634934 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:00.635002 (+ 68us) server_negotiation.cc:299] Negotiation successful
0808 14:49:00.635026 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 14:49:00.635282 29335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:00.630734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:44981 (local address 127.30.214.129:51493)
0808 14:49:00.630936 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:00.630978 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 14:49:00.631468 (+ 490us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:49:00.631702 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:49:00.631706 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:49:00.631714 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:49:00.632209 (+ 495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:00.632213 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:00.632876 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:00.632877 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:00.633739 (+ 862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:00.633742 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:00.634112 (+ 370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:00.634113 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:00.634220 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:00.634758 (+ 538us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:49:00.634759 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:49:00.634789 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:49:00.634813 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:49:00.634945 (+ 132us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:49:00.634948 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:49:00.634951 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:49:00.634998 (+ 47us) client_negotiation.cc:240] Negotiation successful
0808 14:49:00.635080 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":86,"threads_started":1}
I20260808 14:49:00.635771 29332 heartbeater.cc:347] Connected to a master server at 127.30.214.190:44981
I20260808 14:49:00.635871 29332 heartbeater.cc:464] Registering TS with master...
I20260808 14:49:00.636061 29332 heartbeater.cc:511] Master 127.30.214.190:44981 requested a full tablet report, sending...
I20260808 14:49:00.636543 29039 ts_manager.cc:194] Registered new tserver with Master: d1563178a6894622b2cb02a3514e64d1 (127.30.214.129:43687)
I20260808 14:49:00.637140 29039 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.30.214.129:51493
I20260808 14:49:00.637406 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 29139
I20260808 14:49:00.637535 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200295877777-31578-0/minicluster-data/ts-0/wal/instance
I20260808 14:49:00.637737 31578 external_mini_cluster.cc:1428] Setting key c7e33f3c5cc3cb53964b8eee83f5e6e1
I20260808 14:49:00.638625 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200295877777-31578-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200295877777-31578-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200295877777-31578-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.130:0
--local_ip_for_outbound_sockets=127.30.214.130
--webserver_interface=127.30.214.130
--webserver_port=0
--tserver_master_addrs=127.30.214.190:44981
--builtin_ntp_servers=127.30.214.148:41519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 14:49:00.725646 29336 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:49:00.725941 29336 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:49:00.725979 29336 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:49:00.727813 29336 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:49:00.727886 29336 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:49:00.727931 29336 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.130
I20260808 14:49:00.730451 29336 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:41519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200295877777-31578-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200295877777-31578-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.214.130
--webserver_port=0
--tserver_master_addrs=127.30.214.190:44981
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29336
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.130
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200295877777-31578-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:49:00.730809 29336 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:49:00.731268 29336 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:49:00.738736 29344 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:00.738736 29345 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:00.738816 29348 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:49:00.738986 29336 server_base.cc:1034] running on GCE node
I20260808 14:49:00.739287 29336 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:49:00.739609 29336 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:49:00.740770 29336 hybrid_clock.cc:648] HybridClock initialized: now 1786200540740752 us; error 34 us; skew 500 ppm
I20260808 14:49:00.742214 29336 webserver.cc:460] Webserver started at http://127.30.214.130:36891/ using document root <none> and password file <none>
I20260808 14:49:00.742532 29336 fs_manager.cc:359] Metadata directory not provided
I20260808 14:49:00.742596 29336 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:49:00.742744 29336 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:49:00.744164 29336 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200295877777-31578-0/minicluster-data/ts-1/data/instance:
uuid: "37bf8122d6a54e30b0082334a80802c5"
format_stamp: "Formatted at 2026-08-08 14:49:00 on dist-test-slave-42z9"
server_key: "1aef3515b41c313182c9f797ff43901c"
server_key_iv: "d8c7d08d0cd15a90beb4698b7bf0456b"
server_key_version: "encryptionkey@0"
I20260808 14:49:00.744544 29336 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200295877777-31578-0/minicluster-data/ts-1/wal/instance:
uuid: "37bf8122d6a54e30b0082334a80802c5"
format_stamp: "Formatted at 2026-08-08 14:49:00 on dist-test-slave-42z9"
server_key: "1aef3515b41c313182c9f797ff43901c"
server_key_iv: "d8c7d08d0cd15a90beb4698b7bf0456b"
server_key_version: "encryptionkey@0"
I20260808 14:49:00.746508 29336 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260808 14:49:00.747298 29357 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:49:00.747491 29336 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:49:00.747591 29336 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200295877777-31578-0/minicluster-data/ts-1/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200295877777-31578-0/minicluster-data/ts-1/wal
uuid: "37bf8122d6a54e30b0082334a80802c5"
format_stamp: "Formatted at 2026-08-08 14:49:00 on dist-test-slave-42z9"
server_key: "1aef3515b41c313182c9f797ff43901c"
server_key_iv: "d8c7d08d0cd15a90beb4698b7bf0456b"
server_key_version: "encryptionkey@0"
I20260808 14:49:00.747681 29336 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200295877777-31578-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200295877777-31578-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200295877777-31578-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:49:00.763516 29336 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:49:00.763861 29336 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:49:00.763999 29336 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:49:00.764243 29336 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:49:00.764648 29336 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:49:00.764690 29336 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:49:00.764725 29336 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:49:00.764744 29336 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:49:00.770871 29336 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.130:39551
I20260808 14:49:00.770915 29514 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.130:39551 every 8 connection(s)
I20260808 14:49:00.771258 29336 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200295877777-31578-0/minicluster-data/ts-1/data/info.pb
I20260808 14:49:00.776238 29107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:00.772033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.130:50173 (local address 127.30.214.190:44981)
0808 14:49:00.772116 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:00.772118 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:00.772325 (+ 207us) server_negotiation.cc:407] Connection header received
0808 14:49:00.772800 (+ 475us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:00.772801 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:00.772811 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:00.772861 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:00.773615 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:00.774102 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:00.775047 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:00.775223 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:00.775267 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:00.776019 (+ 752us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:00.776020 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:00.776021 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:49:00.776025 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:00.776039 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:49:00.776043 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:00.776084 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:00.776146 (+ 62us) server_negotiation.cc:299] Negotiation successful
0808 14:49:00.776173 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 14:49:00.776440 29518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:00.771993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:44981 (local address 127.30.214.130:50173)
0808 14:49:00.772209 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:00.772245 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 14:49:00.772721 (+ 476us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:49:00.772926 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:49:00.772929 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:49:00.772938 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:49:00.773515 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:00.773522 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:00.774174 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:00.774175 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:00.774985 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:00.774987 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:00.775280 (+ 293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:00.775281 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:00.775389 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:00.775877 (+ 488us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:49:00.775878 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:49:00.775916 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:49:00.775939 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:49:00.776090 (+ 151us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:49:00.776093 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:49:00.776095 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 14:49:00.776141 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 14:49:00.776223 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":85,"threads_started":1}
I20260808 14:49:00.776773 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 29336
I20260808 14:49:00.776894 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200295877777-31578-0/minicluster-data/ts-1/wal/instance
I20260808 14:49:00.776961 29516 heartbeater.cc:347] Connected to a master server at 127.30.214.190:44981
I20260808 14:49:00.777063 29516 heartbeater.cc:464] Registering TS with master...
I20260808 14:49:00.777112 31578 external_mini_cluster.cc:1428] Setting key 30c51f3f9e361b1ba8e3ddbdd569ba36
I20260808 14:49:00.777269 29516 heartbeater.cc:511] Master 127.30.214.190:44981 requested a full tablet report, sending...
I20260808 14:49:00.777705 29038 ts_manager.cc:194] Registered new tserver with Master: 37bf8122d6a54e30b0082334a80802c5 (127.30.214.130:39551)
I20260808 14:49:00.778050 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200295877777-31578-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200295877777-31578-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200295877777-31578-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.214.131:0
--local_ip_for_outbound_sockets=127.30.214.131
--webserver_interface=127.30.214.131
--webserver_port=0
--tserver_master_addrs=127.30.214.190:44981
--builtin_ntp_servers=127.30.214.148:41519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 14:49:00.778091 29038 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.30.214.130:50173
W20260808 14:49:00.861215 29520 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:49:00.861467 29520 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:49:00.861502 29520 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:49:00.862680 29520 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:49:00.862723 29520 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:49:00.862757 29520 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.214.131
I20260808 14:49:00.864162 29520 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:41519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200295877777-31578-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200295877777-31578-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.214.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.214.131
--webserver_port=0
--tserver_master_addrs=127.30.214.190:44981
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29520
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.214.131
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200295877777-31578-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:49:00.864424 29520 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:49:00.864730 29520 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 14:49:00.870137 29520 server_base.cc:1034] running on GCE node
W20260808 14:49:00.870151 29529 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:00.870174 29543 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:00.870281 29533 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:49:00.870579 29520 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:49:00.870819 29520 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:49:00.871969 29520 hybrid_clock.cc:648] HybridClock initialized: now 1786200540871956 us; error 28 us; skew 500 ppm
I20260808 14:49:00.873283 29520 webserver.cc:460] Webserver started at http://127.30.214.131:41171/ using document root <none> and password file <none>
I20260808 14:49:00.873579 29520 fs_manager.cc:359] Metadata directory not provided
I20260808 14:49:00.873636 29520 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:49:00.873776 29520 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:49:00.874864 29520 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200295877777-31578-0/minicluster-data/ts-2/data/instance:
uuid: "018f0ea02d1a41afba241785cb702eb5"
format_stamp: "Formatted at 2026-08-08 14:49:00 on dist-test-slave-42z9"
server_key: "2366bf52afdf03f650a18b62f9e47fe1"
server_key_iv: "eea11bb4503c700734ffbf192ba06eb9"
server_key_version: "encryptionkey@0"
I20260808 14:49:00.875219 29520 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200295877777-31578-0/minicluster-data/ts-2/wal/instance:
uuid: "018f0ea02d1a41afba241785cb702eb5"
format_stamp: "Formatted at 2026-08-08 14:49:00 on dist-test-slave-42z9"
server_key: "2366bf52afdf03f650a18b62f9e47fe1"
server_key_iv: "eea11bb4503c700734ffbf192ba06eb9"
server_key_version: "encryptionkey@0"
I20260808 14:49:00.876513 29520 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:49:00.877187 29550 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:49:00.877359 29520 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:49:00.877468 29520 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200295877777-31578-0/minicluster-data/ts-2/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200295877777-31578-0/minicluster-data/ts-2/wal
uuid: "018f0ea02d1a41afba241785cb702eb5"
format_stamp: "Formatted at 2026-08-08 14:49:00 on dist-test-slave-42z9"
server_key: "2366bf52afdf03f650a18b62f9e47fe1"
server_key_iv: "eea11bb4503c700734ffbf192ba06eb9"
server_key_version: "encryptionkey@0"
I20260808 14:49:00.877544 29520 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200295877777-31578-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200295877777-31578-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200295877777-31578-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:49:00.909368 29520 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:49:00.909744 29520 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:49:00.909888 29520 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:49:00.910126 29520 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:49:00.910468 29520 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:49:00.910506 29520 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:49:00.910537 29520 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:49:00.910553 29520 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:49:00.916795 29520 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.131:46639
I20260808 14:49:00.916908 29727 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.131:46639 every 8 connection(s)
I20260808 14:49:00.917204 29520 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200295877777-31578-0/minicluster-data/ts-2/data/info.pb
I20260808 14:49:00.923640 29107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:00.917996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.131:47521 (local address 127.30.214.190:44981)
0808 14:49:00.918071 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:00.918074 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:00.918330 (+ 256us) server_negotiation.cc:407] Connection header received
0808 14:49:00.919018 (+ 688us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:00.919019 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:00.919032 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:00.919102 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:00.920048 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:00.920556 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:00.922119 (+ 1563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:00.922352 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:00.922407 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:00.923372 (+ 965us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:00.923373 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:00.923373 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:49:00.923379 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:00.923394 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:49:00.923397 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:00.923437 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:00.923540 (+ 103us) server_negotiation.cc:299] Negotiation successful
0808 14:49:00.923571 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 14:49:00.923969 29733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:00.917965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:44981 (local address 127.30.214.131:47521)
0808 14:49:00.918176 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:00.918226 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 14:49:00.918879 (+ 653us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:49:00.919183 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:49:00.919187 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:49:00.919199 (+ 12us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:49:00.919944 (+ 745us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:00.919952 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:00.920660 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:00.920661 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:00.922029 (+ 1368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:00.922032 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:00.922445 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:00.922446 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:00.922619 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:00.923198 (+ 579us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:49:00.923198 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:49:00.923242 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:49:00.923276 (+ 34us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:49:00.923461 (+ 185us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:49:00.923466 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:49:00.923469 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:49:00.923536 (+ 67us) client_negotiation.cc:240] Negotiation successful
0808 14:49:00.923655 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":96,"threads_started":1}
I20260808 14:49:00.924364 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 29520
I20260808 14:49:00.924468 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200295877777-31578-0/minicluster-data/ts-2/wal/instance
I20260808 14:49:00.924664 31578 external_mini_cluster.cc:1428] Setting key 094c957885f529dc7a8ba148d3ce55cb
I20260808 14:49:00.924640 29729 heartbeater.cc:347] Connected to a master server at 127.30.214.190:44981
I20260808 14:49:00.924734 29729 heartbeater.cc:464] Registering TS with master...
I20260808 14:49:00.924952 29729 heartbeater.cc:511] Master 127.30.214.190:44981 requested a full tablet report, sending...
I20260808 14:49:00.925336 29039 ts_manager.cc:194] Registered new tserver with Master: 018f0ea02d1a41afba241785cb702eb5 (127.30.214.131:46639)
I20260808 14:49:00.925788 29039 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.30.214.131:47521
I20260808 14:49:00.936439 31578 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:49:00.941401 29107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:00.938075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50116 (local address 127.30.214.190:44981)
0808 14:49:00.938140 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:00.938142 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:00.938212 (+ 70us) server_negotiation.cc:407] Connection header received
0808 14:49:00.938265 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:00.938265 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:00.938277 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:00.938329 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:00.938491 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:00.939017 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:00.940072 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:00.940357 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:00.940394 (+ 37us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:00.941143 (+ 749us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:00.941145 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:00.941145 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:49:00.941151 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:00.941165 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:49:00.941170 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:00.941195 (+ 25us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:00.941282 (+ 87us) server_negotiation.cc:299] Negotiation successful
0808 14:49:00.941313 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 14:49:00.947576 29039 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50116:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:49:00.949753 29039 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:49:00.956921 29745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:00.952152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.130:39551 (local address 127.0.0.1:37188)
0808 14:49:00.952281 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:00.952322 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 14:49:00.952387 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:49:00.953154 (+ 767us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:49:00.953154 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:49:00.953156 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:49:00.953187 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:00.953188 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:00.954420 (+ 1232us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:00.954421 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:00.955617 (+ 1196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:00.955620 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:00.956591 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:00.956592 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:00.956688 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:00.956703 (+ 15us) client_negotiation.cc:769] Sending connection context
0808 14:49:00.956775 (+ 72us) client_negotiation.cc:240] Negotiation successful
0808 14:49:00.956832 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":71,"threads_started":1}
I20260808 14:49:00.957221 29752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:00.952752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37188 (local address 127.30.214.130:39551)
0808 14:49:00.952981 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:00.952985 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:00.952994 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:49:00.953031 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:00.953033 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:00.953047 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:00.953154 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:49:00.953250 (+ 96us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:00.954326 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:00.955724 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:00.956484 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:00.956572 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:00.956667 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:00.956858 (+ 191us) server_negotiation.cc:299] Negotiation successful
0808 14:49:00.956903 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":199,"thread_start_us":103,"threads_started":1}
I20260808 14:49:00.957320 29749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:00.952377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.131:46639 (local address 127.0.0.1:34312)
0808 14:49:00.952489 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:00.952498 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 14:49:00.952552 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:49:00.952903 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:49:00.952906 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:49:00.952909 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:49:00.952988 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:00.952990 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:00.954330 (+ 1340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:00.954331 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:00.955538 (+ 1207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:00.955541 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:00.957128 (+ 1587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:00.957129 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:00.957205 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:00.957209 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:49:00.957239 (+ 30us) client_negotiation.cc:240] Negotiation successful
0808 14:49:00.957271 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":96,"mutex_wait_us":49,"thread_start_us":71,"threads_started":1}
I20260808 14:49:00.957676 29750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:00.952520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34312 (local address 127.30.214.131:46639)
0808 14:49:00.952708 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:00.952713 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:00.952724 (+ 11us) server_negotiation.cc:407] Connection header received
0808 14:49:00.952766 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:00.952768 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:00.952782 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:00.952873 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:49:00.953053 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:00.954244 (+ 1191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:00.956018 (+ 1774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:00.956548 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:00.957410 (+ 862us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:00.957541 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:00.957567 (+ 26us) server_negotiation.cc:299] Negotiation successful
0808 14:49:00.957611 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":96,"threads_started":1}
I20260808 14:49:00.958163 29748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:00.952152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.129:43687 (local address 127.0.0.1:35856)
0808 14:49:00.952334 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:00.952344 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:49:00.952395 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:49:00.953105 (+ 710us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:49:00.953106 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:49:00.953108 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:49:00.953155 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:00.953156 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:00.954134 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:00.954135 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:00.955538 (+ 1403us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:00.955541 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:00.957951 (+ 2410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:00.957952 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:00.958015 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:00.958020 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 14:49:00.958052 (+ 32us) client_negotiation.cc:240] Negotiation successful
0808 14:49:00.958097 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"mutex_wait_us":51,"thread_start_us":110,"threads_started":1}
I20260808 14:49:00.958475 29751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:00.952533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35856 (local address 127.30.214.129:43687)
0808 14:49:00.952726 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:00.952731 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:00.952742 (+ 11us) server_negotiation.cc:407] Connection header received
0808 14:49:00.952775 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:00.952777 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:00.952809 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:00.953230 (+ 421us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:49:00.953290 (+ 60us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:00.954045 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:00.955655 (+ 1610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:00.957853 (+ 2198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:00.958272 (+ 419us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:00.958355 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:00.958378 (+ 23us) server_negotiation.cc:299] Negotiation successful
0808 14:49:00.958411 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":115,"threads_started":1}
I20260808 14:49:00.958455 29632 tablet_service.cc:1467] Processing CreateTablet for tablet f0b2f69cd53f4b7fad5c671d10e2f759 (DEFAULT_TABLE table=test-table [id=82385bf5d4794b9a9ddc92be7728852b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:49:00.958458 29428 tablet_service.cc:1467] Processing CreateTablet for tablet f0b2f69cd53f4b7fad5c671d10e2f759 (DEFAULT_TABLE table=test-table [id=82385bf5d4794b9a9ddc92be7728852b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:49:00.958848 29428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f0b2f69cd53f4b7fad5c671d10e2f759. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:49:00.958848 29632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f0b2f69cd53f4b7fad5c671d10e2f759. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:49:00.962515 29755 tablet_bootstrap.cc:492] T f0b2f69cd53f4b7fad5c671d10e2f759 P 018f0ea02d1a41afba241785cb702eb5: Bootstrap starting.
I20260808 14:49:00.963256 29755 tablet_bootstrap.cc:654] T f0b2f69cd53f4b7fad5c671d10e2f759 P 018f0ea02d1a41afba241785cb702eb5: Neither blocks nor log segments found. Creating new log.
I20260808 14:49:00.963186 29229 tablet_service.cc:1467] Processing CreateTablet for tablet f0b2f69cd53f4b7fad5c671d10e2f759 (DEFAULT_TABLE table=test-table [id=82385bf5d4794b9a9ddc92be7728852b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:49:00.963574 29229 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f0b2f69cd53f4b7fad5c671d10e2f759. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:49:00.963573 29755 log.cc:824] T f0b2f69cd53f4b7fad5c671d10e2f759 P 018f0ea02d1a41afba241785cb702eb5: Log is configured to *not* fsync() on all Append() calls
I20260808 14:49:00.964414 29755 tablet_bootstrap.cc:492] T f0b2f69cd53f4b7fad5c671d10e2f759 P 018f0ea02d1a41afba241785cb702eb5: No bootstrap required, opened a new log
I20260808 14:49:00.964479 29755 ts_tablet_manager.cc:1397] T f0b2f69cd53f4b7fad5c671d10e2f759 P 018f0ea02d1a41afba241785cb702eb5: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:49:00.966234 29762 tablet_bootstrap.cc:492] T f0b2f69cd53f4b7fad5c671d10e2f759 P d1563178a6894622b2cb02a3514e64d1: Bootstrap starting.
I20260808 14:49:00.966926 29762 tablet_bootstrap.cc:654] T f0b2f69cd53f4b7fad5c671d10e2f759 P d1563178a6894622b2cb02a3514e64d1: Neither blocks nor log segments found. Creating new log.
I20260808 14:49:00.967095 29759 tablet_bootstrap.cc:492] T f0b2f69cd53f4b7fad5c671d10e2f759 P 37bf8122d6a54e30b0082334a80802c5: Bootstrap starting.
I20260808 14:49:00.967098 29755 raft_consensus.cc:348] T f0b2f69cd53f4b7fad5c671d10e2f759 P 018f0ea02d1a41afba241785cb702eb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1563178a6894622b2cb02a3514e64d1" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 43687 } } peers { permanent_uuid: "37bf8122d6a54e30b0082334a80802c5" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 39551 } } peers { permanent_uuid: "018f0ea02d1a41afba241785cb702eb5" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 46639 } }
I20260808 14:49:00.967267 29762 log.cc:824] T f0b2f69cd53f4b7fad5c671d10e2f759 P d1563178a6894622b2cb02a3514e64d1: Log is configured to *not* fsync() on all Append() calls
I20260808 14:49:00.967295 29755 raft_consensus.cc:374] T f0b2f69cd53f4b7fad5c671d10e2f759 P 018f0ea02d1a41afba241785cb702eb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:49:00.967331 29755 raft_consensus.cc:729] T f0b2f69cd53f4b7fad5c671d10e2f759 P 018f0ea02d1a41afba241785cb702eb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 018f0ea02d1a41afba241785cb702eb5, State: Initialized, Role: FOLLOWER
I20260808 14:49:00.967473 29755 consensus_queue.cc:260] T f0b2f69cd53f4b7fad5c671d10e2f759 P 018f0ea02d1a41afba241785cb702eb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1563178a6894622b2cb02a3514e64d1" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 43687 } } peers { permanent_uuid: "37bf8122d6a54e30b0082334a80802c5" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 39551 } } peers { permanent_uuid: "018f0ea02d1a41afba241785cb702eb5" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 46639 } }
I20260808 14:49:00.967769 29755 ts_tablet_manager.cc:1428] T f0b2f69cd53f4b7fad5c671d10e2f759 P 018f0ea02d1a41afba241785cb702eb5: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260808 14:49:00.968029 29762 tablet_bootstrap.cc:492] T f0b2f69cd53f4b7fad5c671d10e2f759 P d1563178a6894622b2cb02a3514e64d1: No bootstrap required, opened a new log
I20260808 14:49:00.968109 29762 ts_tablet_manager.cc:1397] T f0b2f69cd53f4b7fad5c671d10e2f759 P d1563178a6894622b2cb02a3514e64d1: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:49:00.968253 29759 tablet_bootstrap.cc:654] T f0b2f69cd53f4b7fad5c671d10e2f759 P 37bf8122d6a54e30b0082334a80802c5: Neither blocks nor log segments found. Creating new log.
I20260808 14:49:00.968321 29729 heartbeater.cc:503] Master 127.30.214.190:44981 was elected leader, sending a full tablet report...
I20260808 14:49:00.968685 29759 log.cc:824] T f0b2f69cd53f4b7fad5c671d10e2f759 P 37bf8122d6a54e30b0082334a80802c5: Log is configured to *not* fsync() on all Append() calls
I20260808 14:49:00.969542 29759 tablet_bootstrap.cc:492] T f0b2f69cd53f4b7fad5c671d10e2f759 P 37bf8122d6a54e30b0082334a80802c5: No bootstrap required, opened a new log
I20260808 14:49:00.969625 29759 ts_tablet_manager.cc:1397] T f0b2f69cd53f4b7fad5c671d10e2f759 P 37bf8122d6a54e30b0082334a80802c5: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 14:49:00.970767 29762 raft_consensus.cc:348] T f0b2f69cd53f4b7fad5c671d10e2f759 P d1563178a6894622b2cb02a3514e64d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1563178a6894622b2cb02a3514e64d1" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 43687 } } peers { permanent_uuid: "37bf8122d6a54e30b0082334a80802c5" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 39551 } } peers { permanent_uuid: "018f0ea02d1a41afba241785cb702eb5" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 46639 } }
I20260808 14:49:00.970958 29762 raft_consensus.cc:374] T f0b2f69cd53f4b7fad5c671d10e2f759 P d1563178a6894622b2cb02a3514e64d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:49:00.971009 29762 raft_consensus.cc:729] T f0b2f69cd53f4b7fad5c671d10e2f759 P d1563178a6894622b2cb02a3514e64d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1563178a6894622b2cb02a3514e64d1, State: Initialized, Role: FOLLOWER
I20260808 14:49:00.971140 29762 consensus_queue.cc:260] T f0b2f69cd53f4b7fad5c671d10e2f759 P d1563178a6894622b2cb02a3514e64d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1563178a6894622b2cb02a3514e64d1" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 43687 } } peers { permanent_uuid: "37bf8122d6a54e30b0082334a80802c5" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 39551 } } peers { permanent_uuid: "018f0ea02d1a41afba241785cb702eb5" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 46639 } }
I20260808 14:49:00.971415 29762 ts_tablet_manager.cc:1428] T f0b2f69cd53f4b7fad5c671d10e2f759 P d1563178a6894622b2cb02a3514e64d1: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 14:49:00.971539 29332 heartbeater.cc:503] Master 127.30.214.190:44981 was elected leader, sending a full tablet report...
I20260808 14:49:00.972111 29759 raft_consensus.cc:348] T f0b2f69cd53f4b7fad5c671d10e2f759 P 37bf8122d6a54e30b0082334a80802c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1563178a6894622b2cb02a3514e64d1" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 43687 } } peers { permanent_uuid: "37bf8122d6a54e30b0082334a80802c5" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 39551 } } peers { permanent_uuid: "018f0ea02d1a41afba241785cb702eb5" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 46639 } }
I20260808 14:49:00.972276 29759 raft_consensus.cc:374] T f0b2f69cd53f4b7fad5c671d10e2f759 P 37bf8122d6a54e30b0082334a80802c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:49:00.972321 29759 raft_consensus.cc:729] T f0b2f69cd53f4b7fad5c671d10e2f759 P 37bf8122d6a54e30b0082334a80802c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37bf8122d6a54e30b0082334a80802c5, State: Initialized, Role: FOLLOWER
I20260808 14:49:00.972453 29759 consensus_queue.cc:260] T f0b2f69cd53f4b7fad5c671d10e2f759 P 37bf8122d6a54e30b0082334a80802c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1563178a6894622b2cb02a3514e64d1" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 43687 } } peers { permanent_uuid: "37bf8122d6a54e30b0082334a80802c5" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 39551 } } peers { permanent_uuid: "018f0ea02d1a41afba241785cb702eb5" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 46639 } }
I20260808 14:49:00.972752 29759 ts_tablet_manager.cc:1428] T f0b2f69cd53f4b7fad5c671d10e2f759 P 37bf8122d6a54e30b0082334a80802c5: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 14:49:00.972856 29516 heartbeater.cc:503] Master 127.30.214.190:44981 was elected leader, sending a full tablet report...
W20260808 14:49:01.021838 29517 tablet.cc:2369] T f0b2f69cd53f4b7fad5c671d10e2f759 P 37bf8122d6a54e30b0082334a80802c5: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:49:01.130771 29334 tablet.cc:2369] T f0b2f69cd53f4b7fad5c671d10e2f759 P d1563178a6894622b2cb02a3514e64d1: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:49:01.167888 29730 tablet.cc:2369] T f0b2f69cd53f4b7fad5c671d10e2f759 P 018f0ea02d1a41afba241785cb702eb5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:49:01.175580 29768 raft_consensus.cc:482] T f0b2f69cd53f4b7fad5c671d10e2f759 P 37bf8122d6a54e30b0082334a80802c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:49:01.175743 29768 raft_consensus.cc:504] T f0b2f69cd53f4b7fad5c671d10e2f759 P 37bf8122d6a54e30b0082334a80802c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1563178a6894622b2cb02a3514e64d1" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 43687 } } peers { permanent_uuid: "37bf8122d6a54e30b0082334a80802c5" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 39551 } } peers { permanent_uuid: "018f0ea02d1a41afba241785cb702eb5" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 46639 } }
I20260808 14:49:01.176126 29768 leader_election.cc:288] T f0b2f69cd53f4b7fad5c671d10e2f759 P 37bf8122d6a54e30b0082334a80802c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1563178a6894622b2cb02a3514e64d1 (127.30.214.129:43687), 018f0ea02d1a41afba241785cb702eb5 (127.30.214.131:46639)
I20260808 14:49:01.178996 29751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:01.176431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.130:42587 (local address 127.30.214.129:43687)
0808 14:49:01.176491 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:01.176493 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:01.176504 (+ 11us) server_negotiation.cc:407] Connection header received
0808 14:49:01.176617 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:01.176618 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:01.176633 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:01.176675 (+ 42us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:49:01.176840 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:01.177319 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:01.178298 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:01.178667 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:01.178729 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:01.178738 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:01.178874 (+ 136us) server_negotiation.cc:299] Negotiation successful
0808 14:49:01.178918 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 14:49:01.179021 29518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:01.176341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.129:43687 (local address 127.30.214.130:42587)
0808 14:49:01.176421 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:01.176433 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:49:01.176504 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:49:01.176697 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:49:01.176698 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:49:01.176700 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:49:01.176771 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:01.176773 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:01.177398 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:01.177399 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:01.178202 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:01.178204 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:01.178749 (+ 545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:01.178750 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:01.178810 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:01.178813 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:49:01.178858 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 14:49:01.178918 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54}
I20260808 14:49:01.179059 29750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:01.176605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.214.130:33467 (local address 127.30.214.131:46639)
0808 14:49:01.176676 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:01.176678 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:01.176688 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:49:01.176768 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:01.176769 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:01.176779 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:01.176826 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:49:01.176977 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:01.177472 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:01.178359 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:01.178724 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:01.178787 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:01.178795 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:01.178951 (+ 156us) server_negotiation.cc:299] Negotiation successful
0808 14:49:01.178992 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 14:49:01.179260 29771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:01.176461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.131:46639 (local address 127.30.214.130:33467)
0808 14:49:01.176625 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:01.176635 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:49:01.176694 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:49:01.176836 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:49:01.176837 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:49:01.176838 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:49:01.176917 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:01.176918 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:01.177536 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:01.177537 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:01.178269 (+ 732us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:01.178271 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:01.178803 (+ 532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:01.178804 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:01.178885 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:01.178888 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:49:01.178934 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 14:49:01.178971 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":108,"threads_started":1}
I20260808 14:49:01.179380 29264 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0b2f69cd53f4b7fad5c671d10e2f759" candidate_uuid: "37bf8122d6a54e30b0082334a80802c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1563178a6894622b2cb02a3514e64d1" is_pre_election: true
I20260808 14:49:01.179533 29264 raft_consensus.cc:2454] T f0b2f69cd53f4b7fad5c671d10e2f759 P d1563178a6894622b2cb02a3514e64d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37bf8122d6a54e30b0082334a80802c5 in term 0.
I20260808 14:49:01.179719 29660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0b2f69cd53f4b7fad5c671d10e2f759" candidate_uuid: "37bf8122d6a54e30b0082334a80802c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018f0ea02d1a41afba241785cb702eb5" is_pre_election: true
I20260808 14:49:01.179755 29361 leader_election.cc:302] T f0b2f69cd53f4b7fad5c671d10e2f759 P 37bf8122d6a54e30b0082334a80802c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37bf8122d6a54e30b0082334a80802c5, d1563178a6894622b2cb02a3514e64d1; no voters:
I20260808 14:49:01.179849 29660 raft_consensus.cc:2454] T f0b2f69cd53f4b7fad5c671d10e2f759 P 018f0ea02d1a41afba241785cb702eb5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37bf8122d6a54e30b0082334a80802c5 in term 0.
I20260808 14:49:01.179889 29768 raft_consensus.cc:2781] T f0b2f69cd53f4b7fad5c671d10e2f759 P 37bf8122d6a54e30b0082334a80802c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:49:01.179962 29768 raft_consensus.cc:482] T f0b2f69cd53f4b7fad5c671d10e2f759 P 37bf8122d6a54e30b0082334a80802c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:49:01.179994 29768 raft_consensus.cc:3037] T f0b2f69cd53f4b7fad5c671d10e2f759 P 37bf8122d6a54e30b0082334a80802c5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:49:01.180778 29768 raft_consensus.cc:504] T f0b2f69cd53f4b7fad5c671d10e2f759 P 37bf8122d6a54e30b0082334a80802c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1563178a6894622b2cb02a3514e64d1" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 43687 } } peers { permanent_uuid: "37bf8122d6a54e30b0082334a80802c5" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 39551 } } peers { permanent_uuid: "018f0ea02d1a41afba241785cb702eb5" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 46639 } }
I20260808 14:49:01.180899 29768 leader_election.cc:288] T f0b2f69cd53f4b7fad5c671d10e2f759 P 37bf8122d6a54e30b0082334a80802c5 [CANDIDATE]: Term 1 election: Requested vote from peers d1563178a6894622b2cb02a3514e64d1 (127.30.214.129:43687), 018f0ea02d1a41afba241785cb702eb5 (127.30.214.131:46639)
I20260808 14:49:01.181059 29264 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0b2f69cd53f4b7fad5c671d10e2f759" candidate_uuid: "37bf8122d6a54e30b0082334a80802c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1563178a6894622b2cb02a3514e64d1"
I20260808 14:49:01.181073 29660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0b2f69cd53f4b7fad5c671d10e2f759" candidate_uuid: "37bf8122d6a54e30b0082334a80802c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018f0ea02d1a41afba241785cb702eb5"
I20260808 14:49:01.181141 29264 raft_consensus.cc:3037] T f0b2f69cd53f4b7fad5c671d10e2f759 P d1563178a6894622b2cb02a3514e64d1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:49:01.181150 29660 raft_consensus.cc:3037] T f0b2f69cd53f4b7fad5c671d10e2f759 P 018f0ea02d1a41afba241785cb702eb5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:49:01.181951 29264 raft_consensus.cc:2454] T f0b2f69cd53f4b7fad5c671d10e2f759 P d1563178a6894622b2cb02a3514e64d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37bf8122d6a54e30b0082334a80802c5 in term 1.
I20260808 14:49:01.181993 29660 raft_consensus.cc:2454] T f0b2f69cd53f4b7fad5c671d10e2f759 P 018f0ea02d1a41afba241785cb702eb5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37bf8122d6a54e30b0082334a80802c5 in term 1.
I20260808 14:49:01.182133 29361 leader_election.cc:302] T f0b2f69cd53f4b7fad5c671d10e2f759 P 37bf8122d6a54e30b0082334a80802c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37bf8122d6a54e30b0082334a80802c5, d1563178a6894622b2cb02a3514e64d1; no voters:
I20260808 14:49:01.182222 29768 raft_consensus.cc:2781] T f0b2f69cd53f4b7fad5c671d10e2f759 P 37bf8122d6a54e30b0082334a80802c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:49:01.182379 29768 raft_consensus.cc:686] T f0b2f69cd53f4b7fad5c671d10e2f759 P 37bf8122d6a54e30b0082334a80802c5 [term 1 LEADER]: Becoming Leader. State: Replica: 37bf8122d6a54e30b0082334a80802c5, State: Running, Role: LEADER
I20260808 14:49:01.182468 29768 consensus_queue.cc:237] T f0b2f69cd53f4b7fad5c671d10e2f759 P 37bf8122d6a54e30b0082334a80802c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1563178a6894622b2cb02a3514e64d1" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 43687 } } peers { permanent_uuid: "37bf8122d6a54e30b0082334a80802c5" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 39551 } } peers { permanent_uuid: "018f0ea02d1a41afba241785cb702eb5" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 46639 } }
I20260808 14:49:01.183336 29039 catalog_manager.cc:5495] T f0b2f69cd53f4b7fad5c671d10e2f759 P 37bf8122d6a54e30b0082334a80802c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 37bf8122d6a54e30b0082334a80802c5 (127.30.214.130). New cstate: current_term: 1 leader_uuid: "37bf8122d6a54e30b0082334a80802c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1563178a6894622b2cb02a3514e64d1" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 43687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37bf8122d6a54e30b0082334a80802c5" member_type: VOTER last_known_addr { host: "127.30.214.130" port: 39551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "018f0ea02d1a41afba241785cb702eb5" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 46639 } health_report { overall_health: UNKNOWN } } }
I20260808 14:49:01.189560 29752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:01.187570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37198 (local address 127.30.214.130:39551)
0808 14:49:01.187621 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:01.187623 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:01.187630 (+ 7us) server_negotiation.cc:407] Connection header received
0808 14:49:01.187657 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:01.187658 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:01.187675 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:01.187731 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:49:01.187837 (+ 106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:01.188288 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:01.188966 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:01.189141 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:01.189185 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:01.189284 (+ 99us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:49:01.189376 (+ 92us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:49:01.189429 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:01.189467 (+ 38us) server_negotiation.cc:299] Negotiation successful
0808 14:49:01.189489 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 14:49:01.191263 29660 raft_consensus.cc:1261] T f0b2f69cd53f4b7fad5c671d10e2f759 P 018f0ea02d1a41afba241785cb702eb5 [term 1 FOLLOWER]: Refusing update from remote peer 37bf8122d6a54e30b0082334a80802c5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:49:01.191294 29264 raft_consensus.cc:1261] T f0b2f69cd53f4b7fad5c671d10e2f759 P d1563178a6894622b2cb02a3514e64d1 [term 1 FOLLOWER]: Refusing update from remote peer 37bf8122d6a54e30b0082334a80802c5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:49:01.191610 29768 consensus_queue.cc:1035] T f0b2f69cd53f4b7fad5c671d10e2f759 P 37bf8122d6a54e30b0082334a80802c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1563178a6894622b2cb02a3514e64d1" member_type: VOTER last_known_addr { host: "127.30.214.129" port: 43687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:49:01.191754 29773 consensus_queue.cc:1035] T f0b2f69cd53f4b7fad5c671d10e2f759 P 37bf8122d6a54e30b0082334a80802c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018f0ea02d1a41afba241785cb702eb5" member_type: VOTER last_known_addr { host: "127.30.214.131" port: 46639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:49:01.194340 29776 mvcc.cc:205] Tried to move back new op lower bound from 7316277416716840960 to 7316277416683917312. Current Snapshot: MvccSnapshot[applied={T|T < 7316277416716840960}]
I20260808 14:49:01.194468 29777 mvcc.cc:205] Tried to move back new op lower bound from 7316277416716840960 to 7316277416683917312. Current Snapshot: MvccSnapshot[applied={T|T < 7316277416716840960}]
I20260808 14:49:01.196292 29038 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:50116:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:49:01.196383 29038 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:50116:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:49:01.197103 29038 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5bf0553d0f7c4678888ebe578a8da29f: Sending DeleteTablet for 3 replicas of tablet f0b2f69cd53f4b7fad5c671d10e2f759
I20260808 14:49:01.197410 29229 tablet_service.cc:1514] Processing DeleteTablet for tablet f0b2f69cd53f4b7fad5c671d10e2f759 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:49:01 UTC) from {username='slave'} at 127.0.0.1:35856
I20260808 14:49:01.197487 29632 tablet_service.cc:1514] Processing DeleteTablet for tablet f0b2f69cd53f4b7fad5c671d10e2f759 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:49:01 UTC) from {username='slave'} at 127.0.0.1:34312
I20260808 14:49:01.197557 29428 tablet_service.cc:1514] Processing DeleteTablet for tablet f0b2f69cd53f4b7fad5c671d10e2f759 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:49:01 UTC) from {username='slave'} at 127.0.0.1:37188
I20260808 14:49:01.197721 29793 tablet_replica.cc:330] T f0b2f69cd53f4b7fad5c671d10e2f759 P 018f0ea02d1a41afba241785cb702eb5: stopping tablet replica
I20260808 14:49:01.197829 29793 raft_consensus.cc:2229] T f0b2f69cd53f4b7fad5c671d10e2f759 P 018f0ea02d1a41afba241785cb702eb5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:49:01.197934 29793 raft_consensus.cc:2258] T f0b2f69cd53f4b7fad5c671d10e2f759 P 018f0ea02d1a41afba241785cb702eb5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:49:01.198041 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 29139
I20260808 14:49:01.200994 29793 ts_tablet_manager.cc:1905] T f0b2f69cd53f4b7fad5c671d10e2f759 P 018f0ea02d1a41afba241785cb702eb5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:49:01.202896 29793 ts_tablet_manager.cc:1918] T f0b2f69cd53f4b7fad5c671d10e2f759 P 018f0ea02d1a41afba241785cb702eb5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:49:01.202999 29793 log.cc:1196] T f0b2f69cd53f4b7fad5c671d10e2f759 P 018f0ea02d1a41afba241785cb702eb5: Deleting WAL directory at /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200295877777-31578-0/minicluster-data/ts-2/wal/wals/f0b2f69cd53f4b7fad5c671d10e2f759
I20260808 14:49:01.203281 29793 ts_tablet_manager.cc:1939] T f0b2f69cd53f4b7fad5c671d10e2f759 P 018f0ea02d1a41afba241785cb702eb5: Deleting consensus metadata
I20260808 14:49:01.205721 29017 catalog_manager.cc:4841] TS 018f0ea02d1a41afba241785cb702eb5 (127.30.214.131:46639): tablet f0b2f69cd53f4b7fad5c671d10e2f759 (table test-table [id=82385bf5d4794b9a9ddc92be7728852b]) successfully deleted
I20260808 14:49:01.205981 29794 tablet_replica.cc:330] T f0b2f69cd53f4b7fad5c671d10e2f759 P 37bf8122d6a54e30b0082334a80802c5: stopping tablet replica
I20260808 14:49:01.206107 29794 raft_consensus.cc:2229] T f0b2f69cd53f4b7fad5c671d10e2f759 P 37bf8122d6a54e30b0082334a80802c5 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:49:01.206255 29794 raft_consensus.cc:2258] T f0b2f69cd53f4b7fad5c671d10e2f759 P 37bf8122d6a54e30b0082334a80802c5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260808 14:49:01.211210 29017 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.30.214.129:43687 (error 108)
I20260808 14:49:01.211627 29794 ts_tablet_manager.cc:1905] T f0b2f69cd53f4b7fad5c671d10e2f759 P 37bf8122d6a54e30b0082334a80802c5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:49:01.211963 29748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:01.211801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.129:43687 (local address 127.0.0.1:35870)
0808 14:49:01.211871 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:01.211925 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.129:43687: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260808 14:49:01.212124 29017 catalog_manager.cc:4584] TS d1563178a6894622b2cb02a3514e64d1 (127.30.214.129:43687): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f0b2f69cd53f4b7fad5c671d10e2f759: Network error: Client connection negotiation failed: client connection to 127.30.214.129:43687: connect: Connection refused (error 111)
I20260808 14:49:01.213101 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 29336
I20260808 14:49:01.213229 29794 ts_tablet_manager.cc:1918] T f0b2f69cd53f4b7fad5c671d10e2f759 P 37bf8122d6a54e30b0082334a80802c5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:49:01.213304 29794 log.cc:1196] T f0b2f69cd53f4b7fad5c671d10e2f759 P 37bf8122d6a54e30b0082334a80802c5: Deleting WAL directory at /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786200295877777-31578-0/minicluster-data/ts-1/wal/wals/f0b2f69cd53f4b7fad5c671d10e2f759
I20260808 14:49:01.227778 29748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:01.227628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.130:39551 (local address 127.0.0.1:37206)
0808 14:49:01.227687 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:01.227725 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.130:39551: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260808 14:49:01.227808 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 29520
I20260808 14:49:01.239590 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 28996
2026-08-08T14:49:01Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (976 ms)
[----------] 6 tests from EncryptionPolicyTest (9011 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200295877777-31578-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:49:01 dist-test-slave-42z9 krb5kdc[29799](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:49:01 dist-test-slave-42z9 krb5kdc[29799](info): set up 2 sockets
Aug 08 14:49:01 dist-test-slave-42z9 krb5kdc[29799](info): commencing operation
krb5kdc: starting...
W20260808 14:49:02.388393 31578 mini_kdc.cc:121] Time spent starting KDC: real 1.120s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Aug 08 14:49:02 dist-test-slave-42z9 krb5kdc[29799](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200542, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:49:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:49:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200295877777-31578-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200295877777-31578-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 14:49:02.512071 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200295877777-31578-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200295877777-31578-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200295877777-31578-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36985
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200295877777-31578-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37999
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36985
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:49:02.595250 29816 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:49:02.595485 29816 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:49:02.595510 29816 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:49:02.596647 29816 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:49:02.596686 29816 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:49:02.596699 29816 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:49:02.596710 29816 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:49:02.596721 29816 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:49:02.598244 29816 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37999
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200295877777-31578-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200295877777-31578-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36985
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200295877777-31578-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36985
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29816
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200295877777-31578-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:49:02.598479 29816 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:49:02.598672 29816 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:49:02.603749 29827 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:02.603771 29825 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:02.603749 29824 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:49:02.603986 29816 server_base.cc:1034] running on GCE node
I20260808 14:49:02.604324 29816 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:49:02.604640 29816 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:49:02.605770 29816 hybrid_clock.cc:648] HybridClock initialized: now 1786200542605757 us; error 27 us; skew 500 ppm
Aug 08 14:49:02 dist-test-slave-42z9 krb5kdc[29799](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200542, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:49:02.612941 29816 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 14:49:02.613557 29816 webserver.cc:460] Webserver started at http://127.0.0.1:45113/ using document root <none> and password file <none>
I20260808 14:49:02.613802 29816 fs_manager.cc:359] Metadata directory not provided
I20260808 14:49:02.613849 29816 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:49:02.613989 29816 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:49:02.615119 29816 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200295877777-31578-0/minicluster-data/master-0/data/instance:
uuid: "2fd8a15e13a54923bf3b7f6c413928fe"
format_stamp: "Formatted at 2026-08-08 14:49:02 on dist-test-slave-42z9"
server_key: "e2c02f0d5864ccdafee2b81625f97149"
server_key_iv: "4f9c1ec9cb44986735aae5631c9c2241"
server_key_version: "encryptionkey@0"
I20260808 14:49:02.615485 29816 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200295877777-31578-0/minicluster-data/master-0/wal/instance:
uuid: "2fd8a15e13a54923bf3b7f6c413928fe"
format_stamp: "Formatted at 2026-08-08 14:49:02 on dist-test-slave-42z9"
server_key: "e2c02f0d5864ccdafee2b81625f97149"
server_key_iv: "4f9c1ec9cb44986735aae5631c9c2241"
server_key_version: "encryptionkey@0"
I20260808 14:49:02.616874 29816 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 14:49:02.617735 29837 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:49:02.617937 29816 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:49:02.618031 29816 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200295877777-31578-0/minicluster-data/master-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200295877777-31578-0/minicluster-data/master-0/wal
uuid: "2fd8a15e13a54923bf3b7f6c413928fe"
format_stamp: "Formatted at 2026-08-08 14:49:02 on dist-test-slave-42z9"
server_key: "e2c02f0d5864ccdafee2b81625f97149"
server_key_iv: "4f9c1ec9cb44986735aae5631c9c2241"
server_key_version: "encryptionkey@0"
I20260808 14:49:02.618105 29816 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200295877777-31578-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200295877777-31578-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200295877777-31578-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:49:02.629997 29816 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:49:02.631928 29816 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:49:02.632095 29816 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:49:02.636323 29816 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36985
I20260808 14:49:02.636369 29915 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36985 every 8 connection(s)
I20260808 14:49:02.636720 29816 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
I20260808 14:49:02.637890 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 29816
I20260808 14:49:02.638012 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786200295877777-31578-0/minicluster-data/master-0/wal/instance
I20260808 14:49:02.638139 29916 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:49:02.638242 31578 external_mini_cluster.cc:1428] Setting key c8ea0527724ee6f0d4c8923c0fd35b63
I20260808 14:49:02.641290 29916 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2fd8a15e13a54923bf3b7f6c413928fe: Bootstrap starting.
I20260808 14:49:02.641995 29916 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2fd8a15e13a54923bf3b7f6c413928fe: Neither blocks nor log segments found. Creating new log.
I20260808 14:49:02.642271 29916 log.cc:824] T 00000000000000000000000000000000 P 2fd8a15e13a54923bf3b7f6c413928fe: Log is configured to *not* fsync() on all Append() calls
I20260808 14:49:02.642952 29916 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2fd8a15e13a54923bf3b7f6c413928fe: No bootstrap required, opened a new log
Aug 08 14:49:02 dist-test-slave-42z9 krb5kdc[29799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200542, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 14:49:02.644994 29916 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2fd8a15e13a54923bf3b7f6c413928fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fd8a15e13a54923bf3b7f6c413928fe" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36985 } }
I20260808 14:49:02.645143 29916 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2fd8a15e13a54923bf3b7f6c413928fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:49:02.645175 29916 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2fd8a15e13a54923bf3b7f6c413928fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fd8a15e13a54923bf3b7f6c413928fe, State: Initialized, Role: FOLLOWER
I20260808 14:49:02.645313 29916 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2fd8a15e13a54923bf3b7f6c413928fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fd8a15e13a54923bf3b7f6c413928fe" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36985 } }
I20260808 14:49:02.645391 29916 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2fd8a15e13a54923bf3b7f6c413928fe [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:49:02.645432 29916 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2fd8a15e13a54923bf3b7f6c413928fe [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:49:02.645509 29916 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2fd8a15e13a54923bf3b7f6c413928fe [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:49:02.646148 29916 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2fd8a15e13a54923bf3b7f6c413928fe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fd8a15e13a54923bf3b7f6c413928fe" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36985 } }
I20260808 14:49:02.646262 29916 leader_election.cc:302] T 00000000000000000000000000000000 P 2fd8a15e13a54923bf3b7f6c413928fe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2fd8a15e13a54923bf3b7f6c413928fe; no voters:
I20260808 14:49:02.646441 29916 leader_election.cc:288] T 00000000000000000000000000000000 P 2fd8a15e13a54923bf3b7f6c413928fe [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:49:02.646492 29923 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2fd8a15e13a54923bf3b7f6c413928fe [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:49:02.646613 29923 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2fd8a15e13a54923bf3b7f6c413928fe [term 1 LEADER]: Becoming Leader. State: Replica: 2fd8a15e13a54923bf3b7f6c413928fe, State: Running, Role: LEADER
I20260808 14:49:02.646733 29916 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2fd8a15e13a54923bf3b7f6c413928fe [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:49:02.646700 29923 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2fd8a15e13a54923bf3b7f6c413928fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fd8a15e13a54923bf3b7f6c413928fe" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36985 } }
I20260808 14:49:02.647086 29923 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2fd8a15e13a54923bf3b7f6c413928fe [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2fd8a15e13a54923bf3b7f6c413928fe. Latest consensus state: current_term: 1 leader_uuid: "2fd8a15e13a54923bf3b7f6c413928fe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fd8a15e13a54923bf3b7f6c413928fe" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36985 } } }
I20260808 14:49:02.647166 29923 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2fd8a15e13a54923bf3b7f6c413928fe [sys.catalog]: This master's current role is: LEADER
I20260808 14:49:02.647311 29925 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2fd8a15e13a54923bf3b7f6c413928fe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2fd8a15e13a54923bf3b7f6c413928fe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fd8a15e13a54923bf3b7f6c413928fe" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36985 } } }
I20260808 14:49:02.647373 29925 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2fd8a15e13a54923bf3b7f6c413928fe [sys.catalog]: This master's current role is: LEADER
I20260808 14:49:02.647495 29930 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:49:02.648015 29930 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:49:02.648928 29921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:02.638821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60173 (local address 127.0.0.1:36985)
0808 14:49:02.639018 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:02.639026 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:02.639052 (+ 26us) server_negotiation.cc:407] Connection header received
0808 14:49:02.639593 (+ 541us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:02.639601 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:02.639649 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:02.639765 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:02.640543 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:02.641494 (+ 951us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:02.642279 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:02.642748 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:02.642848 (+ 100us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:02.645182 (+ 2334us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:02.645186 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:02.645187 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:02.645200 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:02.647123 (+ 1923us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:02.647604 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:02.647607 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:02.647608 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:02.647708 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:02.647984 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:02.647985 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:02.647985 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:02.648373 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:02.648535 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:02.648663 (+ 128us) server_negotiation.cc:299] Negotiation successful
0808 14:49:02.648763 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":82,"threads_started":1}
I20260808 14:49:02.649781 29930 catalog_manager.cc:1347] Generated new cluster ID: 311caff828ed47efb8ed4d09220b3f21
I20260808 14:49:02.649832 29930 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:49:02.649914 31578 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:49:02.658680 29921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:02.651462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54793 (local address 127.0.0.1:36985)
0808 14:49:02.651498 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:02.651500 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:02.651510 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:49:02.651571 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:02.651572 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:02.651580 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:02.651630 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:02.652324 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:02.653042 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:02.654120 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:02.654432 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:02.654488 (+ 56us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:02.655907 (+ 1419us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:02.655908 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:02.655909 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:02.655915 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:02.657433 (+ 1518us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:02.657854 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:02.657855 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:02.657856 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:02.657929 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:02.658133 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:02.658133 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:02.658133 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:02.658273 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:02.658375 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:02.658506 (+ 131us) server_negotiation.cc:299] Negotiation successful
0808 14:49:02.658582 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 14:49:02.669479 29930 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:49:02.670241 29930 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:49:02.676254 29930 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2fd8a15e13a54923bf3b7f6c413928fe: Generated new TSK 0
I20260808 14:49:02.676462 29930 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:49:02.679302 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 29816
W20260808 14:49:02.700037 29797 connection.cc:535] client connection to 127.0.0.1:36985 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36985): Connection reset by peer (error 104)
2026-08-08T14:49:02Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1445 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200295877777-31578-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:49:02 dist-test-slave-42z9 krb5kdc[29957](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:49:02 dist-test-slave-42z9 krb5kdc[29957](info): set up 2 sockets
Aug 08 14:49:02 dist-test-slave-42z9 krb5kdc[29957](info): commencing operation
krb5kdc: starting...
W20260808 14:49:03.831920 31578 mini_kdc.cc:121] Time spent starting KDC: real 1.118s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Aug 08 14:49:03 dist-test-slave-42z9 krb5kdc[29957](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200543, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:49:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:49:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200295877777-31578-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200295877777-31578-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 14:49:03.952595 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200295877777-31578-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200295877777-31578-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200295877777-31578-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35157
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200295877777-31578-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33625
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35157
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:49:04.034235 29978 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:49:04.034452 29978 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:49:04.034476 29978 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:49:04.035621 29978 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:49:04.035662 29978 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:49:04.035674 29978 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:49:04.035686 29978 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:49:04.035696 29978 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:49:04.037222 29978 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33625
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200295877777-31578-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200295877777-31578-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35157
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200295877777-31578-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35157
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29978
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200295877777-31578-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:49:04.037464 29978 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:49:04.037694 29978 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:49:04.042656 29990 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:04.042665 29996 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:04.042665 29989 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:49:04.042888 29978 server_base.cc:1034] running on GCE node
I20260808 14:49:04.043131 29978 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:49:04.043394 29978 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:49:04.044541 29978 hybrid_clock.cc:648] HybridClock initialized: now 1786200544044518 us; error 31 us; skew 500 ppm
Aug 08 14:49:04 dist-test-slave-42z9 krb5kdc[29957](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200544, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:49:04.047123 29978 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 14:49:04.047586 29978 webserver.cc:460] Webserver started at http://127.0.0.1:39867/ using document root <none> and password file <none>
I20260808 14:49:04.047814 29978 fs_manager.cc:359] Metadata directory not provided
I20260808 14:49:04.047859 29978 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:49:04.047998 29978 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:49:04.049080 29978 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200295877777-31578-0/minicluster-data/master-0/data/instance:
uuid: "cef91fa78d9147a0b326248ddf3b318e"
format_stamp: "Formatted at 2026-08-08 14:49:04 on dist-test-slave-42z9"
server_key: "429f950cacd99cd4232b3a76b4a41b4b"
server_key_iv: "e1313989db9e54e95be9ccfffccf54d0"
server_key_version: "encryptionkey@0"
I20260808 14:49:04.049408 29978 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200295877777-31578-0/minicluster-data/master-0/wal/instance:
uuid: "cef91fa78d9147a0b326248ddf3b318e"
format_stamp: "Formatted at 2026-08-08 14:49:04 on dist-test-slave-42z9"
server_key: "429f950cacd99cd4232b3a76b4a41b4b"
server_key_iv: "e1313989db9e54e95be9ccfffccf54d0"
server_key_version: "encryptionkey@0"
I20260808 14:49:04.050755 29978 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:49:04.051494 30006 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:49:04.051640 29978 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:49:04.051728 29978 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200295877777-31578-0/minicluster-data/master-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200295877777-31578-0/minicluster-data/master-0/wal
uuid: "cef91fa78d9147a0b326248ddf3b318e"
format_stamp: "Formatted at 2026-08-08 14:49:04 on dist-test-slave-42z9"
server_key: "429f950cacd99cd4232b3a76b4a41b4b"
server_key_iv: "e1313989db9e54e95be9ccfffccf54d0"
server_key_version: "encryptionkey@0"
I20260808 14:49:04.051792 29978 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200295877777-31578-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200295877777-31578-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200295877777-31578-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:49:04.062810 29978 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:49:04.065128 29978 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:49:04.065275 29978 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:49:04.069275 29978 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35157
I20260808 14:49:04.069321 30088 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35157 every 8 connection(s)
I20260808 14:49:04.069715 29978 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
I20260808 14:49:04.070605 30090 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:49:04.072857 30090 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cef91fa78d9147a0b326248ddf3b318e: Bootstrap starting.
I20260808 14:49:04.073457 30090 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cef91fa78d9147a0b326248ddf3b318e: Neither blocks nor log segments found. Creating new log.
I20260808 14:49:04.073736 30090 log.cc:824] T 00000000000000000000000000000000 P cef91fa78d9147a0b326248ddf3b318e: Log is configured to *not* fsync() on all Append() calls
I20260808 14:49:04.074419 30090 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cef91fa78d9147a0b326248ddf3b318e: No bootstrap required, opened a new log
I20260808 14:49:04.076012 30090 raft_consensus.cc:348] T 00000000000000000000000000000000 P cef91fa78d9147a0b326248ddf3b318e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cef91fa78d9147a0b326248ddf3b318e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35157 } }
I20260808 14:49:04.076150 30090 raft_consensus.cc:374] T 00000000000000000000000000000000 P cef91fa78d9147a0b326248ddf3b318e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:49:04.076172 30090 raft_consensus.cc:729] T 00000000000000000000000000000000 P cef91fa78d9147a0b326248ddf3b318e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cef91fa78d9147a0b326248ddf3b318e, State: Initialized, Role: FOLLOWER
I20260808 14:49:04.076303 30090 consensus_queue.cc:260] T 00000000000000000000000000000000 P cef91fa78d9147a0b326248ddf3b318e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cef91fa78d9147a0b326248ddf3b318e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35157 } }
I20260808 14:49:04.076368 30090 raft_consensus.cc:388] T 00000000000000000000000000000000 P cef91fa78d9147a0b326248ddf3b318e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:49:04.076391 30090 raft_consensus.cc:482] T 00000000000000000000000000000000 P cef91fa78d9147a0b326248ddf3b318e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:49:04.076439 30090 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cef91fa78d9147a0b326248ddf3b318e [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:49:04.076978 30090 raft_consensus.cc:504] T 00000000000000000000000000000000 P cef91fa78d9147a0b326248ddf3b318e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cef91fa78d9147a0b326248ddf3b318e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35157 } }
I20260808 14:49:04.077082 30090 leader_election.cc:302] T 00000000000000000000000000000000 P cef91fa78d9147a0b326248ddf3b318e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cef91fa78d9147a0b326248ddf3b318e; no voters:
I20260808 14:49:04.077237 30090 leader_election.cc:288] T 00000000000000000000000000000000 P cef91fa78d9147a0b326248ddf3b318e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:49:04.077279 30094 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cef91fa78d9147a0b326248ddf3b318e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:49:04.077467 30094 raft_consensus.cc:686] T 00000000000000000000000000000000 P cef91fa78d9147a0b326248ddf3b318e [term 1 LEADER]: Becoming Leader. State: Replica: cef91fa78d9147a0b326248ddf3b318e, State: Running, Role: LEADER
I20260808 14:49:04.077517 30090 sys_catalog.cc:564] T 00000000000000000000000000000000 P cef91fa78d9147a0b326248ddf3b318e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:49:04.077586 30094 consensus_queue.cc:237] T 00000000000000000000000000000000 P cef91fa78d9147a0b326248ddf3b318e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cef91fa78d9147a0b326248ddf3b318e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35157 } }
I20260808 14:49:04.077970 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 29978
I20260808 14:49:04.078096 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786200295877777-31578-0/minicluster-data/master-0/wal/instance
I20260808 14:49:04.078076 30095 sys_catalog.cc:455] T 00000000000000000000000000000000 P cef91fa78d9147a0b326248ddf3b318e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cef91fa78d9147a0b326248ddf3b318e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cef91fa78d9147a0b326248ddf3b318e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35157 } } }
I20260808 14:49:04.078147 30095 sys_catalog.cc:458] T 00000000000000000000000000000000 P cef91fa78d9147a0b326248ddf3b318e [sys.catalog]: This master's current role is: LEADER
I20260808 14:49:04.078292 31578 external_mini_cluster.cc:1428] Setting key 68b5bf2686f3b6fe0901105c9e8e3161
I20260808 14:49:04.078495 30096 sys_catalog.cc:455] T 00000000000000000000000000000000 P cef91fa78d9147a0b326248ddf3b318e [sys.catalog]: SysCatalogTable state changed. Reason: New leader cef91fa78d9147a0b326248ddf3b318e. Latest consensus state: current_term: 1 leader_uuid: "cef91fa78d9147a0b326248ddf3b318e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cef91fa78d9147a0b326248ddf3b318e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35157 } } }
I20260808 14:49:04.078634 30096 sys_catalog.cc:458] T 00000000000000000000000000000000 P cef91fa78d9147a0b326248ddf3b318e [sys.catalog]: This master's current role is: LEADER
I20260808 14:49:04.078687 30105 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:49:04.079206 30105 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:49:04.080812 30105 catalog_manager.cc:1347] Generated new cluster ID: 632f535fb2c3459999a1caeb8839c229
I20260808 14:49:04.080870 30105 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:49:04.084641 30117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:04.078926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58621 (local address 127.0.0.1:35157)
0808 14:49:04.079848 (+ 922us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:04.079856 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:04.079892 (+ 36us) server_negotiation.cc:407] Connection header received
0808 14:49:04.080002 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:04.080009 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:04.080063 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:04.080200 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:04.080379 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:04.082113 (+ 1734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:04.082859 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:04.083261 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:04.083366 (+ 105us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:04.084025 (+ 659us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:04.084029 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:04.084030 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:49:04.084193 (+ 163us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:04.084223 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:49:04.084234 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:04.084304 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:04.084402 (+ 98us) server_negotiation.cc:299] Negotiation successful
0808 14:49:04.084437 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":876,"thread_start_us":81,"threads_started":1}
I20260808 14:49:04.085505 31578 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:49:04.089468 30117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:04.086803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34965 (local address 127.0.0.1:35157)
0808 14:49:04.086846 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:04.086847 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:04.086929 (+ 82us) server_negotiation.cc:407] Connection header received
0808 14:49:04.086980 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:04.086981 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:04.086991 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:04.087036 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:04.087153 (+ 117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:04.087622 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:04.088295 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:04.088525 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:04.088581 (+ 56us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:04.089214 (+ 633us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:04.089215 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:04.089215 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:49:04.089219 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:04.089233 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:49:04.089238 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:04.089287 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:04.089354 (+ 67us) server_negotiation.cc:299] Negotiation successful
0808 14:49:04.089365 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 14:49:04.092686 30105 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:49:04.093166 30105 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:49:04.096283 30105 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cef91fa78d9147a0b326248ddf3b318e: Generated new TSK 0
I20260808 14:49:04.096457 30105 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:49:04.105473 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 29978
W20260808 14:49:04.125641 29955 connection.cc:535] client connection to 127.0.0.1:35157 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:35157): Connection reset by peer (error 104)
2026-08-08T14:49:04Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1425 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200295877777-31578-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:49:04 dist-test-slave-42z9 krb5kdc[30136](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:49:04 dist-test-slave-42z9 krb5kdc[30136](info): set up 2 sockets
Aug 08 14:49:04 dist-test-slave-42z9 krb5kdc[30136](info): commencing operation
krb5kdc: starting...
W20260808 14:49:05.255110 31578 mini_kdc.cc:121] Time spent starting KDC: real 1.116s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Aug 08 14:49:05 dist-test-slave-42z9 krb5kdc[30136](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200545, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:49:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:49:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200295877777-31578-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200295877777-31578-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 14:49:05.380474 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200295877777-31578-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200295877777-31578-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200295877777-31578-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42217
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200295877777-31578-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36981
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42217
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:49:05.464407 30158 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:49:05.464639 30158 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:49:05.464672 30158 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:49:05.465852 30158 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:49:05.465896 30158 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:49:05.465914 30158 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:49:05.465930 30158 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:49:05.465945 30158 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:49:05.467453 30158 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36981
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200295877777-31578-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200295877777-31578-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42217
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200295877777-31578-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42217
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30158
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200295877777-31578-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:49:05.467720 30158 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:49:05.467932 30158 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:49:05.472764 30169 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:49:05.472882 30158 server_base.cc:1034] running on GCE node
W20260808 14:49:05.472759 30172 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:05.472764 30166 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:49:05.473230 30158 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:49:05.473577 30158 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:49:05.474731 30158 hybrid_clock.cc:648] HybridClock initialized: now 1786200545474711 us; error 33 us; skew 500 ppm
Aug 08 14:49:05 dist-test-slave-42z9 krb5kdc[30136](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200545, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:49:05.477285 30158 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 14:49:05.477787 30158 webserver.cc:460] Webserver started at http://127.0.0.1:43813/ using document root <none> and password file <none>
I20260808 14:49:05.478018 30158 fs_manager.cc:359] Metadata directory not provided
I20260808 14:49:05.478068 30158 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:49:05.478199 30158 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:49:05.479251 30158 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200295877777-31578-0/minicluster-data/master-0/data/instance:
uuid: "0188e4179e224a8fa1acf86706cf9282"
format_stamp: "Formatted at 2026-08-08 14:49:05 on dist-test-slave-42z9"
server_key: "80043b725931782b23e3ac7d829bf5d2"
server_key_iv: "bd310c4966a194a4856f6e19b6a53fbd"
server_key_version: "encryptionkey@0"
I20260808 14:49:05.479635 30158 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200295877777-31578-0/minicluster-data/master-0/wal/instance:
uuid: "0188e4179e224a8fa1acf86706cf9282"
format_stamp: "Formatted at 2026-08-08 14:49:05 on dist-test-slave-42z9"
server_key: "80043b725931782b23e3ac7d829bf5d2"
server_key_iv: "bd310c4966a194a4856f6e19b6a53fbd"
server_key_version: "encryptionkey@0"
I20260808 14:49:05.480970 30158 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 14:49:05.481832 30182 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:49:05.482013 30158 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:49:05.482103 30158 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200295877777-31578-0/minicluster-data/master-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200295877777-31578-0/minicluster-data/master-0/wal
uuid: "0188e4179e224a8fa1acf86706cf9282"
format_stamp: "Formatted at 2026-08-08 14:49:05 on dist-test-slave-42z9"
server_key: "80043b725931782b23e3ac7d829bf5d2"
server_key_iv: "bd310c4966a194a4856f6e19b6a53fbd"
server_key_version: "encryptionkey@0"
I20260808 14:49:05.482172 30158 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200295877777-31578-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200295877777-31578-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200295877777-31578-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:49:05.485555 30158 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:49:05.487787 30158 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:49:05.487907 30158 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:49:05.491680 30158 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42217
I20260808 14:49:05.491734 30260 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42217 every 8 connection(s)
I20260808 14:49:05.492044 30158 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
I20260808 14:49:05.493424 30261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:49:05.495810 30261 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0188e4179e224a8fa1acf86706cf9282: Bootstrap starting.
I20260808 14:49:05.496361 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 30158
I20260808 14:49:05.496490 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786200295877777-31578-0/minicluster-data/master-0/wal/instance
I20260808 14:49:05.496501 30261 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0188e4179e224a8fa1acf86706cf9282: Neither blocks nor log segments found. Creating new log.
I20260808 14:49:05.496685 31578 external_mini_cluster.cc:1428] Setting key aa2e1158731b520109c98657a8b1dff8
I20260808 14:49:05.496835 30261 log.cc:824] T 00000000000000000000000000000000 P 0188e4179e224a8fa1acf86706cf9282: Log is configured to *not* fsync() on all Append() calls
I20260808 14:49:05.497687 30261 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0188e4179e224a8fa1acf86706cf9282: No bootstrap required, opened a new log
I20260808 14:49:05.499159 30268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:05.497208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42229 (local address 127.0.0.1:42217)
0808 14:49:05.497392 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:05.497401 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:05.497432 (+ 31us) server_negotiation.cc:407] Connection header received
0808 14:49:05.497978 (+ 546us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:05.497985 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:05.498013 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:05.498126 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:05.498742 (+ 616us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:05.498745 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:05.498745 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:49:05.498749 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:05.498785 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:49:05.498795 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:05.498859 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:05.498933 (+ 74us) server_negotiation.cc:299] Negotiation successful
0808 14:49:05.498967 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":73,"threads_started":1}
I20260808 14:49:05.500075 31578 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:49:05.500026 30261 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0188e4179e224a8fa1acf86706cf9282 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0188e4179e224a8fa1acf86706cf9282" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42217 } }
I20260808 14:49:05.500183 30261 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0188e4179e224a8fa1acf86706cf9282 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:49:05.500214 30261 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0188e4179e224a8fa1acf86706cf9282 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0188e4179e224a8fa1acf86706cf9282, State: Initialized, Role: FOLLOWER
I20260808 14:49:05.500324 30261 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0188e4179e224a8fa1acf86706cf9282 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0188e4179e224a8fa1acf86706cf9282" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42217 } }
I20260808 14:49:05.500415 30261 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0188e4179e224a8fa1acf86706cf9282 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:49:05.500454 30261 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0188e4179e224a8fa1acf86706cf9282 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:49:05.500504 30261 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0188e4179e224a8fa1acf86706cf9282 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:49:05.501228 30261 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0188e4179e224a8fa1acf86706cf9282 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0188e4179e224a8fa1acf86706cf9282" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42217 } }
I20260808 14:49:05.501353 30261 leader_election.cc:302] T 00000000000000000000000000000000 P 0188e4179e224a8fa1acf86706cf9282 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0188e4179e224a8fa1acf86706cf9282; no voters:
I20260808 14:49:05.501565 30261 leader_election.cc:288] T 00000000000000000000000000000000 P 0188e4179e224a8fa1acf86706cf9282 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:49:05.501720 30276 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0188e4179e224a8fa1acf86706cf9282 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:49:05.501919 30261 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0188e4179e224a8fa1acf86706cf9282 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:49:05.501967 30276 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0188e4179e224a8fa1acf86706cf9282 [term 1 LEADER]: Becoming Leader. State: Replica: 0188e4179e224a8fa1acf86706cf9282, State: Running, Role: LEADER
I20260808 14:49:05.502060 30276 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0188e4179e224a8fa1acf86706cf9282 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0188e4179e224a8fa1acf86706cf9282" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42217 } }
I20260808 14:49:05.502440 30280 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0188e4179e224a8fa1acf86706cf9282 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0188e4179e224a8fa1acf86706cf9282. Latest consensus state: current_term: 1 leader_uuid: "0188e4179e224a8fa1acf86706cf9282" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0188e4179e224a8fa1acf86706cf9282" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42217 } } }
I20260808 14:49:05.502440 30279 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0188e4179e224a8fa1acf86706cf9282 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0188e4179e224a8fa1acf86706cf9282" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0188e4179e224a8fa1acf86706cf9282" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42217 } } }
I20260808 14:49:05.502614 30280 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0188e4179e224a8fa1acf86706cf9282 [sys.catalog]: This master's current role is: LEADER
I20260808 14:49:05.502627 30279 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0188e4179e224a8fa1acf86706cf9282 [sys.catalog]: This master's current role is: LEADER
W20260808 14:49:05.503651 30300 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0188e4179e224a8fa1acf86706cf9282: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:49:05.503706 30300 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:49:05.503834 30290 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:49:05.504021 30290 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:49:05.505048 30268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:05.501773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33275 (local address 127.0.0.1:42217)
0808 14:49:05.501818 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:05.501820 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:05.503427 (+ 1607us) server_negotiation.cc:407] Connection header received
0808 14:49:05.503532 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:05.503533 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:05.503539 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:05.503602 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:05.504814 (+ 1212us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:05.504816 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:05.504816 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:49:05.504821 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:05.504837 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:49:05.504841 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:05.504906 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:05.504975 (+ 69us) server_negotiation.cc:299] Negotiation successful
0808 14:49:05.504989 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260808 14:49:05.505728 30290 catalog_manager.cc:1347] Generated new cluster ID: 2f08afe3be424086ae8988bb99b0b943
I20260808 14:49:05.505788 30290 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:49:05.519366 30290 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:49:05.519557 30290 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:49:05.524613 30290 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0188e4179e224a8fa1acf86706cf9282: Generated new TSK 0
I20260808 14:49:05.524938 30290 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:49:05.532196 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 30158
2026-08-08T14:49:05Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1418 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200295877777-31578-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:49:05 dist-test-slave-42z9 krb5kdc[30306](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:49:05 dist-test-slave-42z9 krb5kdc[30306](info): set up 2 sockets
Aug 08 14:49:05 dist-test-slave-42z9 krb5kdc[30306](info): commencing operation
krb5kdc: starting...
W20260808 14:49:06.669679 31578 mini_kdc.cc:121] Time spent starting KDC: real 1.112s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Aug 08 14:49:06 dist-test-slave-42z9 krb5kdc[30306](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200546, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:49:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:49:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200295877777-31578-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200295877777-31578-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 14:49:06.792174 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200295877777-31578-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200295877777-31578-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200295877777-31578-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39115
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200295877777-31578-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33687
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39115
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:49:06.875514 30325 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:49:06.875762 30325 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:49:06.875797 30325 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:49:06.877033 30325 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:49:06.877096 30325 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:49:06.877117 30325 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:49:06.877133 30325 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:49:06.877151 30325 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:49:06.878836 30325 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33687
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200295877777-31578-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200295877777-31578-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39115
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200295877777-31578-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39115
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30325
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200295877777-31578-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:49:06.879128 30325 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:49:06.879376 30325 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:49:06.884275 30332 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:06.884272 30336 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:06.884286 30333 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:49:06.884456 30325 server_base.cc:1034] running on GCE node
I20260808 14:49:06.884774 30325 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:49:06.885061 30325 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:49:06.886201 30325 hybrid_clock.cc:648] HybridClock initialized: now 1786200546886187 us; error 31 us; skew 500 ppm
Aug 08 14:49:06 dist-test-slave-42z9 krb5kdc[30306](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200546, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:49:06.888614 30325 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 14:49:06.889053 30325 webserver.cc:460] Webserver started at http://127.0.0.1:40005/ using document root <none> and password file <none>
I20260808 14:49:06.889279 30325 fs_manager.cc:359] Metadata directory not provided
I20260808 14:49:06.889325 30325 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:49:06.889480 30325 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:49:06.890551 30325 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200295877777-31578-0/minicluster-data/master-0/data/instance:
uuid: "90ef2c54caa049c4b3f2fbd8a4fb66e1"
format_stamp: "Formatted at 2026-08-08 14:49:06 on dist-test-slave-42z9"
server_key: "e963b108566c285ae96a478aa0cfb547"
server_key_iv: "73c963b6cee5fb29fed1ee58281c8960"
server_key_version: "encryptionkey@0"
I20260808 14:49:06.890882 30325 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200295877777-31578-0/minicluster-data/master-0/wal/instance:
uuid: "90ef2c54caa049c4b3f2fbd8a4fb66e1"
format_stamp: "Formatted at 2026-08-08 14:49:06 on dist-test-slave-42z9"
server_key: "e963b108566c285ae96a478aa0cfb547"
server_key_iv: "73c963b6cee5fb29fed1ee58281c8960"
server_key_version: "encryptionkey@0"
I20260808 14:49:06.892129 30325 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 14:49:06.892778 30350 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:49:06.892920 30325 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:49:06.893011 30325 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200295877777-31578-0/minicluster-data/master-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200295877777-31578-0/minicluster-data/master-0/wal
uuid: "90ef2c54caa049c4b3f2fbd8a4fb66e1"
format_stamp: "Formatted at 2026-08-08 14:49:06 on dist-test-slave-42z9"
server_key: "e963b108566c285ae96a478aa0cfb547"
server_key_iv: "73c963b6cee5fb29fed1ee58281c8960"
server_key_version: "encryptionkey@0"
I20260808 14:49:06.893079 30325 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200295877777-31578-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200295877777-31578-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200295877777-31578-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:49:06.902133 30325 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:49:06.903887 30325 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:49:06.904039 30325 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:49:06.908068 30325 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39115
I20260808 14:49:06.908118 30437 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39115 every 8 connection(s)
I20260808 14:49:06.908457 30325 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
I20260808 14:49:06.909349 30438 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:49:06.911679 30438 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 90ef2c54caa049c4b3f2fbd8a4fb66e1: Bootstrap starting.
I20260808 14:49:06.912227 30438 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 90ef2c54caa049c4b3f2fbd8a4fb66e1: Neither blocks nor log segments found. Creating new log.
I20260808 14:49:06.912473 30438 log.cc:824] T 00000000000000000000000000000000 P 90ef2c54caa049c4b3f2fbd8a4fb66e1: Log is configured to *not* fsync() on all Append() calls
I20260808 14:49:06.913151 30438 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 90ef2c54caa049c4b3f2fbd8a4fb66e1: No bootstrap required, opened a new log
I20260808 14:49:06.914824 30438 raft_consensus.cc:348] T 00000000000000000000000000000000 P 90ef2c54caa049c4b3f2fbd8a4fb66e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90ef2c54caa049c4b3f2fbd8a4fb66e1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39115 } }
I20260808 14:49:06.914970 30438 raft_consensus.cc:374] T 00000000000000000000000000000000 P 90ef2c54caa049c4b3f2fbd8a4fb66e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:49:06.914992 30438 raft_consensus.cc:729] T 00000000000000000000000000000000 P 90ef2c54caa049c4b3f2fbd8a4fb66e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90ef2c54caa049c4b3f2fbd8a4fb66e1, State: Initialized, Role: FOLLOWER
I20260808 14:49:06.915095 30438 consensus_queue.cc:260] T 00000000000000000000000000000000 P 90ef2c54caa049c4b3f2fbd8a4fb66e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90ef2c54caa049c4b3f2fbd8a4fb66e1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39115 } }
I20260808 14:49:06.915146 30438 raft_consensus.cc:388] T 00000000000000000000000000000000 P 90ef2c54caa049c4b3f2fbd8a4fb66e1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:49:06.915165 30438 raft_consensus.cc:482] T 00000000000000000000000000000000 P 90ef2c54caa049c4b3f2fbd8a4fb66e1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:49:06.915195 30438 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 90ef2c54caa049c4b3f2fbd8a4fb66e1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:49:06.915722 30438 raft_consensus.cc:504] T 00000000000000000000000000000000 P 90ef2c54caa049c4b3f2fbd8a4fb66e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90ef2c54caa049c4b3f2fbd8a4fb66e1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39115 } }
I20260808 14:49:06.915809 30438 leader_election.cc:302] T 00000000000000000000000000000000 P 90ef2c54caa049c4b3f2fbd8a4fb66e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 90ef2c54caa049c4b3f2fbd8a4fb66e1; no voters:
I20260808 14:49:06.915937 30438 leader_election.cc:288] T 00000000000000000000000000000000 P 90ef2c54caa049c4b3f2fbd8a4fb66e1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:49:06.915992 30445 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 90ef2c54caa049c4b3f2fbd8a4fb66e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:49:06.916145 30445 raft_consensus.cc:686] T 00000000000000000000000000000000 P 90ef2c54caa049c4b3f2fbd8a4fb66e1 [term 1 LEADER]: Becoming Leader. State: Replica: 90ef2c54caa049c4b3f2fbd8a4fb66e1, State: Running, Role: LEADER
I20260808 14:49:06.916167 30438 sys_catalog.cc:564] T 00000000000000000000000000000000 P 90ef2c54caa049c4b3f2fbd8a4fb66e1 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:49:06.916273 30445 consensus_queue.cc:237] T 00000000000000000000000000000000 P 90ef2c54caa049c4b3f2fbd8a4fb66e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90ef2c54caa049c4b3f2fbd8a4fb66e1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39115 } }
I20260808 14:49:06.916654 30446 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90ef2c54caa049c4b3f2fbd8a4fb66e1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "90ef2c54caa049c4b3f2fbd8a4fb66e1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90ef2c54caa049c4b3f2fbd8a4fb66e1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39115 } } }
I20260808 14:49:06.916684 30447 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90ef2c54caa049c4b3f2fbd8a4fb66e1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 90ef2c54caa049c4b3f2fbd8a4fb66e1. Latest consensus state: current_term: 1 leader_uuid: "90ef2c54caa049c4b3f2fbd8a4fb66e1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90ef2c54caa049c4b3f2fbd8a4fb66e1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39115 } } }
I20260808 14:49:06.916771 30446 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90ef2c54caa049c4b3f2fbd8a4fb66e1 [sys.catalog]: This master's current role is: LEADER
I20260808 14:49:06.916793 30447 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90ef2c54caa049c4b3f2fbd8a4fb66e1 [sys.catalog]: This master's current role is: LEADER
I20260808 14:49:06.916976 30449 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:49:06.917527 30449 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:49:06.917891 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 30325
I20260808 14:49:06.918015 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786200295877777-31578-0/minicluster-data/master-0/wal/instance
I20260808 14:49:06.918200 31578 external_mini_cluster.cc:1428] Setting key c3499b227c460270c3406da08ae59f6d
I20260808 14:49:06.919168 30449 catalog_manager.cc:1347] Generated new cluster ID: d417848ccb354bc6a96ee703120a0bd1
I20260808 14:49:06.919219 30449 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:49:06.927346 30449 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:49:06.927855 30449 catalog_manager.cc:1504] Loading token signing keys...
Aug 08 14:49:06 dist-test-slave-42z9 krb5kdc[30306](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200546, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 14:49:06.932874 30470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:06.918811 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47051 (local address 127.0.0.1:39115)
0808 14:49:06.918960 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:06.918969 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:06.918998 (+ 29us) server_negotiation.cc:407] Connection header received
0808 14:49:06.919105 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:06.919112 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:06.921567 (+ 2455us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:06.921749 (+ 182us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:06.922543 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:06.924418 (+ 1875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:06.925536 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:06.926164 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:06.926268 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:06.929288 (+ 3020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:06.929292 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:06.929293 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:06.929306 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:06.931240 (+ 1934us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:06.931630 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:06.931633 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:06.931634 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:06.931748 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:06.931924 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:06.931924 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:06.931925 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:06.932220 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:06.932366 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:06.932449 (+ 83us) server_negotiation.cc:299] Negotiation successful
0808 14:49:06.932623 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105,"thread_start_us":78,"threads_started":1}
I20260808 14:49:06.932968 30449 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 90ef2c54caa049c4b3f2fbd8a4fb66e1: Generated new TSK 0
I20260808 14:49:06.933283 30449 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:49:06.934103 31578 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:49:06.941473 30470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:06.935400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34385 (local address 127.0.0.1:39115)
0808 14:49:06.935436 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:06.935438 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:06.935568 (+ 130us) server_negotiation.cc:407] Connection header received
0808 14:49:06.935594 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:06.935595 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:06.935608 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:06.935677 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:06.936126 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:06.936887 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:06.937606 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:06.937955 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:06.938023 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:06.939063 (+ 1040us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:06.939064 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:06.939064 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:06.939070 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:06.940455 (+ 1385us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:06.940762 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:06.940763 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:06.940763 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:06.940821 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:06.940967 (+ 146us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:06.940967 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:06.940968 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:06.941092 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:06.941199 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:06.941264 (+ 65us) server_negotiation.cc:299] Negotiation successful
0808 14:49:06.941349 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260808 14:49:06.943681 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 30325
2026-08-08T14:49:06Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1419 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200295877777-31578-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:49:07 dist-test-slave-42z9 krb5kdc[30481](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:49:07 dist-test-slave-42z9 krb5kdc[30481](info): set up 2 sockets
Aug 08 14:49:07 dist-test-slave-42z9 krb5kdc[30481](info): commencing operation
krb5kdc: starting...
W20260808 14:49:08.124956 31578 mini_kdc.cc:121] Time spent starting KDC: real 1.147s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Aug 08 14:49:08 dist-test-slave-42z9 krb5kdc[30481](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200548, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:49:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:49:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200295877777-31578-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200295877777-31578-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 14:49:08.245891 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200295877777-31578-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200295877777-31578-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200295877777-31578-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33379
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200295877777-31578-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:32771
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33379
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:49:08.330597 30501 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:49:08.330832 30501 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:49:08.330857 30501 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:49:08.332109 30501 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:49:08.332160 30501 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:49:08.332173 30501 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:49:08.332185 30501 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:49:08.332195 30501 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:49:08.333827 30501 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:32771
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200295877777-31578-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200295877777-31578-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33379
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200295877777-31578-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33379
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30501
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200295877777-31578-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:49:08.334100 30501 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:49:08.334334 30501 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:49:08.339195 30515 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:08.339200 30507 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:08.339217 30511 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:49:08.339509 30501 server_base.cc:1034] running on GCE node
I20260808 14:49:08.339747 30501 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:49:08.340044 30501 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:49:08.341180 30501 hybrid_clock.cc:648] HybridClock initialized: now 1786200548341165 us; error 32 us; skew 500 ppm
Aug 08 14:49:08 dist-test-slave-42z9 krb5kdc[30481](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200548, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:49:08.347213 30501 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 14:49:08.347743 30501 webserver.cc:460] Webserver started at http://127.0.0.1:41519/ using document root <none> and password file <none>
I20260808 14:49:08.347975 30501 fs_manager.cc:359] Metadata directory not provided
I20260808 14:49:08.348028 30501 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:49:08.348165 30501 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:49:08.349267 30501 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200295877777-31578-0/minicluster-data/master-0/data/instance:
uuid: "423ef4429e064cccbf68432bc2fa0ed1"
format_stamp: "Formatted at 2026-08-08 14:49:08 on dist-test-slave-42z9"
server_key: "101efe76f408fc8083859181ac249266"
server_key_iv: "06e52f666843d548315adf479e9569e1"
server_key_version: "encryptionkey@0"
I20260808 14:49:08.349669 30501 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200295877777-31578-0/minicluster-data/master-0/wal/instance:
uuid: "423ef4429e064cccbf68432bc2fa0ed1"
format_stamp: "Formatted at 2026-08-08 14:49:08 on dist-test-slave-42z9"
server_key: "101efe76f408fc8083859181ac249266"
server_key_iv: "06e52f666843d548315adf479e9569e1"
server_key_version: "encryptionkey@0"
I20260808 14:49:08.350983 30501 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:49:08.351752 30527 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:49:08.351925 30501 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:49:08.352023 30501 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200295877777-31578-0/minicluster-data/master-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200295877777-31578-0/minicluster-data/master-0/wal
uuid: "423ef4429e064cccbf68432bc2fa0ed1"
format_stamp: "Formatted at 2026-08-08 14:49:08 on dist-test-slave-42z9"
server_key: "101efe76f408fc8083859181ac249266"
server_key_iv: "06e52f666843d548315adf479e9569e1"
server_key_version: "encryptionkey@0"
I20260808 14:49:08.352095 30501 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200295877777-31578-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200295877777-31578-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200295877777-31578-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:49:08.377171 30501 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:49:08.379112 30501 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:49:08.379268 30501 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:49:08.383455 30501 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33379
I20260808 14:49:08.383494 30603 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33379 every 8 connection(s)
I20260808 14:49:08.383910 30501 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
I20260808 14:49:08.385219 30604 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:49:08.387574 30604 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 423ef4429e064cccbf68432bc2fa0ed1: Bootstrap starting.
I20260808 14:49:08.388190 30604 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 423ef4429e064cccbf68432bc2fa0ed1: Neither blocks nor log segments found. Creating new log.
I20260808 14:49:08.388465 30604 log.cc:824] T 00000000000000000000000000000000 P 423ef4429e064cccbf68432bc2fa0ed1: Log is configured to *not* fsync() on all Append() calls
I20260808 14:49:08.389250 30604 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 423ef4429e064cccbf68432bc2fa0ed1: No bootstrap required, opened a new log
I20260808 14:49:08.390895 30604 raft_consensus.cc:348] T 00000000000000000000000000000000 P 423ef4429e064cccbf68432bc2fa0ed1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "423ef4429e064cccbf68432bc2fa0ed1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33379 } }
I20260808 14:49:08.391050 30604 raft_consensus.cc:374] T 00000000000000000000000000000000 P 423ef4429e064cccbf68432bc2fa0ed1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:49:08.391072 30604 raft_consensus.cc:729] T 00000000000000000000000000000000 P 423ef4429e064cccbf68432bc2fa0ed1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 423ef4429e064cccbf68432bc2fa0ed1, State: Initialized, Role: FOLLOWER
I20260808 14:49:08.391218 30604 consensus_queue.cc:260] T 00000000000000000000000000000000 P 423ef4429e064cccbf68432bc2fa0ed1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "423ef4429e064cccbf68432bc2fa0ed1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33379 } }
I20260808 14:49:08.391284 30604 raft_consensus.cc:388] T 00000000000000000000000000000000 P 423ef4429e064cccbf68432bc2fa0ed1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:49:08.391307 30604 raft_consensus.cc:482] T 00000000000000000000000000000000 P 423ef4429e064cccbf68432bc2fa0ed1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:49:08.391355 30604 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 423ef4429e064cccbf68432bc2fa0ed1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:49:08.391921 30604 raft_consensus.cc:504] T 00000000000000000000000000000000 P 423ef4429e064cccbf68432bc2fa0ed1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "423ef4429e064cccbf68432bc2fa0ed1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33379 } }
I20260808 14:49:08.392015 30604 leader_election.cc:302] T 00000000000000000000000000000000 P 423ef4429e064cccbf68432bc2fa0ed1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 423ef4429e064cccbf68432bc2fa0ed1; no voters:
I20260808 14:49:08.392030 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 30501
I20260808 14:49:08.392138 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786200295877777-31578-0/minicluster-data/master-0/wal/instance
I20260808 14:49:08.392179 30604 leader_election.cc:288] T 00000000000000000000000000000000 P 423ef4429e064cccbf68432bc2fa0ed1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:49:08.392251 30608 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 423ef4429e064cccbf68432bc2fa0ed1 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:49:08.392333 31578 external_mini_cluster.cc:1428] Setting key 3a34d45cde22d6aaa9afbbab860eb84c
I20260808 14:49:08.392421 30608 raft_consensus.cc:686] T 00000000000000000000000000000000 P 423ef4429e064cccbf68432bc2fa0ed1 [term 1 LEADER]: Becoming Leader. State: Replica: 423ef4429e064cccbf68432bc2fa0ed1, State: Running, Role: LEADER
I20260808 14:49:08.392490 30604 sys_catalog.cc:564] T 00000000000000000000000000000000 P 423ef4429e064cccbf68432bc2fa0ed1 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:49:08.392530 30608 consensus_queue.cc:237] T 00000000000000000000000000000000 P 423ef4429e064cccbf68432bc2fa0ed1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "423ef4429e064cccbf68432bc2fa0ed1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33379 } }
I20260808 14:49:08.393193 30609 sys_catalog.cc:455] T 00000000000000000000000000000000 P 423ef4429e064cccbf68432bc2fa0ed1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "423ef4429e064cccbf68432bc2fa0ed1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "423ef4429e064cccbf68432bc2fa0ed1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33379 } } }
I20260808 14:49:08.393215 30610 sys_catalog.cc:455] T 00000000000000000000000000000000 P 423ef4429e064cccbf68432bc2fa0ed1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 423ef4429e064cccbf68432bc2fa0ed1. Latest consensus state: current_term: 1 leader_uuid: "423ef4429e064cccbf68432bc2fa0ed1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "423ef4429e064cccbf68432bc2fa0ed1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33379 } } }
I20260808 14:49:08.393271 30609 sys_catalog.cc:458] T 00000000000000000000000000000000 P 423ef4429e064cccbf68432bc2fa0ed1 [sys.catalog]: This master's current role is: LEADER
I20260808 14:49:08.393301 30610 sys_catalog.cc:458] T 00000000000000000000000000000000 P 423ef4429e064cccbf68432bc2fa0ed1 [sys.catalog]: This master's current role is: LEADER
I20260808 14:49:08.393502 30625 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:49:08.394114 30625 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:49:08.396145 30625 catalog_manager.cc:1347] Generated new cluster ID: 2c9f4e042779405ca21d4e2ccddeb122
I20260808 14:49:08.396209 30625 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:49:08.398000 30614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:08.392834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58927 (local address 127.0.0.1:33379)
0808 14:49:08.393042 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:08.393051 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:08.393090 (+ 39us) server_negotiation.cc:407] Connection header received
0808 14:49:08.393210 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:08.393217 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:08.393276 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:08.393716 (+ 440us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:08.393835 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:08.394990 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:08.396080 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:08.396551 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:08.396655 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:08.397324 (+ 669us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:08.397327 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:08.397328 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:49:08.397569 (+ 241us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:08.397600 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:49:08.397612 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:08.397669 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:08.397751 (+ 82us) server_negotiation.cc:299] Negotiation successful
0808 14:49:08.397818 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":79,"threads_started":1}
I20260808 14:49:08.398864 31578 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:49:08.402904 30614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:08.400186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47107 (local address 127.0.0.1:33379)
0808 14:49:08.400231 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:08.400233 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:08.400343 (+ 110us) server_negotiation.cc:407] Connection header received
0808 14:49:08.400392 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:08.400392 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:08.400403 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:08.400443 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:08.400579 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:08.401056 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:08.401800 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:08.402010 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:08.402072 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:08.402674 (+ 602us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:08.402675 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:08.402675 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:49:08.402680 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:08.402694 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:49:08.402698 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:08.402743 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:08.402801 (+ 58us) server_negotiation.cc:299] Negotiation successful
0808 14:49:08.402827 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 14:49:08.409287 30625 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:49:08.409861 30625 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:49:08.419590 30625 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 423ef4429e064cccbf68432bc2fa0ed1: Generated new TSK 0
I20260808 14:49:08.419796 30625 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:49:08.430678 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 30501
2026-08-08T14:49:08Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1483 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200295877777-31578-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:49:08 dist-test-slave-42z9 krb5kdc[30646](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:49:08 dist-test-slave-42z9 krb5kdc[30646](info): set up 2 sockets
Aug 08 14:49:08 dist-test-slave-42z9 krb5kdc[30646](info): commencing operation
krb5kdc: starting...
W20260808 14:49:09.571661 31578 mini_kdc.cc:121] Time spent starting KDC: real 1.110s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Aug 08 14:49:09 dist-test-slave-42z9 krb5kdc[30646](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200549, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:49:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:49:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200295877777-31578-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200295877777-31578-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 14:49:09.695647 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200295877777-31578-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200295877777-31578-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200295877777-31578-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38437
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200295877777-31578-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44387
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38437
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:49:09.779588 30664 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:49:09.779819 30664 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:49:09.779842 30664 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:49:09.781008 30664 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:49:09.781050 30664 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:49:09.781064 30664 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:49:09.781075 30664 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:49:09.781085 30664 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:49:09.782687 30664 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44387
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200295877777-31578-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200295877777-31578-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38437
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200295877777-31578-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38437
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30664
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200295877777-31578-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:49:09.782919 30664 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:49:09.783119 30664 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:49:09.788138 30681 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:09.788120 30678 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:09.788120 30676 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:49:09.788219 30664 server_base.cc:1034] running on GCE node
I20260808 14:49:09.788625 30664 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:49:09.788934 30664 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:49:09.790084 30664 hybrid_clock.cc:648] HybridClock initialized: now 1786200549790063 us; error 36 us; skew 500 ppm
Aug 08 14:49:09 dist-test-slave-42z9 krb5kdc[30646](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200549, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:49:09.792654 30664 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 14:49:09.793133 30664 webserver.cc:460] Webserver started at http://127.0.0.1:42655/ using document root <none> and password file <none>
I20260808 14:49:09.793370 30664 fs_manager.cc:359] Metadata directory not provided
I20260808 14:49:09.793421 30664 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:49:09.793582 30664 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:49:09.794687 30664 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200295877777-31578-0/minicluster-data/master-0/data/instance:
uuid: "0e2952e5bd6749c68e625255ad61a530"
format_stamp: "Formatted at 2026-08-08 14:49:09 on dist-test-slave-42z9"
server_key: "429d39432bac7a3f08415ebdfd87ea1a"
server_key_iv: "6f12c90a92f7dc80e9a09487e1659926"
server_key_version: "encryptionkey@0"
I20260808 14:49:09.795042 30664 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200295877777-31578-0/minicluster-data/master-0/wal/instance:
uuid: "0e2952e5bd6749c68e625255ad61a530"
format_stamp: "Formatted at 2026-08-08 14:49:09 on dist-test-slave-42z9"
server_key: "429d39432bac7a3f08415ebdfd87ea1a"
server_key_iv: "6f12c90a92f7dc80e9a09487e1659926"
server_key_version: "encryptionkey@0"
I20260808 14:49:09.796403 30664 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:49:09.797112 30690 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:49:09.797262 30664 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:49:09.797351 30664 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200295877777-31578-0/minicluster-data/master-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200295877777-31578-0/minicluster-data/master-0/wal
uuid: "0e2952e5bd6749c68e625255ad61a530"
format_stamp: "Formatted at 2026-08-08 14:49:09 on dist-test-slave-42z9"
server_key: "429d39432bac7a3f08415ebdfd87ea1a"
server_key_iv: "6f12c90a92f7dc80e9a09487e1659926"
server_key_version: "encryptionkey@0"
I20260808 14:49:09.797420 30664 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200295877777-31578-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200295877777-31578-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200295877777-31578-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:49:09.800814 30664 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:49:09.803089 30664 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:49:09.803238 30664 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:49:09.807229 30664 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38437
I20260808 14:49:09.807273 30767 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38437 every 8 connection(s)
I20260808 14:49:09.807605 30664 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
I20260808 14:49:09.808600 30768 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:49:09.811261 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 30664
I20260808 14:49:09.811385 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786200295877777-31578-0/minicluster-data/master-0/wal/instance
I20260808 14:49:09.811564 31578 external_mini_cluster.cc:1428] Setting key 68b7136901865015226b7497d7adc030
I20260808 14:49:09.812107 30768 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0e2952e5bd6749c68e625255ad61a530: Bootstrap starting.
I20260808 14:49:09.812752 30768 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0e2952e5bd6749c68e625255ad61a530: Neither blocks nor log segments found. Creating new log.
I20260808 14:49:09.813023 30768 log.cc:824] T 00000000000000000000000000000000 P 0e2952e5bd6749c68e625255ad61a530: Log is configured to *not* fsync() on all Append() calls
I20260808 14:49:09.813755 30768 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0e2952e5bd6749c68e625255ad61a530: No bootstrap required, opened a new log
I20260808 14:49:09.814218 30779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:09.812121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39833 (local address 127.0.0.1:38437)
0808 14:49:09.812315 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:09.812323 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:09.812350 (+ 27us) server_negotiation.cc:407] Connection header received
0808 14:49:09.812833 (+ 483us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:09.812843 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:09.812888 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:09.813025 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:09.813699 (+ 674us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:09.813704 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:09.813704 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:49:09.813709 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:09.813770 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:49:09.813786 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:09.813953 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:09.813985 (+ 32us) server_negotiation.cc:299] Negotiation successful
0808 14:49:09.814026 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":79,"threads_started":1}
I20260808 14:49:09.815182 31578 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:49:09.816362 30768 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0e2952e5bd6749c68e625255ad61a530 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e2952e5bd6749c68e625255ad61a530" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38437 } }
I20260808 14:49:09.816571 30768 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0e2952e5bd6749c68e625255ad61a530 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:49:09.816612 30768 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0e2952e5bd6749c68e625255ad61a530 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e2952e5bd6749c68e625255ad61a530, State: Initialized, Role: FOLLOWER
I20260808 14:49:09.816757 30768 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0e2952e5bd6749c68e625255ad61a530 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e2952e5bd6749c68e625255ad61a530" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38437 } }
I20260808 14:49:09.816857 30768 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0e2952e5bd6749c68e625255ad61a530 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:49:09.816888 30768 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0e2952e5bd6749c68e625255ad61a530 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:49:09.816973 30768 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0e2952e5bd6749c68e625255ad61a530 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:49:09.817890 30768 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0e2952e5bd6749c68e625255ad61a530 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e2952e5bd6749c68e625255ad61a530" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38437 } }
I20260808 14:49:09.818025 30768 leader_election.cc:302] T 00000000000000000000000000000000 P 0e2952e5bd6749c68e625255ad61a530 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0e2952e5bd6749c68e625255ad61a530; no voters:
I20260808 14:49:09.818219 30768 leader_election.cc:288] T 00000000000000000000000000000000 P 0e2952e5bd6749c68e625255ad61a530 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:49:09.818415 30779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:09.816980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40793 (local address 127.0.0.1:38437)
0808 14:49:09.817062 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:09.817065 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:09.817299 (+ 234us) server_negotiation.cc:407] Connection header received
0808 14:49:09.817342 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:09.817343 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:09.817351 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:09.817436 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:09.818125 (+ 689us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:09.818127 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:09.818128 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:49:09.818135 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:09.818156 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:49:09.818160 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:09.818213 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:09.818315 (+ 102us) server_negotiation.cc:299] Negotiation successful
0808 14:49:09.818331 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 14:49:09.818533 30768 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0e2952e5bd6749c68e625255ad61a530 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:49:09.818787 30796 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0e2952e5bd6749c68e625255ad61a530 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:49:09.819046 30796 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0e2952e5bd6749c68e625255ad61a530 [term 1 LEADER]: Becoming Leader. State: Replica: 0e2952e5bd6749c68e625255ad61a530, State: Running, Role: LEADER
I20260808 14:49:09.819296 30796 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0e2952e5bd6749c68e625255ad61a530 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e2952e5bd6749c68e625255ad61a530" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38437 } }
I20260808 14:49:09.819759 30799 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0e2952e5bd6749c68e625255ad61a530 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0e2952e5bd6749c68e625255ad61a530. Latest consensus state: current_term: 1 leader_uuid: "0e2952e5bd6749c68e625255ad61a530" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e2952e5bd6749c68e625255ad61a530" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38437 } } }
I20260808 14:49:09.819844 30799 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0e2952e5bd6749c68e625255ad61a530 [sys.catalog]: This master's current role is: LEADER
I20260808 14:49:09.819941 30797 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0e2952e5bd6749c68e625255ad61a530 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0e2952e5bd6749c68e625255ad61a530" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e2952e5bd6749c68e625255ad61a530" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38437 } } }
I20260808 14:49:09.820186 30797 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0e2952e5bd6749c68e625255ad61a530 [sys.catalog]: This master's current role is: LEADER
W20260808 14:49:09.820757 30814 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0e2952e5bd6749c68e625255ad61a530: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:49:09.820802 30814 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:49:09.820864 30817 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:49:09.821005 30817 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:49:09.822371 30817 catalog_manager.cc:1347] Generated new cluster ID: 345f6634c4804c30ae622ed83288390d
I20260808 14:49:09.822424 30817 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:49:09.828502 30817 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:49:09.828665 30817 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:49:09.832057 30817 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0e2952e5bd6749c68e625255ad61a530: Generated new TSK 0
I20260808 14:49:09.832240 30817 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:49:09.835419 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 30664
2026-08-08T14:49:09Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1401 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200295877777-31578-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:49:09 dist-test-slave-42z9 krb5kdc[30828](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:49:09 dist-test-slave-42z9 krb5kdc[30828](info): set up 2 sockets
Aug 08 14:49:09 dist-test-slave-42z9 krb5kdc[30828](info): commencing operation
krb5kdc: starting...
W20260808 14:49:10.967855 31578 mini_kdc.cc:121] Time spent starting KDC: real 1.105s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Aug 08 14:49:11 dist-test-slave-42z9 krb5kdc[30828](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200551, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:49:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:49:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200295877777-31578-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200295877777-31578-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 14:49:11.089807 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200295877777-31578-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200295877777-31578-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200295877777-31578-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34845
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200295877777-31578-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41307
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34845
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:49:11.175393 30846 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:49:11.175630 30846 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:49:11.175668 30846 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:49:11.176848 30846 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:49:11.176895 30846 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:49:11.176914 30846 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:49:11.176930 30846 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:49:11.176946 30846 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:49:11.178553 30846 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41307
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200295877777-31578-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200295877777-31578-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34845
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200295877777-31578-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34845
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30846
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200295877777-31578-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:49:11.178815 30846 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:49:11.179034 30846 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:49:11.184183 30854 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:11.184170 30856 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:49:11.184252 30846 server_base.cc:1034] running on GCE node
W20260808 14:49:11.184144 30858 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:49:11.184823 30846 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:49:11.185415 30846 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:49:11.186693 30846 hybrid_clock.cc:648] HybridClock initialized: now 1786200551186675 us; error 37 us; skew 500 ppm
Aug 08 14:49:11 dist-test-slave-42z9 krb5kdc[30828](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200551, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:49:11.189338 30846 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 14:49:11.189834 30846 webserver.cc:460] Webserver started at http://127.0.0.1:43659/ using document root <none> and password file <none>
I20260808 14:49:11.190026 30846 fs_manager.cc:359] Metadata directory not provided
I20260808 14:49:11.190066 30846 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:49:11.190164 30846 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:49:11.191206 30846 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200295877777-31578-0/minicluster-data/master-0/data/instance:
uuid: "a2e704d57a014161b350d5449fb62253"
format_stamp: "Formatted at 2026-08-08 14:49:11 on dist-test-slave-42z9"
server_key: "11a387a12b065c995f34d690874e23b8"
server_key_iv: "c7b07cc571fd57cd8b83e2574ed8d843"
server_key_version: "encryptionkey@0"
I20260808 14:49:11.191520 30846 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200295877777-31578-0/minicluster-data/master-0/wal/instance:
uuid: "a2e704d57a014161b350d5449fb62253"
format_stamp: "Formatted at 2026-08-08 14:49:11 on dist-test-slave-42z9"
server_key: "11a387a12b065c995f34d690874e23b8"
server_key_iv: "c7b07cc571fd57cd8b83e2574ed8d843"
server_key_version: "encryptionkey@0"
I20260808 14:49:11.192775 30846 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 14:49:11.193466 30866 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:49:11.193635 30846 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:49:11.193727 30846 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200295877777-31578-0/minicluster-data/master-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200295877777-31578-0/minicluster-data/master-0/wal
uuid: "a2e704d57a014161b350d5449fb62253"
format_stamp: "Formatted at 2026-08-08 14:49:11 on dist-test-slave-42z9"
server_key: "11a387a12b065c995f34d690874e23b8"
server_key_iv: "c7b07cc571fd57cd8b83e2574ed8d843"
server_key_version: "encryptionkey@0"
I20260808 14:49:11.193794 30846 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200295877777-31578-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200295877777-31578-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200295877777-31578-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:49:11.213670 30846 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:49:11.215560 30846 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:49:11.215706 30846 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:49:11.219753 30846 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34845
I20260808 14:49:11.219800 30946 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34845 every 8 connection(s)
I20260808 14:49:11.220134 30846 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
I20260808 14:49:11.221004 30948 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:49:11.223308 30948 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a2e704d57a014161b350d5449fb62253: Bootstrap starting.
I20260808 14:49:11.223907 30948 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a2e704d57a014161b350d5449fb62253: Neither blocks nor log segments found. Creating new log.
I20260808 14:49:11.224182 30948 log.cc:824] T 00000000000000000000000000000000 P a2e704d57a014161b350d5449fb62253: Log is configured to *not* fsync() on all Append() calls
I20260808 14:49:11.224897 30948 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a2e704d57a014161b350d5449fb62253: No bootstrap required, opened a new log
I20260808 14:49:11.225572 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 30846
I20260808 14:49:11.225682 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786200295877777-31578-0/minicluster-data/master-0/wal/instance
I20260808 14:49:11.225843 31578 external_mini_cluster.cc:1428] Setting key 3b89ad8b012c76b3751efcbaad640992
I20260808 14:49:11.226821 30948 raft_consensus.cc:348] T 00000000000000000000000000000000 P a2e704d57a014161b350d5449fb62253 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2e704d57a014161b350d5449fb62253" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34845 } }
I20260808 14:49:11.226966 30948 raft_consensus.cc:374] T 00000000000000000000000000000000 P a2e704d57a014161b350d5449fb62253 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:49:11.226999 30948 raft_consensus.cc:729] T 00000000000000000000000000000000 P a2e704d57a014161b350d5449fb62253 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2e704d57a014161b350d5449fb62253, State: Initialized, Role: FOLLOWER
I20260808 14:49:11.227146 30948 consensus_queue.cc:260] T 00000000000000000000000000000000 P a2e704d57a014161b350d5449fb62253 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2e704d57a014161b350d5449fb62253" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34845 } }
I20260808 14:49:11.227226 30948 raft_consensus.cc:388] T 00000000000000000000000000000000 P a2e704d57a014161b350d5449fb62253 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:49:11.227258 30948 raft_consensus.cc:482] T 00000000000000000000000000000000 P a2e704d57a014161b350d5449fb62253 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:49:11.227308 30948 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a2e704d57a014161b350d5449fb62253 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:49:11.228201 30948 raft_consensus.cc:504] T 00000000000000000000000000000000 P a2e704d57a014161b350d5449fb62253 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2e704d57a014161b350d5449fb62253" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34845 } }
I20260808 14:49:11.228299 30948 leader_election.cc:302] T 00000000000000000000000000000000 P a2e704d57a014161b350d5449fb62253 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a2e704d57a014161b350d5449fb62253; no voters:
I20260808 14:49:11.228467 30948 leader_election.cc:288] T 00000000000000000000000000000000 P a2e704d57a014161b350d5449fb62253 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:49:11.228507 30955 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a2e704d57a014161b350d5449fb62253 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:49:11.228660 30955 raft_consensus.cc:686] T 00000000000000000000000000000000 P a2e704d57a014161b350d5449fb62253 [term 1 LEADER]: Becoming Leader. State: Replica: a2e704d57a014161b350d5449fb62253, State: Running, Role: LEADER
I20260808 14:49:11.228747 30948 sys_catalog.cc:564] T 00000000000000000000000000000000 P a2e704d57a014161b350d5449fb62253 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:49:11.228797 30955 consensus_queue.cc:237] T 00000000000000000000000000000000 P a2e704d57a014161b350d5449fb62253 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2e704d57a014161b350d5449fb62253" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34845 } }
I20260808 14:49:11.229197 30955 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2e704d57a014161b350d5449fb62253 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a2e704d57a014161b350d5449fb62253. Latest consensus state: current_term: 1 leader_uuid: "a2e704d57a014161b350d5449fb62253" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2e704d57a014161b350d5449fb62253" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34845 } } }
I20260808 14:49:11.229246 30957 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2e704d57a014161b350d5449fb62253 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a2e704d57a014161b350d5449fb62253" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2e704d57a014161b350d5449fb62253" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34845 } } }
I20260808 14:49:11.229331 30955 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2e704d57a014161b350d5449fb62253 [sys.catalog]: This master's current role is: LEADER
I20260808 14:49:11.229338 30957 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2e704d57a014161b350d5449fb62253 [sys.catalog]: This master's current role is: LEADER
I20260808 14:49:11.229599 30975 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:49:11.230189 30975 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:49:11.231972 30975 catalog_manager.cc:1347] Generated new cluster ID: d313f8a23c7b47bba0042c62dc80d86e
I20260808 14:49:11.232028 30975 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 14:49:11 dist-test-slave-42z9 krb5kdc[30828](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200551, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 14:49:11.236630 30953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:11.226381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.33:34221 (local address 127.0.0.1:34845)
0808 14:49:11.226569 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:11.226577 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:11.226604 (+ 27us) server_negotiation.cc:407] Connection header received
0808 14:49:11.226784 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:11.226790 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:11.226838 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:11.226964 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:11.227637 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:11.228654 (+ 1017us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:11.229854 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:11.230479 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:11.230586 (+ 107us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:11.233219 (+ 2633us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:11.233223 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:11.233224 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:11.233237 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:11.234812 (+ 1575us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:11.235190 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:11.235193 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:11.235194 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:11.235344 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:11.235594 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:11.235595 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:11.235595 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:11.235856 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:11.236022 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:11.236146 (+ 124us) server_negotiation.cc:299] Negotiation successful
0808 14:49:11.236252 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":93,"threads_started":1}
I20260808 14:49:11.237640 31578 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:49:11.244652 30953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:11.238930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.33:37161 (local address 127.0.0.1:34845)
0808 14:49:11.238968 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:11.238970 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:11.239085 (+ 115us) server_negotiation.cc:407] Connection header received
0808 14:49:11.239139 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:11.239139 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:11.239149 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:11.239189 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:11.239699 (+ 510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:11.240187 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:11.240846 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:11.241089 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:11.241146 (+ 57us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:11.242327 (+ 1181us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:11.242328 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:11.242329 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:11.242336 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:11.243599 (+ 1263us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:11.243950 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:11.243951 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:11.243951 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:11.244002 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:11.244190 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:11.244191 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:11.244191 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:11.244296 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:11.244396 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:11.244504 (+ 108us) server_negotiation.cc:299] Negotiation successful
0808 14:49:11.244563 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 14:49:11.252570 30975 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:49:11.253306 30975 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:49:11.260545 30975 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a2e704d57a014161b350d5449fb62253: Generated new TSK 0
I20260808 14:49:11.260767 30975 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:49:11.263792 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 30846
W20260808 14:49:11.280063 30821 connection.cc:535] client connection to 127.0.0.1:34845 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34845): Connection reset by peer (error 104)
2026-08-08T14:49:11Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1431 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200295877777-31578-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:49:11 dist-test-slave-42z9 krb5kdc[31000](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:49:11 dist-test-slave-42z9 krb5kdc[31000](info): set up 2 sockets
Aug 08 14:49:11 dist-test-slave-42z9 krb5kdc[31000](info): commencing operation
krb5kdc: starting...
W20260808 14:49:12.412739 31578 mini_kdc.cc:121] Time spent starting KDC: real 1.119s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Aug 08 14:49:12 dist-test-slave-42z9 krb5kdc[31000](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200552, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:49:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:49:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200295877777-31578-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200295877777-31578-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 14:49:12.534215 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200295877777-31578-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200295877777-31578-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200295877777-31578-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46455
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200295877777-31578-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35951
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46455
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:49:12.616451 31017 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:49:12.616670 31017 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:49:12.616695 31017 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:49:12.617857 31017 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:49:12.617899 31017 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:49:12.617911 31017 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:49:12.617923 31017 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:49:12.617942 31017 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:49:12.619524 31017 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35951
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200295877777-31578-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200295877777-31578-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46455
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200295877777-31578-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46455
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31017
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200295877777-31578-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:49:12.619742 31017 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:49:12.619946 31017 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:49:12.624769 31024 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:49:12.624972 31017 server_base.cc:1034] running on GCE node
W20260808 14:49:12.624796 31028 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:12.624773 31023 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:49:12.625300 31017 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:49:12.625639 31017 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:49:12.626776 31017 hybrid_clock.cc:648] HybridClock initialized: now 1786200552626768 us; error 28 us; skew 500 ppm
Aug 08 14:49:12 dist-test-slave-42z9 krb5kdc[31000](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200552, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:49:12.629305 31017 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 14:49:12.629815 31017 webserver.cc:460] Webserver started at http://127.0.0.1:43213/ using document root <none> and password file <none>
I20260808 14:49:12.630038 31017 fs_manager.cc:359] Metadata directory not provided
I20260808 14:49:12.630079 31017 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:49:12.630179 31017 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:49:12.631294 31017 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200295877777-31578-0/minicluster-data/master-0/data/instance:
uuid: "52e0b549f0934958937c23d58392e2c3"
format_stamp: "Formatted at 2026-08-08 14:49:12 on dist-test-slave-42z9"
server_key: "ef1f39dc4646f5bb7afe0709a03dde66"
server_key_iv: "7352508a34b0aa5b19bdddd5ddb362f2"
server_key_version: "encryptionkey@0"
I20260808 14:49:12.631595 31017 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200295877777-31578-0/minicluster-data/master-0/wal/instance:
uuid: "52e0b549f0934958937c23d58392e2c3"
format_stamp: "Formatted at 2026-08-08 14:49:12 on dist-test-slave-42z9"
server_key: "ef1f39dc4646f5bb7afe0709a03dde66"
server_key_iv: "7352508a34b0aa5b19bdddd5ddb362f2"
server_key_version: "encryptionkey@0"
I20260808 14:49:12.632833 31017 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 14:49:12.633577 31040 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:49:12.633734 31017 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 14:49:12.633826 31017 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200295877777-31578-0/minicluster-data/master-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200295877777-31578-0/minicluster-data/master-0/wal
uuid: "52e0b549f0934958937c23d58392e2c3"
format_stamp: "Formatted at 2026-08-08 14:49:12 on dist-test-slave-42z9"
server_key: "ef1f39dc4646f5bb7afe0709a03dde66"
server_key_iv: "7352508a34b0aa5b19bdddd5ddb362f2"
server_key_version: "encryptionkey@0"
I20260808 14:49:12.633896 31017 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200295877777-31578-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200295877777-31578-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200295877777-31578-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:49:12.643447 31017 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:49:12.645720 31017 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:49:12.645871 31017 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:49:12.650305 31017 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46455
I20260808 14:49:12.650344 31122 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46455 every 8 connection(s)
I20260808 14:49:12.650682 31017 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
I20260808 14:49:12.651897 31123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:49:12.654640 31123 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 52e0b549f0934958937c23d58392e2c3: Bootstrap starting.
I20260808 14:49:12.655277 31123 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 52e0b549f0934958937c23d58392e2c3: Neither blocks nor log segments found. Creating new log.
I20260808 14:49:12.655555 31123 log.cc:824] T 00000000000000000000000000000000 P 52e0b549f0934958937c23d58392e2c3: Log is configured to *not* fsync() on all Append() calls
I20260808 14:49:12.656279 31123 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 52e0b549f0934958937c23d58392e2c3: No bootstrap required, opened a new log
I20260808 14:49:12.657987 31123 raft_consensus.cc:348] T 00000000000000000000000000000000 P 52e0b549f0934958937c23d58392e2c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52e0b549f0934958937c23d58392e2c3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46455 } }
I20260808 14:49:12.658140 31123 raft_consensus.cc:374] T 00000000000000000000000000000000 P 52e0b549f0934958937c23d58392e2c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:49:12.658175 31123 raft_consensus.cc:729] T 00000000000000000000000000000000 P 52e0b549f0934958937c23d58392e2c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52e0b549f0934958937c23d58392e2c3, State: Initialized, Role: FOLLOWER
I20260808 14:49:12.658313 31123 consensus_queue.cc:260] T 00000000000000000000000000000000 P 52e0b549f0934958937c23d58392e2c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52e0b549f0934958937c23d58392e2c3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46455 } }
I20260808 14:49:12.658385 31123 raft_consensus.cc:388] T 00000000000000000000000000000000 P 52e0b549f0934958937c23d58392e2c3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:49:12.658424 31123 raft_consensus.cc:482] T 00000000000000000000000000000000 P 52e0b549f0934958937c23d58392e2c3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:49:12.658471 31123 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 52e0b549f0934958937c23d58392e2c3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:49:12.659024 31123 raft_consensus.cc:504] T 00000000000000000000000000000000 P 52e0b549f0934958937c23d58392e2c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52e0b549f0934958937c23d58392e2c3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46455 } }
I20260808 14:49:12.659127 31123 leader_election.cc:302] T 00000000000000000000000000000000 P 52e0b549f0934958937c23d58392e2c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 52e0b549f0934958937c23d58392e2c3; no voters:
I20260808 14:49:12.659291 31123 leader_election.cc:288] T 00000000000000000000000000000000 P 52e0b549f0934958937c23d58392e2c3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:49:12.659337 31126 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 52e0b549f0934958937c23d58392e2c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:49:12.659530 31126 raft_consensus.cc:686] T 00000000000000000000000000000000 P 52e0b549f0934958937c23d58392e2c3 [term 1 LEADER]: Becoming Leader. State: Replica: 52e0b549f0934958937c23d58392e2c3, State: Running, Role: LEADER
I20260808 14:49:12.659575 31123 sys_catalog.cc:564] T 00000000000000000000000000000000 P 52e0b549f0934958937c23d58392e2c3 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:49:12.659627 31126 consensus_queue.cc:237] T 00000000000000000000000000000000 P 52e0b549f0934958937c23d58392e2c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52e0b549f0934958937c23d58392e2c3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46455 } }
I20260808 14:49:12.659902 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 31017
I20260808 14:49:12.660025 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786200295877777-31578-0/minicluster-data/master-0/wal/instance
I20260808 14:49:12.660120 31128 sys_catalog.cc:455] T 00000000000000000000000000000000 P 52e0b549f0934958937c23d58392e2c3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 52e0b549f0934958937c23d58392e2c3. Latest consensus state: current_term: 1 leader_uuid: "52e0b549f0934958937c23d58392e2c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52e0b549f0934958937c23d58392e2c3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46455 } } }
I20260808 14:49:12.660202 31128 sys_catalog.cc:458] T 00000000000000000000000000000000 P 52e0b549f0934958937c23d58392e2c3 [sys.catalog]: This master's current role is: LEADER
I20260808 14:49:12.660215 31578 external_mini_cluster.cc:1428] Setting key c53513f66c6cdf9150d42d238a17f44c
I20260808 14:49:12.660288 31127 sys_catalog.cc:455] T 00000000000000000000000000000000 P 52e0b549f0934958937c23d58392e2c3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "52e0b549f0934958937c23d58392e2c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52e0b549f0934958937c23d58392e2c3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46455 } } }
I20260808 14:49:12.660363 31127 sys_catalog.cc:458] T 00000000000000000000000000000000 P 52e0b549f0934958937c23d58392e2c3 [sys.catalog]: This master's current role is: LEADER
I20260808 14:49:12.660869 31130 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:49:12.661471 31130 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:49:12.663100 31130 catalog_manager.cc:1347] Generated new cluster ID: 59ea75af21e840879b11836cb8af0501
I20260808 14:49:12.663156 31130 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:49:12.665779 31141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:12.660841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.33:40347 (local address 127.0.0.1:46455)
0808 14:49:12.661049 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:12.661059 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:12.661094 (+ 35us) server_negotiation.cc:407] Connection header received
0808 14:49:12.661219 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:12.661227 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:12.661307 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:12.661463 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:12.661678 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:12.663107 (+ 1429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:12.663917 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:12.664323 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:12.664424 (+ 101us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:12.665129 (+ 705us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:12.665133 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:12.665134 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:49:12.665310 (+ 176us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:12.665343 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:49:12.665355 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:12.665426 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:12.665566 (+ 140us) server_negotiation.cc:299] Negotiation successful
0808 14:49:12.665598 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":85,"threads_started":1}
I20260808 14:49:12.670416 31578 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:49:12.676308 31141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:12.671755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.33:34985 (local address 127.0.0.1:46455)
0808 14:49:12.671792 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:12.671794 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:12.673630 (+ 1836us) server_negotiation.cc:407] Connection header received
0808 14:49:12.673725 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:12.673726 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:12.673742 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:12.673791 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:12.673929 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:12.674421 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:12.675113 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:12.675339 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:12.675397 (+ 58us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:12.676060 (+ 663us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:12.676062 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:12.676062 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:49:12.676068 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:12.676085 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:49:12.676089 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:12.676133 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:12.676206 (+ 73us) server_negotiation.cc:299] Negotiation successful
0808 14:49:12.676220 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 14:49:12.689682 31130 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:49:12.690217 31130 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:49:12.702972 31130 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 52e0b549f0934958937c23d58392e2c3: Generated new TSK 0
I20260808 14:49:12.703181 31130 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:49:12.705731 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 31017
W20260808 14:49:12.720682 30995 connection.cc:535] client connection to 127.0.0.1:46455 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46455): Connection reset by peer (error 104)
2026-08-08T14:49:12Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1440 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200295877777-31578-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:49:12 dist-test-slave-42z9 krb5kdc[31164](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:49:12 dist-test-slave-42z9 krb5kdc[31164](info): set up 2 sockets
Aug 08 14:49:12 dist-test-slave-42z9 krb5kdc[31164](info): commencing operation
krb5kdc: starting...
W20260808 14:49:13.850895 31578 mini_kdc.cc:121] Time spent starting KDC: real 1.116s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Aug 08 14:49:13 dist-test-slave-42z9 krb5kdc[31164](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200553, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:49:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:49:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200295877777-31578-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200295877777-31578-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 14:49:13.972409 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200295877777-31578-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200295877777-31578-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200295877777-31578-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35029
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200295877777-31578-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35167
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35029
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:49:14.055660 31185 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:49:14.055899 31185 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:49:14.055932 31185 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:49:14.057137 31185 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:49:14.057180 31185 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:49:14.057199 31185 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:49:14.057214 31185 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:49:14.057230 31185 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:49:14.058763 31185 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35167
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200295877777-31578-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200295877777-31578-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35029
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200295877777-31578-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35029
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31185
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200295877777-31578-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:49:14.059032 31185 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:49:14.059247 31185 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:49:14.064230 31193 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:49:14.064365 31185 server_base.cc:1034] running on GCE node
W20260808 14:49:14.064275 31192 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:14.064410 31195 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:49:14.064786 31185 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:49:14.065078 31185 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:49:14.066231 31185 hybrid_clock.cc:648] HybridClock initialized: now 1786200554066214 us; error 36 us; skew 500 ppm
Aug 08 14:49:14 dist-test-slave-42z9 krb5kdc[31164](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200554, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:49:14.072436 31185 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 14:49:14.072916 31185 webserver.cc:460] Webserver started at http://127.0.0.1:39455/ using document root <none> and password file <none>
I20260808 14:49:14.073143 31185 fs_manager.cc:359] Metadata directory not provided
I20260808 14:49:14.073195 31185 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:49:14.073325 31185 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:49:14.074532 31185 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200295877777-31578-0/minicluster-data/master-0/data/instance:
uuid: "5864134b82fb4c4ba3ca5a29b249af9e"
format_stamp: "Formatted at 2026-08-08 14:49:14 on dist-test-slave-42z9"
server_key: "4938a593cd5ab307061d48abc2f69bd2"
server_key_iv: "8c1b2c3f50b7fb1be27fe3f67d94d72e"
server_key_version: "encryptionkey@0"
I20260808 14:49:14.074887 31185 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200295877777-31578-0/minicluster-data/master-0/wal/instance:
uuid: "5864134b82fb4c4ba3ca5a29b249af9e"
format_stamp: "Formatted at 2026-08-08 14:49:14 on dist-test-slave-42z9"
server_key: "4938a593cd5ab307061d48abc2f69bd2"
server_key_iv: "8c1b2c3f50b7fb1be27fe3f67d94d72e"
server_key_version: "encryptionkey@0"
I20260808 14:49:14.076247 31185 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:49:14.077021 31205 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:49:14.077189 31185 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:49:14.077275 31185 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200295877777-31578-0/minicluster-data/master-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200295877777-31578-0/minicluster-data/master-0/wal
uuid: "5864134b82fb4c4ba3ca5a29b249af9e"
format_stamp: "Formatted at 2026-08-08 14:49:14 on dist-test-slave-42z9"
server_key: "4938a593cd5ab307061d48abc2f69bd2"
server_key_iv: "8c1b2c3f50b7fb1be27fe3f67d94d72e"
server_key_version: "encryptionkey@0"
I20260808 14:49:14.077348 31185 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200295877777-31578-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200295877777-31578-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200295877777-31578-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:49:14.080740 31185 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:49:14.082952 31185 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:49:14.083093 31185 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:49:14.087162 31185 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35029
I20260808 14:49:14.087199 31270 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35029 every 8 connection(s)
I20260808 14:49:14.087535 31185 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
I20260808 14:49:14.087893 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 31185
I20260808 14:49:14.088012 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786200295877777-31578-0/minicluster-data/master-0/wal/instance
I20260808 14:49:14.088188 31578 external_mini_cluster.cc:1428] Setting key 63128fb9e770992d2c376281e8dcb1f8
I20260808 14:49:14.088617 31271 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:49:14.091532 31271 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5864134b82fb4c4ba3ca5a29b249af9e: Bootstrap starting.
I20260808 14:49:14.092187 31271 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5864134b82fb4c4ba3ca5a29b249af9e: Neither blocks nor log segments found. Creating new log.
I20260808 14:49:14.092578 31271 log.cc:824] T 00000000000000000000000000000000 P 5864134b82fb4c4ba3ca5a29b249af9e: Log is configured to *not* fsync() on all Append() calls
I20260808 14:49:14.092722 31277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:14.088713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.33:48327 (local address 127.0.0.1:35029)
0808 14:49:14.088909 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:14.088917 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:14.088944 (+ 27us) server_negotiation.cc:407] Connection header received
0808 14:49:14.089376 (+ 432us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:14.089382 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:14.089431 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:14.089586 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:14.092225 (+ 2639us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:14.092229 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:14.092230 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:49:14.092234 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:14.092288 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:49:14.092303 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:14.092386 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:14.092462 (+ 76us) server_negotiation.cc:299] Negotiation successful
0808 14:49:14.092500 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":81,"threads_started":1}
I20260808 14:49:14.093544 31271 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5864134b82fb4c4ba3ca5a29b249af9e: No bootstrap required, opened a new log
I20260808 14:49:14.093703 31578 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:49:14.095670 31271 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5864134b82fb4c4ba3ca5a29b249af9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5864134b82fb4c4ba3ca5a29b249af9e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35029 } }
I20260808 14:49:14.095873 31271 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5864134b82fb4c4ba3ca5a29b249af9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:49:14.095929 31271 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5864134b82fb4c4ba3ca5a29b249af9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5864134b82fb4c4ba3ca5a29b249af9e, State: Initialized, Role: FOLLOWER
I20260808 14:49:14.096062 31271 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5864134b82fb4c4ba3ca5a29b249af9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5864134b82fb4c4ba3ca5a29b249af9e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35029 } }
I20260808 14:49:14.096146 31277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:14.095060 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.33:49373 (local address 127.0.0.1:35029)
0808 14:49:14.095102 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:14.095104 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:14.095172 (+ 68us) server_negotiation.cc:407] Connection header received
0808 14:49:14.095248 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:14.095248 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:14.095253 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:14.095297 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:14.095929 (+ 632us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:14.095930 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:14.095930 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:49:14.095936 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:14.095952 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:49:14.095956 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:14.096004 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:14.096078 (+ 74us) server_negotiation.cc:299] Negotiation successful
0808 14:49:14.096090 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 14:49:14.096171 31271 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5864134b82fb4c4ba3ca5a29b249af9e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:49:14.096206 31271 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5864134b82fb4c4ba3ca5a29b249af9e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:49:14.096249 31271 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5864134b82fb4c4ba3ca5a29b249af9e [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:49:14.096920 31271 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5864134b82fb4c4ba3ca5a29b249af9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5864134b82fb4c4ba3ca5a29b249af9e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35029 } }
I20260808 14:49:14.097018 31271 leader_election.cc:302] T 00000000000000000000000000000000 P 5864134b82fb4c4ba3ca5a29b249af9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5864134b82fb4c4ba3ca5a29b249af9e; no voters:
I20260808 14:49:14.097150 31271 leader_election.cc:288] T 00000000000000000000000000000000 P 5864134b82fb4c4ba3ca5a29b249af9e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:49:14.097208 31293 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5864134b82fb4c4ba3ca5a29b249af9e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:49:14.097379 31293 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5864134b82fb4c4ba3ca5a29b249af9e [term 1 LEADER]: Becoming Leader. State: Replica: 5864134b82fb4c4ba3ca5a29b249af9e, State: Running, Role: LEADER
I20260808 14:49:14.097393 31271 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5864134b82fb4c4ba3ca5a29b249af9e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:49:14.097508 31293 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5864134b82fb4c4ba3ca5a29b249af9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5864134b82fb4c4ba3ca5a29b249af9e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35029 } }
I20260808 14:49:14.097915 31294 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5864134b82fb4c4ba3ca5a29b249af9e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5864134b82fb4c4ba3ca5a29b249af9e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5864134b82fb4c4ba3ca5a29b249af9e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35029 } } }
I20260808 14:49:14.098021 31294 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5864134b82fb4c4ba3ca5a29b249af9e [sys.catalog]: This master's current role is: LEADER
I20260808 14:49:14.098194 31295 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5864134b82fb4c4ba3ca5a29b249af9e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5864134b82fb4c4ba3ca5a29b249af9e. Latest consensus state: current_term: 1 leader_uuid: "5864134b82fb4c4ba3ca5a29b249af9e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5864134b82fb4c4ba3ca5a29b249af9e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35029 } } }
I20260808 14:49:14.098264 31295 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5864134b82fb4c4ba3ca5a29b249af9e [sys.catalog]: This master's current role is: LEADER
I20260808 14:49:14.098544 31305 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:49:14.099172 31305 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:49:14.100850 31305 catalog_manager.cc:1347] Generated new cluster ID: 8c52ba3cf19448e285f2f271f750f71e
I20260808 14:49:14.100911 31305 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:49:14.124926 31305 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:49:14.125138 31305 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:49:14.129469 31305 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5864134b82fb4c4ba3ca5a29b249af9e: Generated new TSK 0
I20260808 14:49:14.129696 31305 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:49:14.142074 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 31185
2026-08-08T14:49:14Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1431 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200295877777-31578-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:49:14 dist-test-slave-42z9 krb5kdc[31322](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:49:14 dist-test-slave-42z9 krb5kdc[31322](info): set up 2 sockets
Aug 08 14:49:14 dist-test-slave-42z9 krb5kdc[31322](info): commencing operation
krb5kdc: starting...
W20260808 14:49:15.279582 31578 mini_kdc.cc:121] Time spent starting KDC: real 1.114s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Aug 08 14:49:15 dist-test-slave-42z9 krb5kdc[31322](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200555, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:49:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:49:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200295877777-31578-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200295877777-31578-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 14:49:15.405270 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200295877777-31578-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200295877777-31578-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200295877777-31578-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43131
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200295877777-31578-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38711
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43131
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:49:15.489140 31339 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:49:15.489377 31339 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:49:15.489400 31339 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:49:15.490650 31339 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:49:15.490708 31339 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:49:15.490721 31339 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:49:15.490732 31339 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:49:15.490743 31339 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:49:15.492352 31339 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38711
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200295877777-31578-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200295877777-31578-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43131
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200295877777-31578-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43131
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31339
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200295877777-31578-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:49:15.492622 31339 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:49:15.492858 31339 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:49:15.498020 31346 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:49:15.498168 31339 server_base.cc:1034] running on GCE node
W20260808 14:49:15.498054 31347 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:15.498054 31350 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:49:15.498641 31339 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:49:15.499059 31339 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:49:15.500267 31339 hybrid_clock.cc:648] HybridClock initialized: now 1786200555500233 us; error 50 us; skew 500 ppm
Aug 08 14:49:15 dist-test-slave-42z9 krb5kdc[31322](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200555, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:49:15.503209 31339 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 14:49:15.503743 31339 webserver.cc:460] Webserver started at http://127.0.0.1:33603/ using document root <none> and password file <none>
I20260808 14:49:15.503986 31339 fs_manager.cc:359] Metadata directory not provided
I20260808 14:49:15.504034 31339 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:49:15.504170 31339 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:49:15.505242 31339 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200295877777-31578-0/minicluster-data/master-0/data/instance:
uuid: "83983ef9965144adafbbec8c69b7aebc"
format_stamp: "Formatted at 2026-08-08 14:49:15 on dist-test-slave-42z9"
server_key: "8f0993164259c26c46740efcddbb5d0e"
server_key_iv: "20a5927a4559751e882f4a176fc38c54"
server_key_version: "encryptionkey@0"
I20260808 14:49:15.505613 31339 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200295877777-31578-0/minicluster-data/master-0/wal/instance:
uuid: "83983ef9965144adafbbec8c69b7aebc"
format_stamp: "Formatted at 2026-08-08 14:49:15 on dist-test-slave-42z9"
server_key: "8f0993164259c26c46740efcddbb5d0e"
server_key_iv: "20a5927a4559751e882f4a176fc38c54"
server_key_version: "encryptionkey@0"
I20260808 14:49:15.506891 31339 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:49:15.507573 31359 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:49:15.507745 31339 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 14:49:15.507833 31339 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200295877777-31578-0/minicluster-data/master-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200295877777-31578-0/minicluster-data/master-0/wal
uuid: "83983ef9965144adafbbec8c69b7aebc"
format_stamp: "Formatted at 2026-08-08 14:49:15 on dist-test-slave-42z9"
server_key: "8f0993164259c26c46740efcddbb5d0e"
server_key_iv: "20a5927a4559751e882f4a176fc38c54"
server_key_version: "encryptionkey@0"
I20260808 14:49:15.507890 31339 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200295877777-31578-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200295877777-31578-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200295877777-31578-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:49:15.527137 31339 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:49:15.529585 31339 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:49:15.529723 31339 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:49:15.533789 31339 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43131
I20260808 14:49:15.533828 31430 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43131 every 8 connection(s)
I20260808 14:49:15.534204 31339 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
I20260808 14:49:15.535348 31432 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:49:15.537789 31432 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 83983ef9965144adafbbec8c69b7aebc: Bootstrap starting.
I20260808 14:49:15.538403 31432 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 83983ef9965144adafbbec8c69b7aebc: Neither blocks nor log segments found. Creating new log.
I20260808 14:49:15.538673 31432 log.cc:824] T 00000000000000000000000000000000 P 83983ef9965144adafbbec8c69b7aebc: Log is configured to *not* fsync() on all Append() calls
I20260808 14:49:15.539692 31432 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 83983ef9965144adafbbec8c69b7aebc: No bootstrap required, opened a new log
I20260808 14:49:15.541229 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 31339
I20260808 14:49:15.541326 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786200295877777-31578-0/minicluster-data/master-0/wal/instance
I20260808 14:49:15.541527 31578 external_mini_cluster.cc:1428] Setting key a523b93c6873e8466c5e24d6f7917724
I20260808 14:49:15.542114 31432 raft_consensus.cc:348] T 00000000000000000000000000000000 P 83983ef9965144adafbbec8c69b7aebc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83983ef9965144adafbbec8c69b7aebc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43131 } }
I20260808 14:49:15.542359 31432 raft_consensus.cc:374] T 00000000000000000000000000000000 P 83983ef9965144adafbbec8c69b7aebc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:49:15.542402 31432 raft_consensus.cc:729] T 00000000000000000000000000000000 P 83983ef9965144adafbbec8c69b7aebc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83983ef9965144adafbbec8c69b7aebc, State: Initialized, Role: FOLLOWER
I20260808 14:49:15.542563 31432 consensus_queue.cc:260] T 00000000000000000000000000000000 P 83983ef9965144adafbbec8c69b7aebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83983ef9965144adafbbec8c69b7aebc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43131 } }
I20260808 14:49:15.542645 31432 raft_consensus.cc:388] T 00000000000000000000000000000000 P 83983ef9965144adafbbec8c69b7aebc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:49:15.542668 31432 raft_consensus.cc:482] T 00000000000000000000000000000000 P 83983ef9965144adafbbec8c69b7aebc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:49:15.542718 31432 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 83983ef9965144adafbbec8c69b7aebc [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:49:15.543869 31432 raft_consensus.cc:504] T 00000000000000000000000000000000 P 83983ef9965144adafbbec8c69b7aebc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83983ef9965144adafbbec8c69b7aebc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43131 } }
I20260808 14:49:15.544050 31432 leader_election.cc:302] T 00000000000000000000000000000000 P 83983ef9965144adafbbec8c69b7aebc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 83983ef9965144adafbbec8c69b7aebc; no voters:
I20260808 14:49:15.544243 31432 leader_election.cc:288] T 00000000000000000000000000000000 P 83983ef9965144adafbbec8c69b7aebc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:49:15.544281 31441 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 83983ef9965144adafbbec8c69b7aebc [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:49:15.544466 31441 raft_consensus.cc:686] T 00000000000000000000000000000000 P 83983ef9965144adafbbec8c69b7aebc [term 1 LEADER]: Becoming Leader. State: Replica: 83983ef9965144adafbbec8c69b7aebc, State: Running, Role: LEADER
I20260808 14:49:15.544598 31432 sys_catalog.cc:564] T 00000000000000000000000000000000 P 83983ef9965144adafbbec8c69b7aebc [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:49:15.544617 31441 consensus_queue.cc:237] T 00000000000000000000000000000000 P 83983ef9965144adafbbec8c69b7aebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83983ef9965144adafbbec8c69b7aebc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43131 } }
I20260808 14:49:15.545087 31441 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83983ef9965144adafbbec8c69b7aebc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 83983ef9965144adafbbec8c69b7aebc. Latest consensus state: current_term: 1 leader_uuid: "83983ef9965144adafbbec8c69b7aebc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83983ef9965144adafbbec8c69b7aebc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43131 } } }
I20260808 14:49:15.545252 31441 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83983ef9965144adafbbec8c69b7aebc [sys.catalog]: This master's current role is: LEADER
I20260808 14:49:15.545571 31453 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:49:15.545785 31445 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83983ef9965144adafbbec8c69b7aebc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "83983ef9965144adafbbec8c69b7aebc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83983ef9965144adafbbec8c69b7aebc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43131 } } }
I20260808 14:49:15.545923 31445 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83983ef9965144adafbbec8c69b7aebc [sys.catalog]: This master's current role is: LEADER
I20260808 14:49:15.546877 31453 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 08 14:49:15 dist-test-slave-42z9 krb5kdc[31322](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200555, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 14:49:15.549556 31453 catalog_manager.cc:1347] Generated new cluster ID: bf6a29fa16694ac68b8856b42a93c4d4
I20260808 14:49:15.549616 31453 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:49:15.554200 31440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:15.542156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.33:42163 (local address 127.0.0.1:43131)
0808 14:49:15.542343 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:15.542354 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:15.542396 (+ 42us) server_negotiation.cc:407] Connection header received
0808 14:49:15.542548 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:15.542556 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:15.542618 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:15.542786 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:15.543427 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:15.544682 (+ 1255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:15.545714 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:15.546533 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:15.547127 (+ 594us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:15.549807 (+ 2680us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:15.549813 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:15.549814 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:15.549830 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:15.551978 (+ 2148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:15.552453 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:15.552456 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:15.552457 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:15.552598 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:15.552829 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:15.552830 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:15.552830 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:15.553158 (+ 328us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:15.553332 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:15.553825 (+ 493us) server_negotiation.cc:299] Negotiation successful
0808 14:49:15.553939 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":85,"threads_started":1}
I20260808 14:49:15.555403 31578 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:49:15.555512 31453 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:49:15.556205 31453 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:49:15.559926 31453 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 83983ef9965144adafbbec8c69b7aebc: Generated new TSK 0
I20260808 14:49:15.560150 31453 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:49:15.566795 31440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:15.557287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.33:57121 (local address 127.0.0.1:43131)
0808 14:49:15.557377 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:15.557380 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:15.559305 (+ 1925us) server_negotiation.cc:407] Connection header received
0808 14:49:15.559363 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:15.559364 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:15.559379 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:15.559464 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:15.560631 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:15.561611 (+ 980us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:15.562344 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:15.562699 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:15.562763 (+ 64us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:15.563981 (+ 1218us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:15.563983 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:15.563983 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:15.563992 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:15.565662 (+ 1670us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:15.566032 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:15.566034 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:15.566034 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:15.566096 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:15.566268 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:15.566269 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:15.566269 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:15.566408 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:15.566518 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:15.566614 (+ 96us) server_negotiation.cc:299] Negotiation successful
0808 14:49:15.566680 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 14:49:15.568778 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 31339
W20260808 14:49:15.585947 31319 connection.cc:535] client connection to 127.0.0.1:43131 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43131): Connection reset by peer (error 104)
2026-08-08T14:49:15Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1433 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200295877777-31578-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:49:15 dist-test-slave-42z9 krb5kdc[31484](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:49:15 dist-test-slave-42z9 krb5kdc[31484](info): set up 2 sockets
Aug 08 14:49:15 dist-test-slave-42z9 krb5kdc[31484](info): commencing operation
krb5kdc: starting...
W20260808 14:49:16.724526 31578 mini_kdc.cc:121] Time spent starting KDC: real 1.125s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Aug 08 14:49:16 dist-test-slave-42z9 krb5kdc[31484](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200556, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:49:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:49:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200295877777-31578-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200295877777-31578-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 14:49:16.843346 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200295877777-31578-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200295877777-31578-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200295877777-31578-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41273
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200295877777-31578-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45441
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41273
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:49:16.926050 31505 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:49:16.926259 31505 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:49:16.926291 31505 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:49:16.927431 31505 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:49:16.927480 31505 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:49:16.927500 31505 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:49:16.927516 31505 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:49:16.927531 31505 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:49:16.929000 31505 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45441
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200295877777-31578-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200295877777-31578-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41273
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200295877777-31578-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41273
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31505
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200295877777-31578-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:49:16.929246 31505 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:49:16.929497 31505 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:49:16.934082 31516 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:16.934082 31518 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:16.934110 31512 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:49:16.934485 31505 server_base.cc:1034] running on GCE node
I20260808 14:49:16.934722 31505 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:49:16.934969 31505 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:49:16.936105 31505 hybrid_clock.cc:648] HybridClock initialized: now 1786200556936094 us; error 31 us; skew 500 ppm
Aug 08 14:49:16 dist-test-slave-42z9 krb5kdc[31484](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200556, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:49:16.938545 31505 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 14:49:16.938947 31505 webserver.cc:460] Webserver started at http://127.0.0.1:41435/ using document root <none> and password file <none>
I20260808 14:49:16.939139 31505 fs_manager.cc:359] Metadata directory not provided
I20260808 14:49:16.939180 31505 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:49:16.939296 31505 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:49:16.940330 31505 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200295877777-31578-0/minicluster-data/master-0/data/instance:
uuid: "96eadd811c2f458caec2908596a895cf"
format_stamp: "Formatted at 2026-08-08 14:49:16 on dist-test-slave-42z9"
server_key: "9facda91a351b75b7a7e2e0632683e47"
server_key_iv: "b1c2c37e6544653f2ac2a78a753b737a"
server_key_version: "encryptionkey@0"
I20260808 14:49:16.940665 31505 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200295877777-31578-0/minicluster-data/master-0/wal/instance:
uuid: "96eadd811c2f458caec2908596a895cf"
format_stamp: "Formatted at 2026-08-08 14:49:16 on dist-test-slave-42z9"
server_key: "9facda91a351b75b7a7e2e0632683e47"
server_key_iv: "b1c2c37e6544653f2ac2a78a753b737a"
server_key_version: "encryptionkey@0"
I20260808 14:49:16.941978 31505 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:49:16.942629 31526 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:49:16.942768 31505 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:49:16.942845 31505 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200295877777-31578-0/minicluster-data/master-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200295877777-31578-0/minicluster-data/master-0/wal
uuid: "96eadd811c2f458caec2908596a895cf"
format_stamp: "Formatted at 2026-08-08 14:49:16 on dist-test-slave-42z9"
server_key: "9facda91a351b75b7a7e2e0632683e47"
server_key_iv: "b1c2c37e6544653f2ac2a78a753b737a"
server_key_version: "encryptionkey@0"
I20260808 14:49:16.942911 31505 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200295877777-31578-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200295877777-31578-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200295877777-31578-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:49:16.958525 31505 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:49:16.960408 31505 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:49:16.960547 31505 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:49:16.964488 31505 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41273
I20260808 14:49:16.964524 31608 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41273 every 8 connection(s)
I20260808 14:49:16.964848 31505 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
I20260808 14:49:16.965713 31610 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:49:16.968016 31610 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 96eadd811c2f458caec2908596a895cf: Bootstrap starting.
I20260808 14:49:16.968601 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 31505
I20260808 14:49:16.968611 31610 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 96eadd811c2f458caec2908596a895cf: Neither blocks nor log segments found. Creating new log.
I20260808 14:49:16.968703 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786200295877777-31578-0/minicluster-data/master-0/wal/instance
I20260808 14:49:16.968875 31578 external_mini_cluster.cc:1428] Setting key b586f0bb897b9d715054042c1842146d
I20260808 14:49:16.968896 31610 log.cc:824] T 00000000000000000000000000000000 P 96eadd811c2f458caec2908596a895cf: Log is configured to *not* fsync() on all Append() calls
I20260808 14:49:16.969686 31610 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 96eadd811c2f458caec2908596a895cf: No bootstrap required, opened a new log
I20260808 14:49:16.971587 31610 raft_consensus.cc:348] T 00000000000000000000000000000000 P 96eadd811c2f458caec2908596a895cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96eadd811c2f458caec2908596a895cf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41273 } }
I20260808 14:49:16.971724 31610 raft_consensus.cc:374] T 00000000000000000000000000000000 P 96eadd811c2f458caec2908596a895cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:49:16.971755 31610 raft_consensus.cc:729] T 00000000000000000000000000000000 P 96eadd811c2f458caec2908596a895cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96eadd811c2f458caec2908596a895cf, State: Initialized, Role: FOLLOWER
I20260808 14:49:16.971879 31610 consensus_queue.cc:260] T 00000000000000000000000000000000 P 96eadd811c2f458caec2908596a895cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96eadd811c2f458caec2908596a895cf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41273 } }
I20260808 14:49:16.971952 31610 raft_consensus.cc:388] T 00000000000000000000000000000000 P 96eadd811c2f458caec2908596a895cf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:49:16.971984 31610 raft_consensus.cc:482] T 00000000000000000000000000000000 P 96eadd811c2f458caec2908596a895cf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:49:16.972031 31610 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 96eadd811c2f458caec2908596a895cf [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:49:16.972728 31610 raft_consensus.cc:504] T 00000000000000000000000000000000 P 96eadd811c2f458caec2908596a895cf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96eadd811c2f458caec2908596a895cf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41273 } }
I20260808 14:49:16.972839 31610 leader_election.cc:302] T 00000000000000000000000000000000 P 96eadd811c2f458caec2908596a895cf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 96eadd811c2f458caec2908596a895cf; no voters:
I20260808 14:49:16.973008 31610 leader_election.cc:288] T 00000000000000000000000000000000 P 96eadd811c2f458caec2908596a895cf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:49:16.973057 31619 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 96eadd811c2f458caec2908596a895cf [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:49:16.973268 31610 sys_catalog.cc:564] T 00000000000000000000000000000000 P 96eadd811c2f458caec2908596a895cf [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:49:16.973573 31619 raft_consensus.cc:686] T 00000000000000000000000000000000 P 96eadd811c2f458caec2908596a895cf [term 1 LEADER]: Becoming Leader. State: Replica: 96eadd811c2f458caec2908596a895cf, State: Running, Role: LEADER
I20260808 14:49:16.973708 31619 consensus_queue.cc:237] T 00000000000000000000000000000000 P 96eadd811c2f458caec2908596a895cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96eadd811c2f458caec2908596a895cf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41273 } }
I20260808 14:49:16.974071 31622 sys_catalog.cc:455] T 00000000000000000000000000000000 P 96eadd811c2f458caec2908596a895cf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 96eadd811c2f458caec2908596a895cf. Latest consensus state: current_term: 1 leader_uuid: "96eadd811c2f458caec2908596a895cf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96eadd811c2f458caec2908596a895cf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41273 } } }
I20260808 14:49:16.974151 31622 sys_catalog.cc:458] T 00000000000000000000000000000000 P 96eadd811c2f458caec2908596a895cf [sys.catalog]: This master's current role is: LEADER
I20260808 14:49:16.974527 31618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:16.969346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.33:54937 (local address 127.0.0.1:41273)
0808 14:49:16.969536 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:16.969545 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:16.969579 (+ 34us) server_negotiation.cc:407] Connection header received
0808 14:49:16.970024 (+ 445us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:16.970031 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:16.970081 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:16.970202 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:16.970416 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:16.971277 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:16.972139 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:16.972735 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:16.972854 (+ 119us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:16.973608 (+ 754us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:16.973612 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:16.973612 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:49:16.973818 (+ 206us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:16.973861 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:49:16.973876 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:16.973976 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:16.974264 (+ 288us) server_negotiation.cc:299] Negotiation successful
0808 14:49:16.974293 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":73,"threads_started":1}
I20260808 14:49:16.974364 31621 sys_catalog.cc:455] T 00000000000000000000000000000000 P 96eadd811c2f458caec2908596a895cf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "96eadd811c2f458caec2908596a895cf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96eadd811c2f458caec2908596a895cf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41273 } } }
I20260808 14:49:16.974656 31621 sys_catalog.cc:458] T 00000000000000000000000000000000 P 96eadd811c2f458caec2908596a895cf [sys.catalog]: This master's current role is: LEADER
I20260808 14:49:16.974768 31635 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:49:16.975282 31635 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:49:16.975646 31578 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:49:16.976912 31635 catalog_manager.cc:1347] Generated new cluster ID: 68f7767544374be5a1c955e41b4b11b0
I20260808 14:49:16.976959 31635 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:49:16.981145 31618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:16.977714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.33:57905 (local address 127.0.0.1:41273)
0808 14:49:16.977753 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:16.977754 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:16.977901 (+ 147us) server_negotiation.cc:407] Connection header received
0808 14:49:16.977964 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:16.977965 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:16.977975 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:16.978026 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:16.978160 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:16.978882 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:16.979884 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:16.980175 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:16.980227 (+ 52us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:16.980892 (+ 665us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:16.980893 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:16.980894 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:49:16.980898 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:16.980913 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:49:16.980917 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:16.980968 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:16.981064 (+ 96us) server_negotiation.cc:299] Negotiation successful
0808 14:49:16.981074 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 14:49:16.996822 31635 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:49:16.997617 31635 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:49:17.005906 31635 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 96eadd811c2f458caec2908596a895cf: Generated new TSK 0
I20260808 14:49:17.006147 31635 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:49:17.008919 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 31505
W20260808 14:49:17.025914 31481 connection.cc:535] client connection to 127.0.0.1:41273 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41273): Connection reset by peer (error 104)
2026-08-08T14:49:17Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1439 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200295877777-31578-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:49:17 dist-test-slave-42z9 krb5kdc[31661](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:49:17 dist-test-slave-42z9 krb5kdc[31661](info): set up 2 sockets
Aug 08 14:49:17 dist-test-slave-42z9 krb5kdc[31661](info): commencing operation
krb5kdc: starting...
W20260808 14:49:18.154891 31578 mini_kdc.cc:121] Time spent starting KDC: real 1.115s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Aug 08 14:49:18 dist-test-slave-42z9 krb5kdc[31661](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200558, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:49:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:49:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200295877777-31578-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200295877777-31578-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 14:49:18.292279 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200295877777-31578-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200295877777-31578-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200295877777-31578-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35927
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200295877777-31578-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34667
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35927
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:49:18.377303 31678 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:49:18.377581 31678 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:49:18.377617 31678 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:49:18.378866 31678 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:49:18.378922 31678 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:49:18.378942 31678 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:49:18.378957 31678 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:49:18.378981 31678 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:49:18.380626 31678 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34667
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200295877777-31578-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200295877777-31578-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35927
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200295877777-31578-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35927
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31678
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200295877777-31578-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:49:18.380909 31678 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:49:18.381145 31678 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:49:18.386119 31688 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:49:18.386219 31678 server_base.cc:1034] running on GCE node
W20260808 14:49:18.386113 31687 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:18.386113 31693 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:49:18.386664 31678 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:49:18.386977 31678 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:49:18.388118 31678 hybrid_clock.cc:648] HybridClock initialized: now 1786200558388101 us; error 36 us; skew 500 ppm
Aug 08 14:49:18 dist-test-slave-42z9 krb5kdc[31661](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200558, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:49:18.390637 31678 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 14:49:18.391103 31678 webserver.cc:460] Webserver started at http://127.0.0.1:39151/ using document root <none> and password file <none>
I20260808 14:49:18.391290 31678 fs_manager.cc:359] Metadata directory not provided
I20260808 14:49:18.391330 31678 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:49:18.391422 31678 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:49:18.392521 31678 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200295877777-31578-0/minicluster-data/master-0/data/instance:
uuid: "73c8a5a406af44f88eba71e4375dbeb9"
format_stamp: "Formatted at 2026-08-08 14:49:18 on dist-test-slave-42z9"
server_key: "05377bb9a130292d877982d20ced5bcc"
server_key_iv: "4fd1c8f892dd43ff9805f4e4ca36ac92"
server_key_version: "encryptionkey@0"
I20260808 14:49:18.392839 31678 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200295877777-31578-0/minicluster-data/master-0/wal/instance:
uuid: "73c8a5a406af44f88eba71e4375dbeb9"
format_stamp: "Formatted at 2026-08-08 14:49:18 on dist-test-slave-42z9"
server_key: "05377bb9a130292d877982d20ced5bcc"
server_key_iv: "4fd1c8f892dd43ff9805f4e4ca36ac92"
server_key_version: "encryptionkey@0"
I20260808 14:49:18.394197 31678 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:49:18.394886 31702 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:49:18.395051 31678 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:49:18.395138 31678 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200295877777-31578-0/minicluster-data/master-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200295877777-31578-0/minicluster-data/master-0/wal
uuid: "73c8a5a406af44f88eba71e4375dbeb9"
format_stamp: "Formatted at 2026-08-08 14:49:18 on dist-test-slave-42z9"
server_key: "05377bb9a130292d877982d20ced5bcc"
server_key_iv: "4fd1c8f892dd43ff9805f4e4ca36ac92"
server_key_version: "encryptionkey@0"
I20260808 14:49:18.395207 31678 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200295877777-31578-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200295877777-31578-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200295877777-31578-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:49:18.398658 31678 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:49:18.400539 31678 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:49:18.400681 31678 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:49:18.405035 31678 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35927
I20260808 14:49:18.405079 31784 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35927 every 8 connection(s)
I20260808 14:49:18.405411 31678 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
I20260808 14:49:18.406327 31786 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:49:18.408097 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 31678
I20260808 14:49:18.408224 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786200295877777-31578-0/minicluster-data/master-0/wal/instance
I20260808 14:49:18.408388 31578 external_mini_cluster.cc:1428] Setting key 2f1d51938b1a0307ad53a8f826c771e6
I20260808 14:49:18.409019 31786 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 73c8a5a406af44f88eba71e4375dbeb9: Bootstrap starting.
I20260808 14:49:18.409704 31786 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 73c8a5a406af44f88eba71e4375dbeb9: Neither blocks nor log segments found. Creating new log.
I20260808 14:49:18.409976 31786 log.cc:824] T 00000000000000000000000000000000 P 73c8a5a406af44f88eba71e4375dbeb9: Log is configured to *not* fsync() on all Append() calls
I20260808 14:49:18.410840 31789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:18.408976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.33:55529 (local address 127.0.0.1:35927)
0808 14:49:18.409151 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:18.409159 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:18.409185 (+ 26us) server_negotiation.cc:407] Connection header received
0808 14:49:18.409674 (+ 489us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:18.409682 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:18.409709 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:18.409860 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:18.410453 (+ 593us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:18.410457 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:18.410457 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:49:18.410461 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:18.410497 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:49:18.410507 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:18.410580 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:18.410630 (+ 50us) server_negotiation.cc:299] Negotiation successful
0808 14:49:18.410675 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":78,"threads_started":1}
I20260808 14:49:18.410961 31786 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 73c8a5a406af44f88eba71e4375dbeb9: No bootstrap required, opened a new log
I20260808 14:49:18.411854 31578 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:49:18.413197 31786 raft_consensus.cc:348] T 00000000000000000000000000000000 P 73c8a5a406af44f88eba71e4375dbeb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73c8a5a406af44f88eba71e4375dbeb9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35927 } }
I20260808 14:49:18.413412 31786 raft_consensus.cc:374] T 00000000000000000000000000000000 P 73c8a5a406af44f88eba71e4375dbeb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:49:18.413484 31786 raft_consensus.cc:729] T 00000000000000000000000000000000 P 73c8a5a406af44f88eba71e4375dbeb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73c8a5a406af44f88eba71e4375dbeb9, State: Initialized, Role: FOLLOWER
I20260808 14:49:18.413609 31786 consensus_queue.cc:260] T 00000000000000000000000000000000 P 73c8a5a406af44f88eba71e4375dbeb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73c8a5a406af44f88eba71e4375dbeb9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35927 } }
I20260808 14:49:18.413707 31786 raft_consensus.cc:388] T 00000000000000000000000000000000 P 73c8a5a406af44f88eba71e4375dbeb9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:49:18.413743 31786 raft_consensus.cc:482] T 00000000000000000000000000000000 P 73c8a5a406af44f88eba71e4375dbeb9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:49:18.413823 31786 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 73c8a5a406af44f88eba71e4375dbeb9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:49:18.414191 31789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:18.413182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.33:56241 (local address 127.0.0.1:35927)
0808 14:49:18.413221 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:18.413222 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:18.413293 (+ 71us) server_negotiation.cc:407] Connection header received
0808 14:49:18.413356 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:18.413357 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:18.413361 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:18.413405 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:18.414004 (+ 599us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:18.414006 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:18.414006 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:49:18.414010 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:18.414024 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:49:18.414028 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:18.414073 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:18.414124 (+ 51us) server_negotiation.cc:299] Negotiation successful
0808 14:49:18.414134 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 14:49:18.414603 31786 raft_consensus.cc:504] T 00000000000000000000000000000000 P 73c8a5a406af44f88eba71e4375dbeb9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73c8a5a406af44f88eba71e4375dbeb9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35927 } }
I20260808 14:49:18.414714 31786 leader_election.cc:302] T 00000000000000000000000000000000 P 73c8a5a406af44f88eba71e4375dbeb9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 73c8a5a406af44f88eba71e4375dbeb9; no voters:
I20260808 14:49:18.414881 31786 leader_election.cc:288] T 00000000000000000000000000000000 P 73c8a5a406af44f88eba71e4375dbeb9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:49:18.414907 31797 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 73c8a5a406af44f88eba71e4375dbeb9 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:49:18.415062 31797 raft_consensus.cc:686] T 00000000000000000000000000000000 P 73c8a5a406af44f88eba71e4375dbeb9 [term 1 LEADER]: Becoming Leader. State: Replica: 73c8a5a406af44f88eba71e4375dbeb9, State: Running, Role: LEADER
I20260808 14:49:18.415129 31786 sys_catalog.cc:564] T 00000000000000000000000000000000 P 73c8a5a406af44f88eba71e4375dbeb9 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:49:18.415177 31797 consensus_queue.cc:237] T 00000000000000000000000000000000 P 73c8a5a406af44f88eba71e4375dbeb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73c8a5a406af44f88eba71e4375dbeb9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35927 } }
I20260808 14:49:18.415584 31801 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73c8a5a406af44f88eba71e4375dbeb9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 73c8a5a406af44f88eba71e4375dbeb9. Latest consensus state: current_term: 1 leader_uuid: "73c8a5a406af44f88eba71e4375dbeb9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73c8a5a406af44f88eba71e4375dbeb9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35927 } } }
I20260808 14:49:18.415565 31798 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73c8a5a406af44f88eba71e4375dbeb9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "73c8a5a406af44f88eba71e4375dbeb9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73c8a5a406af44f88eba71e4375dbeb9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35927 } } }
I20260808 14:49:18.415719 31801 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73c8a5a406af44f88eba71e4375dbeb9 [sys.catalog]: This master's current role is: LEADER
I20260808 14:49:18.415726 31798 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73c8a5a406af44f88eba71e4375dbeb9 [sys.catalog]: This master's current role is: LEADER
I20260808 14:49:18.415930 31810 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:49:18.416429 31810 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:49:18.418125 31810 catalog_manager.cc:1347] Generated new cluster ID: 39778474e3ab434296ff6b0645cd3511
I20260808 14:49:18.418172 31810 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:49:18.452123 31810 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:49:18.452312 31810 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:49:18.454878 31810 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 73c8a5a406af44f88eba71e4375dbeb9: Generated new TSK 0
I20260808 14:49:18.455096 31810 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:49:18.469745 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 31678
2026-08-08T14:49:18Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1455 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200295877777-31578-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:49:18 dist-test-slave-42z9 krb5kdc[31829](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:49:18 dist-test-slave-42z9 krb5kdc[31829](info): set up 2 sockets
Aug 08 14:49:18 dist-test-slave-42z9 krb5kdc[31829](info): commencing operation
krb5kdc: starting...
W20260808 14:49:19.608922 31578 mini_kdc.cc:121] Time spent starting KDC: real 1.114s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Aug 08 14:49:19 dist-test-slave-42z9 krb5kdc[31829](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200559, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:49:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:49:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.214.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab.
Entry for principal kudu/127.30.214.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab.
I20260808 14:49:19.736033 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200295877777-31578-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200295877777-31578-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200295877777-31578-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:36185
--webserver_interface=127.30.214.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab
--principal=kudu/127.30.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:45737
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.214.190:36185
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:49:19.820194 31849 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:49:19.820441 31849 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:49:19.820479 31849 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:49:19.821718 31849 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:49:19.821767 31849 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:49:19.821784 31849 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:49:19.821801 31849 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:49:19.821816 31849 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:49:19.823375 31849 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:45737
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200295877777-31578-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200295877777-31578-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.214.190:36185
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab
--principal=kudu/127.30.214.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:36185
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31849
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200295877777-31578-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:49:19.823652 31849 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:49:19.823876 31849 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:49:19.828725 31858 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:19.828730 31861 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:49:19.828748 31849 server_base.cc:1034] running on GCE node
W20260808 14:49:19.828733 31859 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:49:19.829216 31849 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:49:19.829559 31849 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:49:19.830704 31849 hybrid_clock.cc:648] HybridClock initialized: now 1786200559830688 us; error 41 us; skew 500 ppm
Aug 08 14:49:19 dist-test-slave-42z9 krb5kdc[31829](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200559, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:49:19.835920 31849 init.cc:377] Logged in from keytab as kudu/127.30.214.190@KRBTEST.COM (short username kudu)
I20260808 14:49:19.836424 31849 webserver.cc:460] Webserver started at http://127.30.214.190:36917/ using document root <none> and password file <none>
I20260808 14:49:19.836651 31849 fs_manager.cc:359] Metadata directory not provided
I20260808 14:49:19.836701 31849 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:49:19.836833 31849 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:49:19.837980 31849 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200295877777-31578-0/minicluster-data/master-0/data/instance:
uuid: "ef7d4d8003b64fe0bec23fbbfefe57a5"
format_stamp: "Formatted at 2026-08-08 14:49:19 on dist-test-slave-42z9"
server_key: "5971da4779cba13ba35b12521d1932c1"
server_key_iv: "258c339d9dfde43290fcad9e77c7dbc6"
server_key_version: "encryptionkey@0"
I20260808 14:49:19.838343 31849 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200295877777-31578-0/minicluster-data/master-0/wal/instance:
uuid: "ef7d4d8003b64fe0bec23fbbfefe57a5"
format_stamp: "Formatted at 2026-08-08 14:49:19 on dist-test-slave-42z9"
server_key: "5971da4779cba13ba35b12521d1932c1"
server_key_iv: "258c339d9dfde43290fcad9e77c7dbc6"
server_key_version: "encryptionkey@0"
I20260808 14:49:19.839640 31849 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:49:19.840370 31872 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:49:19.840533 31849 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:49:19.840622 31849 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200295877777-31578-0/minicluster-data/master-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200295877777-31578-0/minicluster-data/master-0/wal
uuid: "ef7d4d8003b64fe0bec23fbbfefe57a5"
format_stamp: "Formatted at 2026-08-08 14:49:19 on dist-test-slave-42z9"
server_key: "5971da4779cba13ba35b12521d1932c1"
server_key_iv: "258c339d9dfde43290fcad9e77c7dbc6"
server_key_version: "encryptionkey@0"
I20260808 14:49:19.840685 31849 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200295877777-31578-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200295877777-31578-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200295877777-31578-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:49:19.853225 31849 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:49:19.855468 31849 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:49:19.855615 31849 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:49:19.859694 31849 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.190:36185
I20260808 14:49:19.859746 31953 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.190:36185 every 8 connection(s)
I20260808 14:49:19.860116 31849 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
I20260808 14:49:19.861030 31954 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:49:19.863302 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 31849
I20260808 14:49:19.863435 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786200295877777-31578-0/minicluster-data/master-0/wal/instance
I20260808 14:49:19.863584 31954 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef7d4d8003b64fe0bec23fbbfefe57a5: Bootstrap starting.
I20260808 14:49:19.863620 31578 external_mini_cluster.cc:1428] Setting key 735bf06d53e18b1189713878373318eb
I20260808 14:49:19.864279 31954 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ef7d4d8003b64fe0bec23fbbfefe57a5: Neither blocks nor log segments found. Creating new log.
I20260808 14:49:19.864625 31954 log.cc:824] T 00000000000000000000000000000000 P ef7d4d8003b64fe0bec23fbbfefe57a5: Log is configured to *not* fsync() on all Append() calls
I20260808 14:49:19.865415 31954 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef7d4d8003b64fe0bec23fbbfefe57a5: No bootstrap required, opened a new log
I20260808 14:49:19.867720 31954 raft_consensus.cc:348] T 00000000000000000000000000000000 P ef7d4d8003b64fe0bec23fbbfefe57a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef7d4d8003b64fe0bec23fbbfefe57a5" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 36185 } }
I20260808 14:49:19.867899 31954 raft_consensus.cc:374] T 00000000000000000000000000000000 P ef7d4d8003b64fe0bec23fbbfefe57a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:49:19.867930 31954 raft_consensus.cc:729] T 00000000000000000000000000000000 P ef7d4d8003b64fe0bec23fbbfefe57a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef7d4d8003b64fe0bec23fbbfefe57a5, State: Initialized, Role: FOLLOWER
I20260808 14:49:19.868058 31954 consensus_queue.cc:260] T 00000000000000000000000000000000 P ef7d4d8003b64fe0bec23fbbfefe57a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef7d4d8003b64fe0bec23fbbfefe57a5" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 36185 } }
I20260808 14:49:19.868139 31954 raft_consensus.cc:388] T 00000000000000000000000000000000 P ef7d4d8003b64fe0bec23fbbfefe57a5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:49:19.868227 31954 raft_consensus.cc:482] T 00000000000000000000000000000000 P ef7d4d8003b64fe0bec23fbbfefe57a5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:49:19.868270 31954 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ef7d4d8003b64fe0bec23fbbfefe57a5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:49:19.868928 31954 raft_consensus.cc:504] T 00000000000000000000000000000000 P ef7d4d8003b64fe0bec23fbbfefe57a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef7d4d8003b64fe0bec23fbbfefe57a5" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 36185 } }
I20260808 14:49:19.869052 31954 leader_election.cc:302] T 00000000000000000000000000000000 P ef7d4d8003b64fe0bec23fbbfefe57a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ef7d4d8003b64fe0bec23fbbfefe57a5; no voters:
I20260808 14:49:19.869215 31954 leader_election.cc:288] T 00000000000000000000000000000000 P ef7d4d8003b64fe0bec23fbbfefe57a5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:49:19.869264 31959 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ef7d4d8003b64fe0bec23fbbfefe57a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:49:19.869494 31959 raft_consensus.cc:686] T 00000000000000000000000000000000 P ef7d4d8003b64fe0bec23fbbfefe57a5 [term 1 LEADER]: Becoming Leader. State: Replica: ef7d4d8003b64fe0bec23fbbfefe57a5, State: Running, Role: LEADER
I20260808 14:49:19.869570 31954 sys_catalog.cc:564] T 00000000000000000000000000000000 P ef7d4d8003b64fe0bec23fbbfefe57a5 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:49:19.869637 31959 consensus_queue.cc:237] T 00000000000000000000000000000000 P ef7d4d8003b64fe0bec23fbbfefe57a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef7d4d8003b64fe0bec23fbbfefe57a5" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 36185 } }
I20260808 14:49:19.870008 31959 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef7d4d8003b64fe0bec23fbbfefe57a5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ef7d4d8003b64fe0bec23fbbfefe57a5. Latest consensus state: current_term: 1 leader_uuid: "ef7d4d8003b64fe0bec23fbbfefe57a5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef7d4d8003b64fe0bec23fbbfefe57a5" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 36185 } } }
I20260808 14:49:19.870064 31962 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef7d4d8003b64fe0bec23fbbfefe57a5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ef7d4d8003b64fe0bec23fbbfefe57a5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef7d4d8003b64fe0bec23fbbfefe57a5" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 36185 } } }
I20260808 14:49:19.870152 31959 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef7d4d8003b64fe0bec23fbbfefe57a5 [sys.catalog]: This master's current role is: LEADER
I20260808 14:49:19.870158 31962 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef7d4d8003b64fe0bec23fbbfefe57a5 [sys.catalog]: This master's current role is: LEADER
I20260808 14:49:19.870398 31971 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Aug 08 14:49:19 dist-test-slave-42z9 krb5kdc[31829](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200559, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:49:19.871168 31971 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:49:19.872951 31971 catalog_manager.cc:1347] Generated new cluster ID: 845b1292083a4713ad95b7f09bc8114a
I20260808 14:49:19.873019 31971 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:49:19.875222 31957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:19.864187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38681 (local address 127.30.214.190:36185)
0808 14:49:19.864374 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:19.864384 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:19.864618 (+ 234us) server_negotiation.cc:407] Connection header received
0808 14:49:19.865224 (+ 606us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:19.865233 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:19.865284 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:19.865400 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:19.866232 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:19.867146 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:19.868194 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:19.868678 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:19.868756 (+ 78us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:19.871859 (+ 3103us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:19.871863 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:19.871864 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:19.871877 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:19.873700 (+ 1823us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:19.874097 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:19.874101 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:19.874101 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:19.874190 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:19.874397 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:19.874398 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:19.874398 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:19.874641 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:19.874800 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:19.874944 (+ 144us) server_negotiation.cc:299] Negotiation successful
0808 14:49:19.875056 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":70,"threads_started":1}
I20260808 14:49:19.878443 31578 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:49:19.879468 31971 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:49:19.880180 31971 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:49:19.885072 31971 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ef7d4d8003b64fe0bec23fbbfefe57a5: Generated new TSK 0
I20260808 14:49:19.885281 31971 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:49:19.890813 31957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:19.881803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49131 (local address 127.30.214.190:36185)
0808 14:49:19.881842 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:19.881844 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:19.884905 (+ 3061us) server_negotiation.cc:407] Connection header received
0808 14:49:19.884958 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:19.884959 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:19.884971 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:19.885024 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:19.885712 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:19.886247 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:19.886947 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:19.887176 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:19.887231 (+ 55us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:19.888400 (+ 1169us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:19.888402 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:19.888402 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:19.888410 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:19.889684 (+ 1274us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:19.890035 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:19.890036 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:19.890036 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:19.890089 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:19.890279 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:19.890280 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:19.890280 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:19.890386 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:19.890476 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:19.890657 (+ 181us) server_negotiation.cc:299] Negotiation successful
0808 14:49:19.890719 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 14:49:19.893005 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 31849
W20260808 14:49:19.908700 31826 connection.cc:535] client connection to 127.30.214.190:36185 recv error: Network error: failed to read from TLS socket (remote: 127.30.214.190:36185): Connection reset by peer (error 104)
2026-08-08T14:49:19Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1427 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200295877777-31578-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:49:19 dist-test-slave-42z9 krb5kdc[31996](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:49:19 dist-test-slave-42z9 krb5kdc[31996](info): set up 2 sockets
Aug 08 14:49:19 dist-test-slave-42z9 krb5kdc[31996](info): commencing operation
krb5kdc: starting...
W20260808 14:49:21.044103 31578 mini_kdc.cc:121] Time spent starting KDC: real 1.122s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Aug 08 14:49:21 dist-test-slave-42z9 krb5kdc[31996](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200561, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:49:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:49:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.214.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab.
Entry for principal kudu/127.30.214.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab.
I20260808 14:49:21.168147 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200295877777-31578-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200295877777-31578-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200295877777-31578-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:43049
--webserver_interface=127.30.214.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab
--principal=kudu/127.30.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:38045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.214.190:43049
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:49:21.251011 32013 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:49:21.251238 32013 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:49:21.251262 32013 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:49:21.252465 32013 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:49:21.252511 32013 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:49:21.252532 32013 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:49:21.252544 32013 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:49:21.252563 32013 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:49:21.254168 32013 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:38045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200295877777-31578-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200295877777-31578-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.214.190:43049
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab
--principal=kudu/127.30.214.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:43049
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32013
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200295877777-31578-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:49:21.254412 32013 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:49:21.254647 32013 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:49:21.259624 32022 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:21.259775 32020 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:21.259800 32024 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:49:21.259819 32013 server_base.cc:1034] running on GCE node
I20260808 14:49:21.260221 32013 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:49:21.260542 32013 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:49:21.261680 32013 hybrid_clock.cc:648] HybridClock initialized: now 1786200561261664 us; error 38 us; skew 500 ppm
Aug 08 14:49:21 dist-test-slave-42z9 krb5kdc[31996](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200561, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:49:21.264205 32013 init.cc:377] Logged in from keytab as kudu/127.30.214.190@KRBTEST.COM (short username kudu)
I20260808 14:49:21.264698 32013 webserver.cc:460] Webserver started at http://127.30.214.190:37841/ using document root <none> and password file <none>
I20260808 14:49:21.264933 32013 fs_manager.cc:359] Metadata directory not provided
I20260808 14:49:21.264984 32013 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:49:21.265120 32013 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:49:21.266261 32013 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200295877777-31578-0/minicluster-data/master-0/data/instance:
uuid: "96366dc8991949eb97be3f779454e49e"
format_stamp: "Formatted at 2026-08-08 14:49:21 on dist-test-slave-42z9"
server_key: "689fe1719a0a3a9258c2a39b80d8fd5d"
server_key_iv: "251a8388115dc21c2ed1139e424d30bc"
server_key_version: "encryptionkey@0"
I20260808 14:49:21.266609 32013 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200295877777-31578-0/minicluster-data/master-0/wal/instance:
uuid: "96366dc8991949eb97be3f779454e49e"
format_stamp: "Formatted at 2026-08-08 14:49:21 on dist-test-slave-42z9"
server_key: "689fe1719a0a3a9258c2a39b80d8fd5d"
server_key_iv: "251a8388115dc21c2ed1139e424d30bc"
server_key_version: "encryptionkey@0"
I20260808 14:49:21.267959 32013 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 14:49:21.268920 32033 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:49:21.269105 32013 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:49:21.269197 32013 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200295877777-31578-0/minicluster-data/master-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200295877777-31578-0/minicluster-data/master-0/wal
uuid: "96366dc8991949eb97be3f779454e49e"
format_stamp: "Formatted at 2026-08-08 14:49:21 on dist-test-slave-42z9"
server_key: "689fe1719a0a3a9258c2a39b80d8fd5d"
server_key_iv: "251a8388115dc21c2ed1139e424d30bc"
server_key_version: "encryptionkey@0"
I20260808 14:49:21.269270 32013 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200295877777-31578-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200295877777-31578-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200295877777-31578-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:49:21.294872 32013 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:49:21.296648 32013 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:49:21.296797 32013 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:49:21.300896 32013 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.190:43049
I20260808 14:49:21.300944 32115 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.190:43049 every 8 connection(s)
I20260808 14:49:21.301285 32013 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
I20260808 14:49:21.302191 32116 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:49:21.303893 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 32013
I20260808 14:49:21.304009 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786200295877777-31578-0/minicluster-data/master-0/wal/instance
I20260808 14:49:21.304188 31578 external_mini_cluster.cc:1428] Setting key 42b5cb5bb02010b872e889b1aaf2d777
I20260808 14:49:21.304736 32116 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 96366dc8991949eb97be3f779454e49e: Bootstrap starting.
I20260808 14:49:21.305501 32116 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 96366dc8991949eb97be3f779454e49e: Neither blocks nor log segments found. Creating new log.
I20260808 14:49:21.305840 32116 log.cc:824] T 00000000000000000000000000000000 P 96366dc8991949eb97be3f779454e49e: Log is configured to *not* fsync() on all Append() calls
I20260808 14:49:21.306592 32116 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 96366dc8991949eb97be3f779454e49e: No bootstrap required, opened a new log
I20260808 14:49:21.308799 32116 raft_consensus.cc:348] T 00000000000000000000000000000000 P 96366dc8991949eb97be3f779454e49e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96366dc8991949eb97be3f779454e49e" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 43049 } }
I20260808 14:49:21.308983 32116 raft_consensus.cc:374] T 00000000000000000000000000000000 P 96366dc8991949eb97be3f779454e49e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:49:21.309021 32116 raft_consensus.cc:729] T 00000000000000000000000000000000 P 96366dc8991949eb97be3f779454e49e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96366dc8991949eb97be3f779454e49e, State: Initialized, Role: FOLLOWER
I20260808 14:49:21.309192 32116 consensus_queue.cc:260] T 00000000000000000000000000000000 P 96366dc8991949eb97be3f779454e49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96366dc8991949eb97be3f779454e49e" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 43049 } }
I20260808 14:49:21.309279 32116 raft_consensus.cc:388] T 00000000000000000000000000000000 P 96366dc8991949eb97be3f779454e49e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:49:21.309309 32116 raft_consensus.cc:482] T 00000000000000000000000000000000 P 96366dc8991949eb97be3f779454e49e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:49:21.309360 32116 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 96366dc8991949eb97be3f779454e49e [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:49:21.310170 32121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:21.304728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50553 (local address 127.30.214.190:43049)
0808 14:49:21.304948 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:21.304957 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:21.304990 (+ 33us) server_negotiation.cc:407] Connection header received
0808 14:49:21.305603 (+ 613us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:21.305614 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:21.305683 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:21.305840 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:21.306016 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:21.307318 (+ 1302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:21.308099 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:21.308748 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:21.308865 (+ 117us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:21.309511 (+ 646us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:21.309515 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:21.309516 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:49:21.309715 (+ 199us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:21.309760 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:49:21.309775 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:21.309857 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:21.309944 (+ 87us) server_negotiation.cc:299] Negotiation successful
0808 14:49:21.309973 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":87,"threads_started":1}
I20260808 14:49:21.310142 32116 raft_consensus.cc:504] T 00000000000000000000000000000000 P 96366dc8991949eb97be3f779454e49e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96366dc8991949eb97be3f779454e49e" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 43049 } }
I20260808 14:49:21.310273 32116 leader_election.cc:302] T 00000000000000000000000000000000 P 96366dc8991949eb97be3f779454e49e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 96366dc8991949eb97be3f779454e49e; no voters:
I20260808 14:49:21.310446 32116 leader_election.cc:288] T 00000000000000000000000000000000 P 96366dc8991949eb97be3f779454e49e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:49:21.310485 32125 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 96366dc8991949eb97be3f779454e49e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:49:21.310645 32125 raft_consensus.cc:686] T 00000000000000000000000000000000 P 96366dc8991949eb97be3f779454e49e [term 1 LEADER]: Becoming Leader. State: Replica: 96366dc8991949eb97be3f779454e49e, State: Running, Role: LEADER
I20260808 14:49:21.310721 32116 sys_catalog.cc:564] T 00000000000000000000000000000000 P 96366dc8991949eb97be3f779454e49e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:49:21.310779 32125 consensus_queue.cc:237] T 00000000000000000000000000000000 P 96366dc8991949eb97be3f779454e49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96366dc8991949eb97be3f779454e49e" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 43049 } }
I20260808 14:49:21.311156 31578 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260808 14:49:21.312491 32143 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 96366dc8991949eb97be3f779454e49e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:49:21.312717 32143 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:49:21.312871 32127 sys_catalog.cc:455] T 00000000000000000000000000000000 P 96366dc8991949eb97be3f779454e49e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 96366dc8991949eb97be3f779454e49e. Latest consensus state: current_term: 1 leader_uuid: "96366dc8991949eb97be3f779454e49e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96366dc8991949eb97be3f779454e49e" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 43049 } } }
I20260808 14:49:21.312945 32127 sys_catalog.cc:458] T 00000000000000000000000000000000 P 96366dc8991949eb97be3f779454e49e [sys.catalog]: This master's current role is: LEADER
I20260808 14:49:21.312881 32126 sys_catalog.cc:455] T 00000000000000000000000000000000 P 96366dc8991949eb97be3f779454e49e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "96366dc8991949eb97be3f779454e49e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96366dc8991949eb97be3f779454e49e" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 43049 } } }
I20260808 14:49:21.313002 32126 sys_catalog.cc:458] T 00000000000000000000000000000000 P 96366dc8991949eb97be3f779454e49e [sys.catalog]: This master's current role is: LEADER
I20260808 14:49:21.313145 32151 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:49:21.313392 32151 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:49:21.314821 32151 catalog_manager.cc:1347] Generated new cluster ID: 9c48228b942046b5ab4f548696fa4470
I20260808 14:49:21.314870 32151 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:49:21.316458 32121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:21.312593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54325 (local address 127.30.214.190:43049)
0808 14:49:21.312698 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:21.312700 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:21.313185 (+ 485us) server_negotiation.cc:407] Connection header received
0808 14:49:21.313281 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:21.313282 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:21.313293 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:21.313351 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:21.313563 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:21.314276 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:21.315170 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:21.315473 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:21.315542 (+ 69us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:21.316220 (+ 678us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:21.316222 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:21.316222 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:49:21.316227 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:21.316245 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:49:21.316250 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:21.316307 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:21.316374 (+ 67us) server_negotiation.cc:299] Negotiation successful
0808 14:49:21.316385 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260808 14:49:21.323403 32151 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:49:21.323980 32151 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:49:21.336835 32151 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 96366dc8991949eb97be3f779454e49e: Generated new TSK 0
I20260808 14:49:21.337085 32151 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:49:21.340196 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 32013
W20260808 14:49:21.358000 31993 connection.cc:535] client connection to 127.30.214.190:43049 recv error: Network error: failed to read from TLS socket (remote: 127.30.214.190:43049): Connection reset by peer (error 104)
2026-08-08T14:49:21Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1449 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200295877777-31578-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:49:21 dist-test-slave-42z9 krb5kdc[32155](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:49:21 dist-test-slave-42z9 krb5kdc[32155](info): set up 2 sockets
Aug 08 14:49:21 dist-test-slave-42z9 krb5kdc[32155](info): commencing operation
krb5kdc: starting...
W20260808 14:49:22.506539 31578 mini_kdc.cc:121] Time spent starting KDC: real 1.135s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Aug 08 14:49:22 dist-test-slave-42z9 krb5kdc[32155](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200562, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:49:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:49:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.214.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab.
Entry for principal kudu/127.30.214.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab.
I20260808 14:49:22.632653 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200295877777-31578-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200295877777-31578-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200295877777-31578-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:39815
--webserver_interface=127.30.214.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab
--principal=kudu/127.30.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:34793
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.214.190:39815
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:49:22.716221 32174 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:49:22.716485 32174 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:49:22.716521 32174 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:49:22.717782 32174 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:49:22.717835 32174 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:49:22.717854 32174 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:49:22.717869 32174 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:49:22.717885 32174 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:49:22.719542 32174 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:34793
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200295877777-31578-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200295877777-31578-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.214.190:39815
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab
--principal=kudu/127.30.214.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:39815
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32174
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200295877777-31578-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:49:22.719831 32174 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:49:22.720058 32174 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:49:22.725167 32180 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:22.725150 32179 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:22.725157 32182 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:49:22.725303 32174 server_base.cc:1034] running on GCE node
I20260808 14:49:22.725659 32174 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:49:22.725971 32174 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:49:22.727119 32174 hybrid_clock.cc:648] HybridClock initialized: now 1786200562727097 us; error 36 us; skew 500 ppm
Aug 08 14:49:22 dist-test-slave-42z9 krb5kdc[32155](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200562, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:49:22.729760 32174 init.cc:377] Logged in from keytab as kudu/127.30.214.190@KRBTEST.COM (short username kudu)
I20260808 14:49:22.730221 32174 webserver.cc:460] Webserver started at http://127.30.214.190:44503/ using document root <none> and password file <none>
I20260808 14:49:22.730458 32174 fs_manager.cc:359] Metadata directory not provided
I20260808 14:49:22.730521 32174 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:49:22.730652 32174 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:49:22.731741 32174 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200295877777-31578-0/minicluster-data/master-0/data/instance:
uuid: "cbec1f7aea4f4fd199b6c02435d26e08"
format_stamp: "Formatted at 2026-08-08 14:49:22 on dist-test-slave-42z9"
server_key: "7da98eaafcb677f011e3504d9daf1d45"
server_key_iv: "534f6893084b142c914723107d36f9f6"
server_key_version: "encryptionkey@0"
I20260808 14:49:22.732084 32174 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200295877777-31578-0/minicluster-data/master-0/wal/instance:
uuid: "cbec1f7aea4f4fd199b6c02435d26e08"
format_stamp: "Formatted at 2026-08-08 14:49:22 on dist-test-slave-42z9"
server_key: "7da98eaafcb677f011e3504d9daf1d45"
server_key_iv: "534f6893084b142c914723107d36f9f6"
server_key_version: "encryptionkey@0"
I20260808 14:49:22.733409 32174 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:49:22.734189 32193 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:49:22.734354 32174 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:49:22.734443 32174 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200295877777-31578-0/minicluster-data/master-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200295877777-31578-0/minicluster-data/master-0/wal
uuid: "cbec1f7aea4f4fd199b6c02435d26e08"
format_stamp: "Formatted at 2026-08-08 14:49:22 on dist-test-slave-42z9"
server_key: "7da98eaafcb677f011e3504d9daf1d45"
server_key_iv: "534f6893084b142c914723107d36f9f6"
server_key_version: "encryptionkey@0"
I20260808 14:49:22.734524 32174 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200295877777-31578-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200295877777-31578-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200295877777-31578-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:49:22.737937 32174 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:49:22.739873 32174 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:49:22.740015 32174 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:49:22.744095 32174 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.190:39815
I20260808 14:49:22.744136 32277 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.190:39815 every 8 connection(s)
I20260808 14:49:22.744477 32174 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
I20260808 14:49:22.745553 32278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:49:22.747877 32278 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cbec1f7aea4f4fd199b6c02435d26e08: Bootstrap starting.
I20260808 14:49:22.748467 32278 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cbec1f7aea4f4fd199b6c02435d26e08: Neither blocks nor log segments found. Creating new log.
I20260808 14:49:22.748508 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 32174
I20260808 14:49:22.748606 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786200295877777-31578-0/minicluster-data/master-0/wal/instance
I20260808 14:49:22.748764 32278 log.cc:824] T 00000000000000000000000000000000 P cbec1f7aea4f4fd199b6c02435d26e08: Log is configured to *not* fsync() on all Append() calls
I20260808 14:49:22.748785 31578 external_mini_cluster.cc:1428] Setting key 5783a480d69c5dda3bc97a67b785376f
I20260808 14:49:22.749783 32278 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cbec1f7aea4f4fd199b6c02435d26e08: No bootstrap required, opened a new log
I20260808 14:49:22.751398 32282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:22.749304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46289 (local address 127.30.214.190:39815)
0808 14:49:22.749496 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:22.749505 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:22.749540 (+ 35us) server_negotiation.cc:407] Connection header received
0808 14:49:22.750145 (+ 605us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:22.750156 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:22.750191 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:22.750343 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:22.750951 (+ 608us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:22.750954 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:22.750955 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:49:22.750959 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:22.751017 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:49:22.751032 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:22.751123 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:22.751153 (+ 30us) server_negotiation.cc:299] Negotiation successful
0808 14:49:22.751196 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":64,"threads_started":1}
I20260808 14:49:22.752405 31578 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:49:22.752319 32278 raft_consensus.cc:348] T 00000000000000000000000000000000 P cbec1f7aea4f4fd199b6c02435d26e08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbec1f7aea4f4fd199b6c02435d26e08" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 39815 } }
I20260808 14:49:22.752501 32278 raft_consensus.cc:374] T 00000000000000000000000000000000 P cbec1f7aea4f4fd199b6c02435d26e08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:49:22.752547 32278 raft_consensus.cc:729] T 00000000000000000000000000000000 P cbec1f7aea4f4fd199b6c02435d26e08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbec1f7aea4f4fd199b6c02435d26e08, State: Initialized, Role: FOLLOWER
I20260808 14:49:22.752664 32278 consensus_queue.cc:260] T 00000000000000000000000000000000 P cbec1f7aea4f4fd199b6c02435d26e08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbec1f7aea4f4fd199b6c02435d26e08" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 39815 } }
I20260808 14:49:22.752737 32278 raft_consensus.cc:388] T 00000000000000000000000000000000 P cbec1f7aea4f4fd199b6c02435d26e08 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:49:22.752769 32278 raft_consensus.cc:482] T 00000000000000000000000000000000 P cbec1f7aea4f4fd199b6c02435d26e08 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:49:22.752817 32278 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cbec1f7aea4f4fd199b6c02435d26e08 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:49:22.753417 32278 raft_consensus.cc:504] T 00000000000000000000000000000000 P cbec1f7aea4f4fd199b6c02435d26e08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbec1f7aea4f4fd199b6c02435d26e08" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 39815 } }
I20260808 14:49:22.753575 32278 leader_election.cc:302] T 00000000000000000000000000000000 P cbec1f7aea4f4fd199b6c02435d26e08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cbec1f7aea4f4fd199b6c02435d26e08; no voters:
I20260808 14:49:22.753753 32278 leader_election.cc:288] T 00000000000000000000000000000000 P cbec1f7aea4f4fd199b6c02435d26e08 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:49:22.753876 32287 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cbec1f7aea4f4fd199b6c02435d26e08 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:49:22.754043 32287 raft_consensus.cc:686] T 00000000000000000000000000000000 P cbec1f7aea4f4fd199b6c02435d26e08 [term 1 LEADER]: Becoming Leader. State: Replica: cbec1f7aea4f4fd199b6c02435d26e08, State: Running, Role: LEADER
I20260808 14:49:22.754081 32278 sys_catalog.cc:564] T 00000000000000000000000000000000 P cbec1f7aea4f4fd199b6c02435d26e08 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:49:22.754215 32287 consensus_queue.cc:237] T 00000000000000000000000000000000 P cbec1f7aea4f4fd199b6c02435d26e08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbec1f7aea4f4fd199b6c02435d26e08" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 39815 } }
I20260808 14:49:22.755127 32282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:22.753816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53487 (local address 127.30.214.190:39815)
0808 14:49:22.753852 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:22.753853 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:22.753987 (+ 134us) server_negotiation.cc:407] Connection header received
0808 14:49:22.754086 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:22.754087 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:22.754092 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:22.754121 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:22.754833 (+ 712us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:22.754834 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:22.754834 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:49:22.754839 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:22.754854 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:49:22.754858 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:22.754905 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:22.755049 (+ 144us) server_negotiation.cc:299] Negotiation successful
0808 14:49:22.755064 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 14:49:22.755654 32289 sys_catalog.cc:455] T 00000000000000000000000000000000 P cbec1f7aea4f4fd199b6c02435d26e08 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cbec1f7aea4f4fd199b6c02435d26e08. Latest consensus state: current_term: 1 leader_uuid: "cbec1f7aea4f4fd199b6c02435d26e08" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbec1f7aea4f4fd199b6c02435d26e08" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 39815 } } }
I20260808 14:49:22.755736 32291 sys_catalog.cc:455] T 00000000000000000000000000000000 P cbec1f7aea4f4fd199b6c02435d26e08 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cbec1f7aea4f4fd199b6c02435d26e08" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbec1f7aea4f4fd199b6c02435d26e08" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 39815 } } }
I20260808 14:49:22.755843 32289 sys_catalog.cc:458] T 00000000000000000000000000000000 P cbec1f7aea4f4fd199b6c02435d26e08 [sys.catalog]: This master's current role is: LEADER
I20260808 14:49:22.755856 32291 sys_catalog.cc:458] T 00000000000000000000000000000000 P cbec1f7aea4f4fd199b6c02435d26e08 [sys.catalog]: This master's current role is: LEADER
W20260808 14:49:22.756042 32313 catalog_manager.cc:1558] T 00000000000000000000000000000000 P cbec1f7aea4f4fd199b6c02435d26e08: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:49:22.756091 32313 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:49:22.756150 32316 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:49:22.756317 32316 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:49:22.757825 32316 catalog_manager.cc:1347] Generated new cluster ID: c34fb6f9cad74fe1b3593c16c978079d
I20260808 14:49:22.757884 32316 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:49:22.770632 32316 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:49:22.770830 32316 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:49:22.787568 32316 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cbec1f7aea4f4fd199b6c02435d26e08: Generated new TSK 0
I20260808 14:49:22.787815 32316 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:49:22.793183 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 32174
2026-08-08T14:49:22Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1444 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200295877777-31578-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:49:22 dist-test-slave-42z9 krb5kdc[32322](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:49:22 dist-test-slave-42z9 krb5kdc[32322](info): set up 2 sockets
Aug 08 14:49:22 dist-test-slave-42z9 krb5kdc[32322](info): commencing operation
krb5kdc: starting...
W20260808 14:49:23.930754 31578 mini_kdc.cc:121] Time spent starting KDC: real 1.115s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Aug 08 14:49:24 dist-test-slave-42z9 krb5kdc[32322](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200564, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:49:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:49:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.214.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab.
Entry for principal kudu/127.30.214.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab.
I20260808 14:49:24.052390 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200295877777-31578-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200295877777-31578-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200295877777-31578-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:46545
--webserver_interface=127.30.214.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab
--principal=kudu/127.30.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:46679
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.214.190:46545
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:49:24.136518 32343 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:49:24.136758 32343 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:49:24.136783 32343 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:49:24.138095 32343 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:49:24.138151 32343 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:49:24.138164 32343 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:49:24.138175 32343 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:49:24.138190 32343 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:49:24.139909 32343 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:46679
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200295877777-31578-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200295877777-31578-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.214.190:46545
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab
--principal=kudu/127.30.214.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:46545
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32343
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200295877777-31578-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:49:24.140197 32343 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:49:24.140424 32343 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:49:24.145473 32349 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:24.145466 32348 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:24.145473 32352 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:49:24.145761 32343 server_base.cc:1034] running on GCE node
I20260808 14:49:24.146210 32343 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:49:24.146512 32343 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:49:24.147662 32343 hybrid_clock.cc:648] HybridClock initialized: now 1786200564147646 us; error 31 us; skew 500 ppm
Aug 08 14:49:24 dist-test-slave-42z9 krb5kdc[32322](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200564, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:49:24.150238 32343 init.cc:377] Logged in from keytab as kudu/127.30.214.190@KRBTEST.COM (short username kudu)
I20260808 14:49:24.150707 32343 webserver.cc:460] Webserver started at http://127.30.214.190:35333/ using document root <none> and password file <none>
I20260808 14:49:24.150923 32343 fs_manager.cc:359] Metadata directory not provided
I20260808 14:49:24.150964 32343 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:49:24.151077 32343 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:49:24.152143 32343 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200295877777-31578-0/minicluster-data/master-0/data/instance:
uuid: "3b602332da104bd189626fcb5d05cceb"
format_stamp: "Formatted at 2026-08-08 14:49:24 on dist-test-slave-42z9"
server_key: "3be82aef213ea1208375d1c54516e6e0"
server_key_iv: "31428a5b8cf6a9e6673ae5292da0e28c"
server_key_version: "encryptionkey@0"
I20260808 14:49:24.152451 32343 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200295877777-31578-0/minicluster-data/master-0/wal/instance:
uuid: "3b602332da104bd189626fcb5d05cceb"
format_stamp: "Formatted at 2026-08-08 14:49:24 on dist-test-slave-42z9"
server_key: "3be82aef213ea1208375d1c54516e6e0"
server_key_iv: "31428a5b8cf6a9e6673ae5292da0e28c"
server_key_version: "encryptionkey@0"
I20260808 14:49:24.153882 32343 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 14:49:24.154632 32364 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:49:24.154795 32343 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:49:24.154882 32343 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200295877777-31578-0/minicluster-data/master-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200295877777-31578-0/minicluster-data/master-0/wal
uuid: "3b602332da104bd189626fcb5d05cceb"
format_stamp: "Formatted at 2026-08-08 14:49:24 on dist-test-slave-42z9"
server_key: "3be82aef213ea1208375d1c54516e6e0"
server_key_iv: "31428a5b8cf6a9e6673ae5292da0e28c"
server_key_version: "encryptionkey@0"
I20260808 14:49:24.154947 32343 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200295877777-31578-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200295877777-31578-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200295877777-31578-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:49:24.172773 32343 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:49:24.174705 32343 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:49:24.174829 32343 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:49:24.178967 32343 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.190:46545
I20260808 14:49:24.179019 32437 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.190:46545 every 8 connection(s)
I20260808 14:49:24.179409 32343 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
I20260808 14:49:24.180342 32438 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:49:24.182870 32438 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b602332da104bd189626fcb5d05cceb: Bootstrap starting.
I20260808 14:49:24.183504 32438 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3b602332da104bd189626fcb5d05cceb: Neither blocks nor log segments found. Creating new log.
I20260808 14:49:24.183775 32438 log.cc:824] T 00000000000000000000000000000000 P 3b602332da104bd189626fcb5d05cceb: Log is configured to *not* fsync() on all Append() calls
I20260808 14:49:24.184485 32438 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b602332da104bd189626fcb5d05cceb: No bootstrap required, opened a new log
I20260808 14:49:24.186201 32438 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3b602332da104bd189626fcb5d05cceb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b602332da104bd189626fcb5d05cceb" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 46545 } }
I20260808 14:49:24.186357 32438 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3b602332da104bd189626fcb5d05cceb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:49:24.186380 32438 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3b602332da104bd189626fcb5d05cceb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b602332da104bd189626fcb5d05cceb, State: Initialized, Role: FOLLOWER
I20260808 14:49:24.186517 32438 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3b602332da104bd189626fcb5d05cceb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b602332da104bd189626fcb5d05cceb" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 46545 } }
I20260808 14:49:24.186590 32438 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3b602332da104bd189626fcb5d05cceb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:49:24.186614 32438 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3b602332da104bd189626fcb5d05cceb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:49:24.186678 32438 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3b602332da104bd189626fcb5d05cceb [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:49:24.187594 32438 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3b602332da104bd189626fcb5d05cceb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b602332da104bd189626fcb5d05cceb" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 46545 } }
I20260808 14:49:24.187698 32438 leader_election.cc:302] T 00000000000000000000000000000000 P 3b602332da104bd189626fcb5d05cceb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3b602332da104bd189626fcb5d05cceb; no voters:
I20260808 14:49:24.187875 32438 leader_election.cc:288] T 00000000000000000000000000000000 P 3b602332da104bd189626fcb5d05cceb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:49:24.187951 32442 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3b602332da104bd189626fcb5d05cceb [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:49:24.188099 32442 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3b602332da104bd189626fcb5d05cceb [term 1 LEADER]: Becoming Leader. State: Replica: 3b602332da104bd189626fcb5d05cceb, State: Running, Role: LEADER
I20260808 14:49:24.188105 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 32343
I20260808 14:49:24.188211 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786200295877777-31578-0/minicluster-data/master-0/wal/instance
I20260808 14:49:24.188182 32442 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3b602332da104bd189626fcb5d05cceb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b602332da104bd189626fcb5d05cceb" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 46545 } }
I20260808 14:49:24.188182 32438 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3b602332da104bd189626fcb5d05cceb [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:49:24.188441 31578 external_mini_cluster.cc:1428] Setting key 11c200c50b148b0aa95ffbef6f3cccca
I20260808 14:49:24.188637 32444 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b602332da104bd189626fcb5d05cceb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3b602332da104bd189626fcb5d05cceb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b602332da104bd189626fcb5d05cceb" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 46545 } } }
I20260808 14:49:24.188720 32444 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b602332da104bd189626fcb5d05cceb [sys.catalog]: This master's current role is: LEADER
I20260808 14:49:24.188628 32445 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b602332da104bd189626fcb5d05cceb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3b602332da104bd189626fcb5d05cceb. Latest consensus state: current_term: 1 leader_uuid: "3b602332da104bd189626fcb5d05cceb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b602332da104bd189626fcb5d05cceb" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 46545 } } }
I20260808 14:49:24.188962 32445 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b602332da104bd189626fcb5d05cceb [sys.catalog]: This master's current role is: LEADER
I20260808 14:49:24.189391 32450 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:49:24.190038 32450 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:49:24.192030 32450 catalog_manager.cc:1347] Generated new cluster ID: 829e5991ea3e419396f09b29ca477949
I20260808 14:49:24.192077 32450 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 14:49:24 dist-test-slave-42z9 krb5kdc[32322](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200564, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:49:24.200487 32458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:24.189151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50693 (local address 127.30.214.190:46545)
0808 14:49:24.189335 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:24.189345 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:24.189402 (+ 57us) server_negotiation.cc:407] Connection header received
0808 14:49:24.189631 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:24.189639 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:24.189734 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:24.189879 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:24.190761 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:24.191908 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:24.193004 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:24.193701 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:24.193809 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:24.196622 (+ 2813us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:24.196628 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:24.196628 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:24.196643 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:24.198691 (+ 2048us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:24.199071 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:24.199075 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:24.199075 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:24.199213 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:24.199403 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:24.199403 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:24.199404 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:24.199728 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:24.199890 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:24.199959 (+ 69us) server_negotiation.cc:299] Negotiation successful
0808 14:49:24.200230 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":70,"threads_started":1}
I20260808 14:49:24.201484 31578 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:49:24.208604 32450 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:49:24.209338 32450 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:49:24.214241 32458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:24.203014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32945 (local address 127.30.214.190:46545)
0808 14:49:24.203052 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:24.203054 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:24.208277 (+ 5223us) server_negotiation.cc:407] Connection header received
0808 14:49:24.208339 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:24.208341 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:24.208362 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:24.208420 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:24.209085 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:24.209711 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:24.210398 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:24.210622 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:24.210679 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:24.211862 (+ 1183us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:24.211863 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:24.211864 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:24.211871 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:24.213160 (+ 1289us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:24.213521 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:24.213523 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:24.213523 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:24.213577 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:24.213743 (+ 166us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:24.213744 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:24.213744 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:24.213853 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:24.213956 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:24.214056 (+ 100us) server_negotiation.cc:299] Negotiation successful
0808 14:49:24.214147 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":37,"server-negotiator.queue_time_us":18}
I20260808 14:49:24.217928 32450 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3b602332da104bd189626fcb5d05cceb: Generated new TSK 0
I20260808 14:49:24.218129 32450 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:49:24.224740 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 32343
2026-08-08T14:49:24Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1433 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200295877777-31578-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:49:24 dist-test-slave-42z9 krb5kdc[32479](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:49:24 dist-test-slave-42z9 krb5kdc[32479](info): set up 2 sockets
Aug 08 14:49:24 dist-test-slave-42z9 krb5kdc[32479](info): commencing operation
krb5kdc: starting...
W20260808 14:49:25.370764 31578 mini_kdc.cc:121] Time spent starting KDC: real 1.122s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Aug 08 14:49:25 dist-test-slave-42z9 krb5kdc[32479](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200565, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:49:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:49:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.214.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab.
Entry for principal kudu/127.30.214.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab.
I20260808 14:49:25.496651 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200295877777-31578-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200295877777-31578-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200295877777-31578-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:37161
--webserver_interface=127.30.214.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab
--principal=kudu/127.30.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:34723
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.214.190:37161
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:49:25.580832 32500 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:49:25.581075 32500 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:49:25.581099 32500 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:49:25.582343 32500 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:49:25.582392 32500 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:49:25.582405 32500 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:49:25.582417 32500 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:49:25.582446 32500 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:49:25.584004 32500 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:34723
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200295877777-31578-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200295877777-31578-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.214.190:37161
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab
--principal=kudu/127.30.214.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:37161
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32500
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200295877777-31578-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:49:25.584260 32500 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:49:25.584479 32500 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:49:25.589320 32508 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:25.589340 32510 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:25.589320 32512 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:49:25.589524 32500 server_base.cc:1034] running on GCE node
I20260808 14:49:25.589819 32500 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:49:25.590111 32500 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:49:25.591259 32500 hybrid_clock.cc:648] HybridClock initialized: now 1786200565591248 us; error 27 us; skew 500 ppm
Aug 08 14:49:25 dist-test-slave-42z9 krb5kdc[32479](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200565, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:49:25.596778 32500 init.cc:377] Logged in from keytab as kudu/127.30.214.190@KRBTEST.COM (short username kudu)
I20260808 14:49:25.597277 32500 webserver.cc:460] Webserver started at http://127.30.214.190:38523/ using document root <none> and password file <none>
I20260808 14:49:25.597525 32500 fs_manager.cc:359] Metadata directory not provided
I20260808 14:49:25.597580 32500 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:49:25.597720 32500 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:49:25.598795 32500 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200295877777-31578-0/minicluster-data/master-0/data/instance:
uuid: "953911aacb424105928af225705d9caf"
format_stamp: "Formatted at 2026-08-08 14:49:25 on dist-test-slave-42z9"
server_key: "acd054b6d15084bad5713ce49ae9fb92"
server_key_iv: "1ab072d273b7f32c4807aab6520f365f"
server_key_version: "encryptionkey@0"
I20260808 14:49:25.599149 32500 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200295877777-31578-0/minicluster-data/master-0/wal/instance:
uuid: "953911aacb424105928af225705d9caf"
format_stamp: "Formatted at 2026-08-08 14:49:25 on dist-test-slave-42z9"
server_key: "acd054b6d15084bad5713ce49ae9fb92"
server_key_iv: "1ab072d273b7f32c4807aab6520f365f"
server_key_version: "encryptionkey@0"
I20260808 14:49:25.600461 32500 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:49:25.601132 32521 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:49:25.601289 32500 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:49:25.601377 32500 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200295877777-31578-0/minicluster-data/master-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200295877777-31578-0/minicluster-data/master-0/wal
uuid: "953911aacb424105928af225705d9caf"
format_stamp: "Formatted at 2026-08-08 14:49:25 on dist-test-slave-42z9"
server_key: "acd054b6d15084bad5713ce49ae9fb92"
server_key_iv: "1ab072d273b7f32c4807aab6520f365f"
server_key_version: "encryptionkey@0"
I20260808 14:49:25.601471 32500 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200295877777-31578-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200295877777-31578-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200295877777-31578-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:49:25.618746 32500 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:49:25.620618 32500 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:49:25.620767 32500 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:49:25.624976 32500 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.190:37161
I20260808 14:49:25.625023 32603 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.190:37161 every 8 connection(s)
I20260808 14:49:25.625387 32500 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
I20260808 14:49:25.626325 32605 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:49:25.628669 32605 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 953911aacb424105928af225705d9caf: Bootstrap starting.
I20260808 14:49:25.629261 32605 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 953911aacb424105928af225705d9caf: Neither blocks nor log segments found. Creating new log.
I20260808 14:49:25.629552 32605 log.cc:824] T 00000000000000000000000000000000 P 953911aacb424105928af225705d9caf: Log is configured to *not* fsync() on all Append() calls
I20260808 14:49:25.630239 32605 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 953911aacb424105928af225705d9caf: No bootstrap required, opened a new log
I20260808 14:49:25.631825 32605 raft_consensus.cc:348] T 00000000000000000000000000000000 P 953911aacb424105928af225705d9caf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "953911aacb424105928af225705d9caf" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 37161 } }
I20260808 14:49:25.631978 32605 raft_consensus.cc:374] T 00000000000000000000000000000000 P 953911aacb424105928af225705d9caf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:49:25.632000 32605 raft_consensus.cc:729] T 00000000000000000000000000000000 P 953911aacb424105928af225705d9caf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 953911aacb424105928af225705d9caf, State: Initialized, Role: FOLLOWER
I20260808 14:49:25.632125 32605 consensus_queue.cc:260] T 00000000000000000000000000000000 P 953911aacb424105928af225705d9caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "953911aacb424105928af225705d9caf" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 37161 } }
I20260808 14:49:25.632177 32605 raft_consensus.cc:388] T 00000000000000000000000000000000 P 953911aacb424105928af225705d9caf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:49:25.632196 32605 raft_consensus.cc:482] T 00000000000000000000000000000000 P 953911aacb424105928af225705d9caf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:49:25.632225 32605 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 953911aacb424105928af225705d9caf [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:49:25.632539 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 32500
I20260808 14:49:25.632651 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786200295877777-31578-0/minicluster-data/master-0/wal/instance
I20260808 14:49:25.632819 31578 external_mini_cluster.cc:1428] Setting key 86fa7e9cfb7aae90ff5b16ceb0c3d1b8
I20260808 14:49:25.633181 32605 raft_consensus.cc:504] T 00000000000000000000000000000000 P 953911aacb424105928af225705d9caf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "953911aacb424105928af225705d9caf" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 37161 } }
I20260808 14:49:25.633370 32605 leader_election.cc:302] T 00000000000000000000000000000000 P 953911aacb424105928af225705d9caf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 953911aacb424105928af225705d9caf; no voters:
I20260808 14:49:25.633602 32605 leader_election.cc:288] T 00000000000000000000000000000000 P 953911aacb424105928af225705d9caf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:49:25.633644 32611 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 953911aacb424105928af225705d9caf [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:49:25.633749 32611 raft_consensus.cc:686] T 00000000000000000000000000000000 P 953911aacb424105928af225705d9caf [term 1 LEADER]: Becoming Leader. State: Replica: 953911aacb424105928af225705d9caf, State: Running, Role: LEADER
I20260808 14:49:25.633893 32611 consensus_queue.cc:237] T 00000000000000000000000000000000 P 953911aacb424105928af225705d9caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "953911aacb424105928af225705d9caf" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 37161 } }
I20260808 14:49:25.633898 32605 sys_catalog.cc:564] T 00000000000000000000000000000000 P 953911aacb424105928af225705d9caf [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:49:25.634609 32613 sys_catalog.cc:455] T 00000000000000000000000000000000 P 953911aacb424105928af225705d9caf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 953911aacb424105928af225705d9caf. Latest consensus state: current_term: 1 leader_uuid: "953911aacb424105928af225705d9caf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "953911aacb424105928af225705d9caf" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 37161 } } }
I20260808 14:49:25.634624 32612 sys_catalog.cc:455] T 00000000000000000000000000000000 P 953911aacb424105928af225705d9caf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "953911aacb424105928af225705d9caf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "953911aacb424105928af225705d9caf" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 37161 } } }
I20260808 14:49:25.634801 32613 sys_catalog.cc:458] T 00000000000000000000000000000000 P 953911aacb424105928af225705d9caf [sys.catalog]: This master's current role is: LEADER
I20260808 14:49:25.634814 32612 sys_catalog.cc:458] T 00000000000000000000000000000000 P 953911aacb424105928af225705d9caf [sys.catalog]: This master's current role is: LEADER
I20260808 14:49:25.635079 32621 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:49:25.635733 32621 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:49:25.637529 32621 catalog_manager.cc:1347] Generated new cluster ID: 66728e59c9b046e1a97f48875bbf1d4a
I20260808 14:49:25.637583 32621 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:49:25.639132 32610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:25.633328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51619 (local address 127.30.214.190:37161)
0808 14:49:25.633598 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:25.633607 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:25.633636 (+ 29us) server_negotiation.cc:407] Connection header received
0808 14:49:25.633799 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:25.633806 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:25.633869 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:25.634255 (+ 386us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:25.634359 (+ 104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:25.635850 (+ 1491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:25.636805 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:25.637384 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:25.637905 (+ 521us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:25.638321 (+ 416us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:25.638325 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:25.638326 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:49:25.638540 (+ 214us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:25.638581 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:49:25.638597 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:25.638659 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:25.638746 (+ 87us) server_negotiation.cc:299] Negotiation successful
0808 14:49:25.638899 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":216,"thread_start_us":131,"threads_started":1}
I20260808 14:49:25.639930 31578 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:49:25.642863 32621 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:49:25.643365 32621 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:49:25.644865 32610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:25.641415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57749 (local address 127.30.214.190:37161)
0808 14:49:25.641483 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:25.641485 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:25.641592 (+ 107us) server_negotiation.cc:407] Connection header received
0808 14:49:25.641677 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:25.641678 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:25.641689 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:25.641714 (+ 25us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:25.641901 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:25.642533 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:25.643539 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:25.643851 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:25.643916 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:25.644614 (+ 698us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:25.644615 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:25.644616 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:49:25.644622 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:25.644638 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:49:25.644642 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:25.644688 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:25.644742 (+ 54us) server_negotiation.cc:299] Negotiation successful
0808 14:49:25.644787 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":7,"server-negotiator.queue_time_us":46}
I20260808 14:49:25.666760 32621 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 953911aacb424105928af225705d9caf: Generated new TSK 0
I20260808 14:49:25.666996 32621 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:49:25.670868 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 32500
2026-08-08T14:49:25Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1452 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200295877777-31578-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:49:25 dist-test-slave-42z9 krb5kdc[32644](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:49:25 dist-test-slave-42z9 krb5kdc[32644](info): set up 2 sockets
Aug 08 14:49:25 dist-test-slave-42z9 krb5kdc[32644](info): commencing operation
krb5kdc: starting...
W20260808 14:49:26.816460 31578 mini_kdc.cc:121] Time spent starting KDC: real 1.115s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Aug 08 14:49:26 dist-test-slave-42z9 krb5kdc[32644](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200566, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:49:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:49:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.214.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab.
Entry for principal kudu/127.30.214.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab.
I20260808 14:49:26.938503 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200295877777-31578-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200295877777-31578-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200295877777-31578-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:32995
--webserver_interface=127.30.214.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab
--principal=kudu/127.30.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:44209
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.214.190:32995
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:49:27.021481 32668 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:49:27.021713 32668 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:49:27.021737 32668 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:49:27.022949 32668 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:49:27.023001 32668 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:49:27.023015 32668 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:49:27.023025 32668 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:49:27.023037 32668 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:49:27.024590 32668 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:44209
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200295877777-31578-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200295877777-31578-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.214.190:32995
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab
--principal=kudu/127.30.214.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:32995
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32668
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200295877777-31578-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:49:27.024832 32668 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:49:27.025072 32668 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:49:27.030104 32674 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:27.030123 32675 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:27.030129 32679 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:49:27.030262 32668 server_base.cc:1034] running on GCE node
I20260808 14:49:27.030619 32668 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:49:27.030911 32668 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:49:27.032069 32668 hybrid_clock.cc:648] HybridClock initialized: now 1786200567032055 us; error 33 us; skew 500 ppm
Aug 08 14:49:27 dist-test-slave-42z9 krb5kdc[32644](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200567, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:49:27.034574 32668 init.cc:377] Logged in from keytab as kudu/127.30.214.190@KRBTEST.COM (short username kudu)
I20260808 14:49:27.034989 32668 webserver.cc:460] Webserver started at http://127.30.214.190:34903/ using document root <none> and password file <none>
I20260808 14:49:27.035220 32668 fs_manager.cc:359] Metadata directory not provided
I20260808 14:49:27.035270 32668 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:49:27.035398 32668 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:49:27.036451 32668 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200295877777-31578-0/minicluster-data/master-0/data/instance:
uuid: "dff72377a51a4a30ab29340c139e2755"
format_stamp: "Formatted at 2026-08-08 14:49:27 on dist-test-slave-42z9"
server_key: "c500f1579a7d0c6c1df67f242f7d411b"
server_key_iv: "4eda9801bbfd6173b4f52ee133363525"
server_key_version: "encryptionkey@0"
I20260808 14:49:27.036783 32668 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200295877777-31578-0/minicluster-data/master-0/wal/instance:
uuid: "dff72377a51a4a30ab29340c139e2755"
format_stamp: "Formatted at 2026-08-08 14:49:27 on dist-test-slave-42z9"
server_key: "c500f1579a7d0c6c1df67f242f7d411b"
server_key_iv: "4eda9801bbfd6173b4f52ee133363525"
server_key_version: "encryptionkey@0"
I20260808 14:49:27.038118 32668 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:49:27.038795 32691 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:49:27.038933 32668 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:49:27.039021 32668 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200295877777-31578-0/minicluster-data/master-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200295877777-31578-0/minicluster-data/master-0/wal
uuid: "dff72377a51a4a30ab29340c139e2755"
format_stamp: "Formatted at 2026-08-08 14:49:27 on dist-test-slave-42z9"
server_key: "c500f1579a7d0c6c1df67f242f7d411b"
server_key_iv: "4eda9801bbfd6173b4f52ee133363525"
server_key_version: "encryptionkey@0"
I20260808 14:49:27.039108 32668 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200295877777-31578-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200295877777-31578-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200295877777-31578-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:49:27.042565 32668 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:49:27.044489 32668 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:49:27.044628 32668 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:49:27.048597 32668 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.190:32995
I20260808 14:49:27.048640 306 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.190:32995 every 8 connection(s)
I20260808 14:49:27.048959 32668 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
I20260808 14:49:27.050004 309 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:49:27.052397 309 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dff72377a51a4a30ab29340c139e2755: Bootstrap starting.
I20260808 14:49:27.053007 309 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dff72377a51a4a30ab29340c139e2755: Neither blocks nor log segments found. Creating new log.
I20260808 14:49:27.053277 309 log.cc:824] T 00000000000000000000000000000000 P dff72377a51a4a30ab29340c139e2755: Log is configured to *not* fsync() on all Append() calls
I20260808 14:49:27.053988 309 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dff72377a51a4a30ab29340c139e2755: No bootstrap required, opened a new log
I20260808 14:49:27.054222 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 32668
I20260808 14:49:27.054322 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786200295877777-31578-0/minicluster-data/master-0/wal/instance
I20260808 14:49:27.054471 31578 external_mini_cluster.cc:1428] Setting key ef2adb7db057264637dc550e05576b31
I20260808 14:49:27.055876 309 raft_consensus.cc:348] T 00000000000000000000000000000000 P dff72377a51a4a30ab29340c139e2755 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dff72377a51a4a30ab29340c139e2755" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 32995 } }
I20260808 14:49:27.056020 309 raft_consensus.cc:374] T 00000000000000000000000000000000 P dff72377a51a4a30ab29340c139e2755 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:49:27.056051 309 raft_consensus.cc:729] T 00000000000000000000000000000000 P dff72377a51a4a30ab29340c139e2755 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dff72377a51a4a30ab29340c139e2755, State: Initialized, Role: FOLLOWER
I20260808 14:49:27.056196 309 consensus_queue.cc:260] T 00000000000000000000000000000000 P dff72377a51a4a30ab29340c139e2755 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dff72377a51a4a30ab29340c139e2755" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 32995 } }
I20260808 14:49:27.056303 309 raft_consensus.cc:388] T 00000000000000000000000000000000 P dff72377a51a4a30ab29340c139e2755 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:49:27.056335 309 raft_consensus.cc:482] T 00000000000000000000000000000000 P dff72377a51a4a30ab29340c139e2755 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:49:27.056382 309 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dff72377a51a4a30ab29340c139e2755 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:49:27.057086 318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:27.054953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57959 (local address 127.30.214.190:32995)
0808 14:49:27.055141 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:27.055149 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:27.055175 (+ 26us) server_negotiation.cc:407] Connection header received
0808 14:49:27.055834 (+ 659us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:27.055841 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:27.055867 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:27.055989 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:27.056676 (+ 687us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:27.056680 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:27.056680 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:49:27.056684 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:27.056729 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:49:27.056740 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:27.056794 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:27.056855 (+ 61us) server_negotiation.cc:299] Negotiation successful
0808 14:49:27.056893 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":85,"threads_started":1}
I20260808 14:49:27.057375 309 raft_consensus.cc:504] T 00000000000000000000000000000000 P dff72377a51a4a30ab29340c139e2755 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dff72377a51a4a30ab29340c139e2755" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 32995 } }
I20260808 14:49:27.057511 309 leader_election.cc:302] T 00000000000000000000000000000000 P dff72377a51a4a30ab29340c139e2755 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dff72377a51a4a30ab29340c139e2755; no voters:
I20260808 14:49:27.057679 309 leader_election.cc:288] T 00000000000000000000000000000000 P dff72377a51a4a30ab29340c139e2755 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:49:27.057711 319 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dff72377a51a4a30ab29340c139e2755 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:49:27.057861 319 raft_consensus.cc:686] T 00000000000000000000000000000000 P dff72377a51a4a30ab29340c139e2755 [term 1 LEADER]: Becoming Leader. State: Replica: dff72377a51a4a30ab29340c139e2755, State: Running, Role: LEADER
I20260808 14:49:27.057953 319 consensus_queue.cc:237] T 00000000000000000000000000000000 P dff72377a51a4a30ab29340c139e2755 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dff72377a51a4a30ab29340c139e2755" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 32995 } }
I20260808 14:49:27.057953 309 sys_catalog.cc:564] T 00000000000000000000000000000000 P dff72377a51a4a30ab29340c139e2755 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:49:27.058153 31578 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:49:27.058353 324 sys_catalog.cc:455] T 00000000000000000000000000000000 P dff72377a51a4a30ab29340c139e2755 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dff72377a51a4a30ab29340c139e2755. Latest consensus state: current_term: 1 leader_uuid: "dff72377a51a4a30ab29340c139e2755" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dff72377a51a4a30ab29340c139e2755" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 32995 } } }
I20260808 14:49:27.058450 324 sys_catalog.cc:458] T 00000000000000000000000000000000 P dff72377a51a4a30ab29340c139e2755 [sys.catalog]: This master's current role is: LEADER
I20260808 14:49:27.058609 321 sys_catalog.cc:455] T 00000000000000000000000000000000 P dff72377a51a4a30ab29340c139e2755 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dff72377a51a4a30ab29340c139e2755" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dff72377a51a4a30ab29340c139e2755" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 32995 } } }
I20260808 14:49:27.058658 321 sys_catalog.cc:458] T 00000000000000000000000000000000 P dff72377a51a4a30ab29340c139e2755 [sys.catalog]: This master's current role is: LEADER
W20260808 14:49:27.059917 349 catalog_manager.cc:1558] T 00000000000000000000000000000000 P dff72377a51a4a30ab29340c139e2755: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:49:27.059975 349 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:49:27.060030 329 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:49:27.060242 329 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:49:27.060810 318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:27.059697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56467 (local address 127.30.214.190:32995)
0808 14:49:27.059736 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:27.059738 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:27.059853 (+ 115us) server_negotiation.cc:407] Connection header received
0808 14:49:27.059913 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:27.059914 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:27.059922 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:27.059966 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:27.060600 (+ 634us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:27.060601 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:27.060601 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:49:27.060605 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:27.060623 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:49:27.060628 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:27.060685 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:27.060742 (+ 57us) server_negotiation.cc:299] Negotiation successful
0808 14:49:27.060755 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 14:49:27.061757 329 catalog_manager.cc:1347] Generated new cluster ID: cb5ccc95a8c741a89896227d83aae4d6
I20260808 14:49:27.061810 329 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:49:27.071313 329 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:49:27.071498 329 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:49:27.074546 329 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dff72377a51a4a30ab29340c139e2755: Generated new TSK 0
I20260808 14:49:27.074736 329 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:49:27.083065 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 32668
2026-08-08T14:49:27Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1409 ms)
[----------] 18 tests from AuthTokenIssuingTest (25843 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200295877777-31578-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:49:27 dist-test-slave-42z9 krb5kdc[361](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:49:27 dist-test-slave-42z9 krb5kdc[361](info): set up 2 sockets
Aug 08 14:49:27 dist-test-slave-42z9 krb5kdc[361](info): commencing operation
krb5kdc: starting...
W20260808 14:49:28.225761 31578 mini_kdc.cc:121] Time spent starting KDC: real 1.115s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Aug 08 14:49:28 dist-test-slave-42z9 krb5kdc[361](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200568, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:49:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:49:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.214.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab.
Entry for principal kudu/127.30.214.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab.
I20260808 14:49:28.349845 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200295877777-31578-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200295877777-31578-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200295877777-31578-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:33139
--webserver_interface=127.30.214.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab
--principal=kudu/127.30.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:40115
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.214.190:33139,127.30.214.189:43729,127.30.214.188:42321
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:49:28.432853 381 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 14:49:28.433097 381 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:49:28.433123 381 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:49:28.433149 381 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:49:28.434358 381 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:49:28.434405 381 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:49:28.434422 381 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:49:28.434439 381 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:49:28.434454 381 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:49:28.436012 381 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:40115
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200295877777-31578-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200295877777-31578-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.214.190:33139,127.30.214.189:43729,127.30.214.188:42321
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab
--principal=kudu/127.30.214.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:33139
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.381
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200295877777-31578-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:49:28.436291 381 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:49:28.436510 381 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:49:28.441424 393 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:28.441485 390 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:28.441424 391 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:49:28.441699 381 server_base.cc:1034] running on GCE node
I20260808 14:49:28.441938 381 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:49:28.442211 381 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:49:28.443348 381 hybrid_clock.cc:648] HybridClock initialized: now 1786200568443333 us; error 28 us; skew 500 ppm
Aug 08 14:49:28 dist-test-slave-42z9 krb5kdc[361](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200568, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:49:28.445782 381 init.cc:377] Logged in from keytab as kudu/127.30.214.190@KRBTEST.COM (short username kudu)
I20260808 14:49:28.446226 381 webserver.cc:460] Webserver started at http://127.30.214.190:43135/ using document root <none> and password file <none>
I20260808 14:49:28.446440 381 fs_manager.cc:359] Metadata directory not provided
I20260808 14:49:28.446492 381 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:49:28.446619 381 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:49:28.447695 381 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200295877777-31578-0/minicluster-data/master-0/data/instance:
uuid: "9d738ebf7e8a4681bca8e4483e31b81e"
format_stamp: "Formatted at 2026-08-08 14:49:28 on dist-test-slave-42z9"
server_key: "728a4466c609a782c34107d5632b3ec2"
server_key_iv: "17351fed87abc6b83f4ed1d2d8d9cd87"
server_key_version: "encryptionkey@0"
I20260808 14:49:28.448048 381 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200295877777-31578-0/minicluster-data/master-0/wal/instance:
uuid: "9d738ebf7e8a4681bca8e4483e31b81e"
format_stamp: "Formatted at 2026-08-08 14:49:28 on dist-test-slave-42z9"
server_key: "728a4466c609a782c34107d5632b3ec2"
server_key_iv: "17351fed87abc6b83f4ed1d2d8d9cd87"
server_key_version: "encryptionkey@0"
I20260808 14:49:28.449324 381 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 14:49:28.450076 403 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:49:28.450224 381 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:49:28.450311 381 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200295877777-31578-0/minicluster-data/master-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200295877777-31578-0/minicluster-data/master-0/wal
uuid: "9d738ebf7e8a4681bca8e4483e31b81e"
format_stamp: "Formatted at 2026-08-08 14:49:28 on dist-test-slave-42z9"
server_key: "728a4466c609a782c34107d5632b3ec2"
server_key_iv: "17351fed87abc6b83f4ed1d2d8d9cd87"
server_key_version: "encryptionkey@0"
I20260808 14:49:28.450377 381 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200295877777-31578-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200295877777-31578-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200295877777-31578-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:49:28.474793 381 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:49:28.476720 381 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:49:28.476867 381 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:49:28.480912 381 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.190:33139
I20260808 14:49:28.480954 486 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.190:33139 every 8 connection(s)
I20260808 14:49:28.481316 381 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
I20260808 14:49:28.482259 487 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:49:28.483815 487 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.214.190" port: 33139 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:49:28.485489 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 381
I20260808 14:49:28.485615 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200295877777-31578-0/minicluster-data/master-0/wal/instance
I20260808 14:49:28.485786 31578 external_mini_cluster.cc:1428] Setting key 58a06e4cec238da8e96b2dff490114e8
Aug 08 14:49:28 dist-test-slave-42z9 krb5kdc[361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200568, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.190@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.30.214.189@KRBTEST.COM; defaulting to no policy
I20260808 14:49:28.494715 489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:28.484504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:33139 (local address 127.0.0.1:41072)
0808 14:49:28.484665 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:28.484707 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 14:49:28.485194 (+ 487us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:49:28.485605 (+ 411us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:49:28.485608 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:49:28.485965 (+ 357us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:49:28.486130 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:28.486135 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:28.487493 (+ 1358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:28.487494 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:28.488538 (+ 1044us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:28.488541 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:28.489037 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:28.489038 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:28.489119 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:28.489678 (+ 559us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:49:28.489689 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:49:28.491412 (+ 1723us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:49:28.493082 (+ 1670us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:28.493090 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:28.493093 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:28.493350 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:28.493611 (+ 261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:28.493612 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:28.493613 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:28.493725 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:28.494075 (+ 350us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:49:28.494082 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:49:28.494164 (+ 82us) client_negotiation.cc:769] Sending connection context
0808 14:49:28.494271 (+ 107us) client_negotiation.cc:240] Negotiation successful
0808 14:49:28.494462 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":72,"threads_started":1}
I20260808 14:49:28.494863 491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:28.484546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41072 (local address 127.30.214.190:33139)
0808 14:49:28.484719 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:28.484724 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:28.484795 (+ 71us) server_negotiation.cc:407] Connection header received
0808 14:49:28.485384 (+ 589us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:28.485387 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:28.485412 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:28.485607 (+ 195us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:28.486231 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:28.487399 (+ 1168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:28.488633 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:28.488945 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:28.489022 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:28.491509 (+ 2487us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:28.491517 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:28.491517 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:28.491525 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:28.492982 (+ 1457us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:28.493428 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:28.493430 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:28.493430 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:28.493544 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:28.493791 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:28.493792 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:28.493792 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:28.494008 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:28.494068 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:28.494477 (+ 409us) server_negotiation.cc:299] Negotiation successful
0808 14:49:28.494643 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":94,"threads_started":1}
I20260808 14:49:28.495751 487 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.214.189" port: 43729 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:49:28.496109 489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:28.495994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.189:43729 (local address 127.0.0.1:53520)
0808 14:49:28.496040 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:28.496083 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.189:43729: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260808 14:49:28.496228 411 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.30.214.189:43729: connect: Connection refused (error 111)
I20260808 14:49:28.496601 489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:28.496510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.189:43729 (local address 127.0.0.1:53526)
0808 14:49:28.496556 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:28.496580 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.189:43729: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260808 14:49:28.496699 487 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.214.189:43729: Network error: Client connection negotiation failed: client connection to 127.30.214.189:43729: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.189.keytab.
Entry for principal kudu/127.30.214.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.189.keytab.
I20260808 14:49:28.510241 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200295877777-31578-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200295877777-31578-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200295877777-31578-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200295877777-31578-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.189:43729
--webserver_interface=127.30.214.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.189.keytab
--principal=kudu/127.30.214.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:40115
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.214.190:33139,127.30.214.189:43729,127.30.214.188:42321
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:49:28.545915 487 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.214.189" port: 43729 } attempt: 1
I20260808 14:49:28.546483 489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:28.546315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.189:43729 (local address 127.0.0.1:53532)
0808 14:49:28.546405 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:28.546451 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.189:43729: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260808 14:49:28.546870 489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:28.546786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.189:43729 (local address 127.0.0.1:53542)
0808 14:49:28.546829 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:28.546854 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.189:43729: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260808 14:49:28.546967 487 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.214.189:43729: Network error: Client connection negotiation failed: client connection to 127.30.214.189:43729: connect: Connection refused (error 111)
W20260808 14:49:28.592942 499 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 14:49:28.593165 499 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:49:28.593182 499 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:49:28.593204 499 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:49:28.594446 499 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:49:28.594494 499 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:49:28.594507 499 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:49:28.594518 499 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:49:28.594532 499 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:49:28.596109 499 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:40115
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200295877777-31578-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200295877777-31578-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.30.214.190:33139,127.30.214.189:43729,127.30.214.188:42321
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.189.keytab
--principal=kudu/127.30.214.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.189:43729
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200295877777-31578-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.30.214.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.499
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200295877777-31578-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:49:28.596345 499 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:49:28.596578 499 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:49:28.601362 511 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:28.601392 504 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:28.601365 505 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:49:28.601701 499 server_base.cc:1034] running on GCE node
I20260808 14:49:28.601935 499 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:49:28.602223 499 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:49:28.603415 499 hybrid_clock.cc:648] HybridClock initialized: now 1786200568603399 us; error 28 us; skew 500 ppm
Aug 08 14:49:28 dist-test-slave-42z9 krb5kdc[361](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200568, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:49:28.605980 499 init.cc:377] Logged in from keytab as kudu/127.30.214.189@KRBTEST.COM (short username kudu)
I20260808 14:49:28.606456 499 webserver.cc:460] Webserver started at http://127.30.214.189:43153/ using document root <none> and password file <none>
I20260808 14:49:28.606695 499 fs_manager.cc:359] Metadata directory not provided
I20260808 14:49:28.606745 499 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:49:28.606880 499 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:49:28.607952 499 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200295877777-31578-0/minicluster-data/master-1/data/instance:
uuid: "e5cd18b0c8004973b4c5360c52eca0f0"
format_stamp: "Formatted at 2026-08-08 14:49:28 on dist-test-slave-42z9"
server_key: "4f6cf9c200366f9812e32b2bfb5946c1"
server_key_iv: "b23fa055c39f04637380176496af9396"
server_key_version: "encryptionkey@0"
I20260808 14:49:28.608295 499 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200295877777-31578-0/minicluster-data/master-1/wal/instance:
uuid: "e5cd18b0c8004973b4c5360c52eca0f0"
format_stamp: "Formatted at 2026-08-08 14:49:28 on dist-test-slave-42z9"
server_key: "4f6cf9c200366f9812e32b2bfb5946c1"
server_key_iv: "b23fa055c39f04637380176496af9396"
server_key_version: "encryptionkey@0"
I20260808 14:49:28.609658 499 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 14:49:28.610340 524 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:49:28.610499 499 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:49:28.610584 499 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200295877777-31578-0/minicluster-data/master-1/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200295877777-31578-0/minicluster-data/master-1/wal
uuid: "e5cd18b0c8004973b4c5360c52eca0f0"
format_stamp: "Formatted at 2026-08-08 14:49:28 on dist-test-slave-42z9"
server_key: "4f6cf9c200366f9812e32b2bfb5946c1"
server_key_iv: "b23fa055c39f04637380176496af9396"
server_key_version: "encryptionkey@0"
I20260808 14:49:28.610651 499 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200295877777-31578-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200295877777-31578-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200295877777-31578-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:49:28.615100 487 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.214.189" port: 43729 } attempt: 2
I20260808 14:49:28.615538 489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:28.615420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.189:43729 (local address 127.0.0.1:53548)
0808 14:49:28.615475 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:28.615506 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.189:43729: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260808 14:49:28.615866 489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:28.615795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.189:43729 (local address 127.0.0.1:53558)
0808 14:49:28.615826 (+ 31us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:28.615852 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.189:43729: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
W20260808 14:49:28.615940 487 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.214.189:43729: Network error: Client connection negotiation failed: client connection to 127.30.214.189:43729: connect: Connection refused (error 111)
I20260808 14:49:28.617914 499 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:49:28.619942 499 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:49:28.620054 499 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:49:28.623885 499 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.189:43729
I20260808 14:49:28.623931 606 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.189:43729 every 8 connection(s)
I20260808 14:49:28.624256 499 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200295877777-31578-0/minicluster-data/master-1/data/info.pb
I20260808 14:49:28.625154 608 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:49:28.625691 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 499
I20260808 14:49:28.625774 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200295877777-31578-0/minicluster-data/master-1/wal/instance
I20260808 14:49:28.625943 31578 external_mini_cluster.cc:1428] Setting key 6546d3e82a1c45b238c90101d1736ceb
I20260808 14:49:28.626832 608 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.214.190" port: 33139 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 14:49:28 dist-test-slave-42z9 krb5kdc[361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200568, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.189@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.30.214.188@KRBTEST.COM; defaulting to no policy
I20260808 14:49:28.636089 491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:28.627596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41076 (local address 127.30.214.190:33139)
0808 14:49:28.627651 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:28.627653 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:28.627929 (+ 276us) server_negotiation.cc:407] Connection header received
0808 14:49:28.628560 (+ 631us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:28.628561 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:28.628575 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:28.628617 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:28.629321 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:28.630054 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:28.631077 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:28.631400 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:28.631475 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:28.633569 (+ 2094us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:28.633571 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:28.633571 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:28.633581 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:28.634887 (+ 1306us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:28.635346 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:28.635347 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:28.635348 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:28.635405 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:28.635595 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:28.635595 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:28.635595 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:28.635698 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:28.635741 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:28.635956 (+ 215us) server_negotiation.cc:299] Negotiation successful
0808 14:49:28.636021 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 14:49:28.636363 612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:28.627586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:33139 (local address 127.0.0.1:41076)
0808 14:49:28.627777 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:28.627826 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 14:49:28.628458 (+ 632us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:49:28.628699 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:49:28.628704 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:49:28.629008 (+ 304us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:49:28.629222 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:28.629227 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:28.630148 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:28.630148 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:28.630985 (+ 837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:28.630987 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:28.631484 (+ 497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:28.631485 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:28.631590 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:28.632095 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:49:28.632104 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:49:28.633468 (+ 1364us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:49:28.634996 (+ 1528us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:28.635004 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:28.635006 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:28.635285 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:28.635453 (+ 168us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:28.635454 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:28.635454 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:28.635551 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:28.635740 (+ 189us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:49:28.635743 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:49:28.635862 (+ 119us) client_negotiation.cc:769] Sending connection context
0808 14:49:28.635940 (+ 78us) client_negotiation.cc:240] Negotiation successful
0808 14:49:28.636162 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":91,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.188@KRBTEST.COM" created.
I20260808 14:49:28.636981 608 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.214.189" port: 43729 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 14:49:28 dist-test-slave-42z9 krb5kdc[361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200568, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.189@KRBTEST.COM for kudu/127.30.214.189@KRBTEST.COM
I20260808 14:49:28.644449 612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:28.637270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.189:43729 (local address 127.0.0.1:53566)
0808 14:49:28.637316 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:28.637326 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:49:28.637375 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:49:28.637656 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:49:28.637656 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:49:28.637772 (+ 116us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:49:28.637837 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:28.637839 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:28.638957 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:28.638958 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:28.639706 (+ 748us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:28.639709 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:28.640163 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:28.640164 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:28.640238 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:28.640615 (+ 377us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:49:28.640620 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:49:28.641891 (+ 1271us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:49:28.643478 (+ 1587us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:28.643479 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:28.643479 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:28.643636 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:28.643814 (+ 178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:28.643815 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:28.643816 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:28.643870 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:28.644125 (+ 255us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:49:28.644126 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:49:28.644164 (+ 38us) client_negotiation.cc:769] Sending connection context
0808 14:49:28.644227 (+ 63us) client_negotiation.cc:240] Negotiation successful
0808 14:49:28.644333 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26}
I20260808 14:49:28.644510 613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:28.637313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53566 (local address 127.30.214.189:43729)
0808 14:49:28.637502 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:28.637506 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:28.637529 (+ 23us) server_negotiation.cc:407] Connection header received
0808 14:49:28.637551 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:28.637553 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:28.637567 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:28.637654 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:28.637908 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:28.638875 (+ 967us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:28.639789 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:28.640093 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:28.640139 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:28.641964 (+ 1825us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:28.641974 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:28.641974 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:28.641981 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:28.643401 (+ 1420us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:28.643705 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:28.643708 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:28.643708 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:28.643761 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:28.643919 (+ 158us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:28.643920 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:28.643920 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:28.644066 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:28.644138 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:28.644275 (+ 137us) server_negotiation.cc:299] Negotiation successful
0808 14:49:28.644390 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":43,"server-negotiator.queue_time_us":159,"thread_start_us":101,"threads_started":1}
I20260808 14:49:28.645040 608 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.214.188" port: 42321 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:49:28.645380 612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:28.645263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.188:42321 (local address 127.0.0.1:38008)
0808 14:49:28.645304 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:28.645353 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.188:42321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260808 14:49:28.645530 527 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.30.214.188:42321: connect: Connection refused (error 111)
I20260808 14:49:28.645985 612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:28.645863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.188:42321 (local address 127.0.0.1:38012)
0808 14:49:28.645935 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:28.645960 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.188:42321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260808 14:49:28.646080 608 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.214.188:42321: Network error: Client connection negotiation failed: client connection to 127.30.214.188:42321: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.188.keytab.
Entry for principal kudu/127.30.214.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.188.keytab.
I20260808 14:49:28.651912 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200295877777-31578-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200295877777-31578-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200295877777-31578-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200295877777-31578-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.188:42321
--webserver_interface=127.30.214.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.188.keytab
--principal=kudu/127.30.214.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:40115
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.214.190:33139,127.30.214.189:43729,127.30.214.188:42321
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:49:28.695305 608 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.214.188" port: 42321 } attempt: 1
I20260808 14:49:28.695832 612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:28.695667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.188:42321 (local address 127.0.0.1:38026)
0808 14:49:28.695735 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:28.695791 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.188:42321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260808 14:49:28.696171 612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:28.696090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.188:42321 (local address 127.0.0.1:38040)
0808 14:49:28.696125 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:28.696151 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.188:42321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260808 14:49:28.696281 608 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.214.188:42321: Network error: Client connection negotiation failed: client connection to 127.30.214.188:42321: connect: Connection refused (error 111)
I20260808 14:49:28.707090 487 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.214.189" port: 43729 } attempt: 3
Aug 08 14:49:28 dist-test-slave-42z9 krb5kdc[361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200568, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.190@KRBTEST.COM for kudu/127.30.214.189@KRBTEST.COM
I20260808 14:49:28.714659 489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:28.707503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.189:43729 (local address 127.0.0.1:53576)
0808 14:49:28.707553 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:28.707566 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:49:28.707630 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:49:28.707769 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:49:28.707770 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:49:28.707922 (+ 152us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:49:28.708001 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:28.708003 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:28.708947 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:28.708948 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:28.709523 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:28.709525 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:28.710003 (+ 478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:28.710004 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:28.710068 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:28.710525 (+ 457us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:49:28.710529 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:49:28.711897 (+ 1368us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:49:28.713675 (+ 1778us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:28.713677 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:28.713677 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:28.713911 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:28.714101 (+ 190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:28.714101 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:28.714102 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:28.714159 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:28.714406 (+ 247us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:49:28.714407 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:49:28.714455 (+ 48us) client_negotiation.cc:769] Sending connection context
0808 14:49:28.714504 (+ 49us) client_negotiation.cc:240] Negotiation successful
0808 14:49:28.714587 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24}
I20260808 14:49:28.714718 613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:28.707567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53576 (local address 127.30.214.189:43729)
0808 14:49:28.707638 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:28.707641 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:28.707653 (+ 12us) server_negotiation.cc:407] Connection header received
0808 14:49:28.707681 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:28.707683 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:28.707698 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:28.707764 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:28.708071 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:28.708852 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:28.709594 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:28.709928 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:28.710008 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:28.711988 (+ 1980us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:28.711989 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:28.711990 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:28.711998 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:28.713597 (+ 1599us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:28.713979 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:28.713980 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:28.713981 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:28.714045 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:28.714209 (+ 164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:28.714210 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:28.714210 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:28.714345 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:28.714412 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:28.714540 (+ 128us) server_negotiation.cc:299] Negotiation successful
0808 14:49:28.714621 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 14:49:28.715332 487 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.214.188" port: 42321 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:49:28.715653 489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:28.715564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.188:42321 (local address 127.0.0.1:38046)
0808 14:49:28.715605 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:28.715633 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.188:42321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
I20260808 14:49:28.716009 489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:28.715931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.188:42321 (local address 127.0.0.1:38056)
0808 14:49:28.715969 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:28.715991 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.188:42321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260808 14:49:28.716084 487 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.214.188:42321: Network error: Client connection negotiation failed: client connection to 127.30.214.188:42321: connect: Connection refused (error 111)
W20260808 14:49:28.737247 621 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 14:49:28.737520 621 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:49:28.737550 621 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:49:28.737578 621 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:49:28.738829 621 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:49:28.738889 621 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:49:28.738909 621 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:49:28.738926 621 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:49:28.738942 621 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:49:28.740527 621 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:40115
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200295877777-31578-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200295877777-31578-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.30.214.190:33139,127.30.214.189:43729,127.30.214.188:42321
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.188.keytab
--principal=kudu/127.30.214.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.188:42321
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200295877777-31578-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.30.214.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.621
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200295877777-31578-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:49:28.740800 621 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:49:28.741025 621 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:49:28.746057 634 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:28.746083 635 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:49:28.746101 621 server_base.cc:1034] running on GCE node
W20260808 14:49:28.746066 637 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:49:28.746441 621 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:49:28.746762 621 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:49:28.747207 487 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.214.188" port: 42321 } attempt: 1
I20260808 14:49:28.747574 489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:28.747464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.188:42321 (local address 127.0.0.1:38072)
0808 14:49:28.747515 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:28.747545 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.188:42321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260808 14:49:28.747849 489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:28.747799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.188:42321 (local address 127.0.0.1:38088)
0808 14:49:28.747819 (+ 20us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:28.747837 (+ 18us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.188:42321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":11}
W20260808 14:49:28.747926 487 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.214.188:42321: Network error: Client connection negotiation failed: client connection to 127.30.214.188:42321: connect: Connection refused (error 111)
I20260808 14:49:28.747915 621 hybrid_clock.cc:648] HybridClock initialized: now 1786200568747899 us; error 30 us; skew 500 ppm
Aug 08 14:49:28 dist-test-slave-42z9 krb5kdc[361](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200568, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:49:28.750414 621 init.cc:377] Logged in from keytab as kudu/127.30.214.188@KRBTEST.COM (short username kudu)
I20260808 14:49:28.750873 621 webserver.cc:460] Webserver started at http://127.30.214.188:33769/ using document root <none> and password file <none>
I20260808 14:49:28.751073 621 fs_manager.cc:359] Metadata directory not provided
I20260808 14:49:28.751114 621 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:49:28.751211 621 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:49:28.752252 621 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200295877777-31578-0/minicluster-data/master-2/data/instance:
uuid: "4329ed7ca6b343f08bcd43a7c82ba0f3"
format_stamp: "Formatted at 2026-08-08 14:49:28 on dist-test-slave-42z9"
server_key: "fae63eca1ce4ae45780b16f94cff1a39"
server_key_iv: "3eb135f0778dfb4d675da690fdeb5c5a"
server_key_version: "encryptionkey@0"
I20260808 14:49:28.752544 621 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200295877777-31578-0/minicluster-data/master-2/wal/instance:
uuid: "4329ed7ca6b343f08bcd43a7c82ba0f3"
format_stamp: "Formatted at 2026-08-08 14:49:28 on dist-test-slave-42z9"
server_key: "fae63eca1ce4ae45780b16f94cff1a39"
server_key_iv: "3eb135f0778dfb4d675da690fdeb5c5a"
server_key_version: "encryptionkey@0"
I20260808 14:49:28.753860 621 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:49:28.754546 649 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:49:28.754693 621 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 14:49:28.754776 621 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200295877777-31578-0/minicluster-data/master-2/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200295877777-31578-0/minicluster-data/master-2/wal
uuid: "4329ed7ca6b343f08bcd43a7c82ba0f3"
format_stamp: "Formatted at 2026-08-08 14:49:28 on dist-test-slave-42z9"
server_key: "fae63eca1ce4ae45780b16f94cff1a39"
server_key_iv: "3eb135f0778dfb4d675da690fdeb5c5a"
server_key_version: "encryptionkey@0"
I20260808 14:49:28.754839 621 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200295877777-31578-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200295877777-31578-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200295877777-31578-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:49:28.764438 608 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.214.188" port: 42321 } attempt: 2
I20260808 14:49:28.764922 612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:28.764759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.188:42321 (local address 127.0.0.1:38102)
0808 14:49:28.764829 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:28.764880 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.188:42321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260808 14:49:28.765242 612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:28.765176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.188:42321 (local address 127.0.0.1:38106)
0808 14:49:28.765206 (+ 30us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:28.765228 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.188:42321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
W20260808 14:49:28.765326 608 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.214.188:42321: Network error: Client connection negotiation failed: client connection to 127.30.214.188:42321: connect: Connection refused (error 111)
I20260808 14:49:28.768082 621 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:49:28.769896 621 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:49:28.770036 621 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:49:28.774066 621 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.188:42321
I20260808 14:49:28.774108 726 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.188:42321 every 8 connection(s)
I20260808 14:49:28.774448 621 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200295877777-31578-0/minicluster-data/master-2/data/info.pb
I20260808 14:49:28.775336 727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:49:28.776855 727 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.214.190" port: 33139 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:49:28.777630 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 621
I20260808 14:49:28.777724 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786200295877777-31578-0/minicluster-data/master-2/wal/instance
I20260808 14:49:28.777884 31578 external_mini_cluster.cc:1428] Setting key d0cc14e036ce846f52213cd366d53013
Aug 08 14:49:28 dist-test-slave-42z9 krb5kdc[361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200568, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.188@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
Aug 08 14:49:28 dist-test-slave-42z9 krb5kdc[361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200568, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.214.188@KRBTEST.COM
I20260808 14:49:28.785725 491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:28.777571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41086 (local address 127.30.214.190:33139)
0808 14:49:28.777638 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:28.777640 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:28.777860 (+ 220us) server_negotiation.cc:407] Connection header received
0808 14:49:28.778451 (+ 591us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:28.778452 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:28.778472 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:28.778524 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:28.779090 (+ 566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:28.779580 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:28.780551 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:28.780746 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:28.780803 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:28.783083 (+ 2280us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:28.783084 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:28.783085 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:28.783091 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:28.784288 (+ 1197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:28.784735 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:28.784737 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:28.784737 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:28.784790 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:28.785007 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:28.785008 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:28.785008 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:28.785151 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:28.785224 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:28.785550 (+ 326us) server_negotiation.cc:299] Negotiation successful
0808 14:49:28.785638 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 14:49:28.785909 730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:28.777560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:33139 (local address 127.0.0.1:41086)
0808 14:49:28.777724 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:28.777769 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 14:49:28.778303 (+ 534us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:49:28.778582 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:49:28.778586 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:49:28.778836 (+ 250us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:49:28.779005 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:28.779010 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:28.779656 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:28.779657 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:28.780468 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:28.780470 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:28.780815 (+ 345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:28.780816 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:28.780932 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:28.781491 (+ 559us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:49:28.781501 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:49:28.782997 (+ 1496us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:49:28.784363 (+ 1366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:28.784371 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:28.784373 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:28.784667 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:28.784845 (+ 178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:28.784846 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:28.784846 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:28.784948 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:28.785230 (+ 282us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:49:28.785236 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:49:28.785384 (+ 148us) client_negotiation.cc:769] Sending connection context
0808 14:49:28.785513 (+ 129us) client_negotiation.cc:240] Negotiation successful
0808 14:49:28.785665 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"mutex_wait_us":116,"thread_start_us":76,"threads_started":1}
I20260808 14:49:28.786369 732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:28.778265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38122 (local address 127.30.214.188:42321)
0808 14:49:28.778419 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:28.778424 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:28.778462 (+ 38us) server_negotiation.cc:407] Connection header received
0808 14:49:28.778574 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:28.778576 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:28.778595 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:28.778666 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:28.779265 (+ 599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:28.780109 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:28.780818 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:28.781129 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:28.781196 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:28.783541 (+ 2345us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:28.783548 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:28.783548 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:28.783559 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:28.785016 (+ 1457us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:28.785362 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:28.785365 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:28.785365 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:28.785424 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:28.785635 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:28.785636 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:28.785636 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:28.785795 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:28.785961 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:28.786202 (+ 241us) server_negotiation.cc:299] Negotiation successful
0808 14:49:28.786276 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":91,"threads_started":1}
I20260808 14:49:28.786461 727 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.214.189" port: 43729 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 14:49:28 dist-test-slave-42z9 krb5kdc[361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200568, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.188@KRBTEST.COM for kudu/127.30.214.189@KRBTEST.COM
Aug 08 14:49:28 dist-test-slave-42z9 krb5kdc[361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200568, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:49:28.793619 730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:28.786711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.189:43729 (local address 127.0.0.1:53582)
0808 14:49:28.786751 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:28.786761 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:49:28.786797 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:49:28.786971 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:49:28.786972 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:49:28.787113 (+ 141us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:49:28.787175 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:28.787178 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:28.788004 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:28.788005 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:28.788686 (+ 681us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:28.788688 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:28.789143 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:28.789144 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:28.789194 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:28.789598 (+ 404us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:49:28.789603 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:49:28.790937 (+ 1334us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:49:28.792556 (+ 1619us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:28.792557 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:28.792558 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:28.792759 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:28.792945 (+ 186us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:28.792946 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:28.792946 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:28.793020 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:28.793277 (+ 257us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:49:28.793277 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:49:28.793317 (+ 40us) client_negotiation.cc:769] Sending connection context
0808 14:49:28.793374 (+ 57us) client_negotiation.cc:240] Negotiation successful
0808 14:49:28.793524 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26}
I20260808 14:49:28.793634 613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:28.786796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53582 (local address 127.30.214.189:43729)
0808 14:49:28.786852 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:28.786854 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:28.786862 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:49:28.786886 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:28.786887 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:28.786895 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:28.786954 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:28.787242 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:28.787936 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:28.788758 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:28.789077 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:28.789139 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:28.791032 (+ 1893us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:28.791033 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:28.791034 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:28.791042 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:28.792468 (+ 1426us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:28.792835 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:28.792835 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:28.792836 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:28.792891 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:28.793075 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:28.793076 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:28.793076 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:28.793214 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:28.793283 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:28.793434 (+ 151us) server_negotiation.cc:299] Negotiation successful
0808 14:49:28.793542 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 14:49:28.794013 727 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.214.188" port: 42321 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:49:28.794567 491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:28.787152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41096 (local address 127.30.214.190:33139)
0808 14:49:28.787195 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:28.787197 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:28.787205 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:49:28.787235 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:28.787236 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:28.787245 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:28.787288 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:28.787813 (+ 525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:28.788440 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:28.789273 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:28.789544 (+ 271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:28.789609 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:28.791746 (+ 2137us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:28.791747 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:28.791747 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:28.791754 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:28.793036 (+ 1282us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:28.793383 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:28.793384 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:28.793384 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:28.793471 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:28.794028 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:28.794029 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:28.794029 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:28.794172 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:28.794363 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:28.794398 (+ 35us) server_negotiation.cc:299] Negotiation successful
0808 14:49:28.794484 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
Aug 08 14:49:28 dist-test-slave-42z9 krb5kdc[361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200568, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.188@KRBTEST.COM for kudu/127.30.214.188@KRBTEST.COM
Aug 08 14:49:28 dist-test-slave-42z9 krb5kdc[361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200568, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.214.189@KRBTEST.COM
I20260808 14:49:28.800761 730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:28.794283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.188:42321 (local address 127.0.0.1:38128)
0808 14:49:28.794562 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:28.794573 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:49:28.794629 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:49:28.794830 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:49:28.794831 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:49:28.794991 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:49:28.795028 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:28.795030 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:28.795684 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:28.795685 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:28.796211 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:28.796212 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:28.796626 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:28.796627 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:28.796672 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:28.797098 (+ 426us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:49:28.797103 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:49:28.798486 (+ 1383us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:49:28.799835 (+ 1349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:28.799836 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:28.799837 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:28.799993 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:28.800155 (+ 162us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:28.800156 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:28.800156 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:28.800213 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:28.800417 (+ 204us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:49:28.800418 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:49:28.800464 (+ 46us) client_negotiation.cc:769] Sending connection context
0808 14:49:28.800528 (+ 64us) client_negotiation.cc:240] Negotiation successful
0808 14:49:28.800630 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262}
I20260808 14:49:28.800776 732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:28.794314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38128 (local address 127.30.214.188:42321)
0808 14:49:28.794347 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:28.794348 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:28.794715 (+ 367us) server_negotiation.cc:407] Connection header received
0808 14:49:28.794736 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:28.794737 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:28.794749 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:28.794795 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:28.795103 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:28.795608 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:28.796281 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:28.796568 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:28.796629 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:28.798564 (+ 1935us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:28.798565 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:28.798565 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:28.798571 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:28.799760 (+ 1189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:28.800052 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:28.800053 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:28.800054 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:28.800104 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:28.800258 (+ 154us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:28.800259 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:28.800259 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:28.800364 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:28.800417 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:28.800577 (+ 160us) server_negotiation.cc:299] Negotiation successful
0808 14:49:28.800675 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":28,"server-negotiator.queue_time_us":13}
I20260808 14:49:28.802582 727 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4329ed7ca6b343f08bcd43a7c82ba0f3: Bootstrap starting.
I20260808 14:49:28.803112 613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:28.795216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53584 (local address 127.30.214.189:43729)
0808 14:49:28.795257 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:28.795259 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:28.795277 (+ 18us) server_negotiation.cc:407] Connection header received
0808 14:49:28.795296 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:28.795297 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:28.795304 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:28.795343 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:28.795811 (+ 468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:28.796245 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:28.798067 (+ 1822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:28.798292 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:28.798361 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:28.800541 (+ 2180us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:28.800542 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:28.800543 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:28.800550 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:28.802046 (+ 1496us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:28.802420 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:28.802421 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:28.802421 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:28.802478 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:28.802659 (+ 181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:28.802660 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:28.802660 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:28.802781 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:28.802912 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:28.802988 (+ 76us) server_negotiation.cc:299] Negotiation successful
0808 14:49:28.803049 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 14:49:28.803640 727 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4329ed7ca6b343f08bcd43a7c82ba0f3: Neither blocks nor log segments found. Creating new log.
I20260808 14:49:28.803957 727 log.cc:824] T 00000000000000000000000000000000 P 4329ed7ca6b343f08bcd43a7c82ba0f3: Log is configured to *not* fsync() on all Append() calls
I20260808 14:49:28.804811 727 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4329ed7ca6b343f08bcd43a7c82ba0f3: No bootstrap required, opened a new log
I20260808 14:49:28.804968 31578 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:49:28.806438 727 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4329ed7ca6b343f08bcd43a7c82ba0f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d738ebf7e8a4681bca8e4483e31b81e" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 33139 } } peers { permanent_uuid: "e5cd18b0c8004973b4c5360c52eca0f0" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 43729 } } peers { permanent_uuid: "4329ed7ca6b343f08bcd43a7c82ba0f3" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 42321 } }
I20260808 14:49:28.806581 727 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4329ed7ca6b343f08bcd43a7c82ba0f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4329ed7ca6b343f08bcd43a7c82ba0f3, State: Initialized, Role: FOLLOWER
I20260808 14:49:28.806641 727 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4329ed7ca6b343f08bcd43a7c82ba0f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d738ebf7e8a4681bca8e4483e31b81e" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 33139 } } peers { permanent_uuid: "e5cd18b0c8004973b4c5360c52eca0f0" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 43729 } } peers { permanent_uuid: "4329ed7ca6b343f08bcd43a7c82ba0f3" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 42321 } }
I20260808 14:49:28.806059 445 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "9d738ebf7e8a4681bca8e4483e31b81e"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41096
I20260808 14:49:28.806962 727 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4329ed7ca6b343f08bcd43a7c82ba0f3 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:49:28.806960 735 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4329ed7ca6b343f08bcd43a7c82ba0f3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d738ebf7e8a4681bca8e4483e31b81e" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 33139 } } peers { permanent_uuid: "e5cd18b0c8004973b4c5360c52eca0f0" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 43729 } } peers { permanent_uuid: "4329ed7ca6b343f08bcd43a7c82ba0f3" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 42321 } } }
I20260808 14:49:28.807077 735 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4329ed7ca6b343f08bcd43a7c82ba0f3 [sys.catalog]: This master's current role is: FOLLOWER
W20260808 14:49:28.808648 754 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4329ed7ca6b343f08bcd43a7c82ba0f3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:49:28.808708 754 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:49:28.808933 621 master_runner.cc:186] Error getting master registration for 127.30.214.190:33139: OK, instance_id { permanent_uuid: "9d738ebf7e8a4681bca8e4483e31b81e" instance_seqno: 1786200568479766 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 14:49:28.811676 621 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 14:49:28.823056 487 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.214.188" port: 42321 } attempt: 2
Aug 08 14:49:28 dist-test-slave-42z9 krb5kdc[361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200568, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.190@KRBTEST.COM for kudu/127.30.214.188@KRBTEST.COM
I20260808 14:49:28.831396 732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:28.823508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38144 (local address 127.30.214.188:42321)
0808 14:49:28.823590 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:28.823592 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:28.823603 (+ 11us) server_negotiation.cc:407] Connection header received
0808 14:49:28.823631 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:28.823632 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:28.823644 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:28.823718 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:28.824069 (+ 351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:28.824838 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:28.825876 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:28.826187 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:28.826264 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:28.828544 (+ 2280us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:28.828545 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:28.828546 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:28.828554 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:28.830137 (+ 1583us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:28.830557 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:28.830558 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:28.830558 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:28.830614 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:28.830792 (+ 178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:28.830792 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:28.830792 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:28.831003 (+ 211us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:28.831064 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:28.831211 (+ 147us) server_negotiation.cc:299] Negotiation successful
0808 14:49:28.831293 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 14:49:28.831401 489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:28.823420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.188:42321 (local address 127.0.0.1:38144)
0808 14:49:28.823490 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:28.823502 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:49:28.823544 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:49:28.823741 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:49:28.823742 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:49:28.823942 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:49:28.824000 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:28.824002 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:28.824925 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:28.824925 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:28.825796 (+ 871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:28.825798 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:28.826264 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:28.826265 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:28.826321 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:28.826834 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:49:28.826839 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:49:28.828435 (+ 1596us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:49:28.830230 (+ 1795us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:28.830231 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:28.830232 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:28.830478 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:28.830670 (+ 192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:28.830670 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:28.830671 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:28.830737 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:28.831065 (+ 328us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:49:28.831066 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:49:28.831120 (+ 54us) client_negotiation.cc:769] Sending connection context
0808 14:49:28.831191 (+ 71us) client_negotiation.cc:240] Negotiation successful
0808 14:49:28.831299 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49}
I20260808 14:49:28.833425 487 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d738ebf7e8a4681bca8e4483e31b81e: Bootstrap starting.
I20260808 14:49:28.834251 487 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9d738ebf7e8a4681bca8e4483e31b81e: Neither blocks nor log segments found. Creating new log.
I20260808 14:49:28.834550 487 log.cc:824] T 00000000000000000000000000000000 P 9d738ebf7e8a4681bca8e4483e31b81e: Log is configured to *not* fsync() on all Append() calls
I20260808 14:49:28.835457 487 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d738ebf7e8a4681bca8e4483e31b81e: No bootstrap required, opened a new log
I20260808 14:49:28.836834 487 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9d738ebf7e8a4681bca8e4483e31b81e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d738ebf7e8a4681bca8e4483e31b81e" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 33139 } } peers { permanent_uuid: "e5cd18b0c8004973b4c5360c52eca0f0" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 43729 } } peers { permanent_uuid: "4329ed7ca6b343f08bcd43a7c82ba0f3" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 42321 } }
I20260808 14:49:28.836992 487 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9d738ebf7e8a4681bca8e4483e31b81e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d738ebf7e8a4681bca8e4483e31b81e, State: Initialized, Role: FOLLOWER
I20260808 14:49:28.837077 487 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9d738ebf7e8a4681bca8e4483e31b81e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d738ebf7e8a4681bca8e4483e31b81e" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 33139 } } peers { permanent_uuid: "e5cd18b0c8004973b4c5360c52eca0f0" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 43729 } } peers { permanent_uuid: "4329ed7ca6b343f08bcd43a7c82ba0f3" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 42321 } }
I20260808 14:49:28.837430 487 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9d738ebf7e8a4681bca8e4483e31b81e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:49:28.837486 445 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9d738ebf7e8a4681bca8e4483e31b81e [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260808 14:49:28.837531 445 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9d738ebf7e8a4681bca8e4483e31b81e [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:49:28.837389 757 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d738ebf7e8a4681bca8e4483e31b81e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d738ebf7e8a4681bca8e4483e31b81e" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 33139 } } peers { permanent_uuid: "e5cd18b0c8004973b4c5360c52eca0f0" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 43729 } } peers { permanent_uuid: "4329ed7ca6b343f08bcd43a7c82ba0f3" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 42321 } } }
I20260808 14:49:28.838150 757 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d738ebf7e8a4681bca8e4483e31b81e [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:49:28.838351 445 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9d738ebf7e8a4681bca8e4483e31b81e [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d738ebf7e8a4681bca8e4483e31b81e" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 33139 } } peers { permanent_uuid: "e5cd18b0c8004973b4c5360c52eca0f0" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 43729 } } peers { permanent_uuid: "4329ed7ca6b343f08bcd43a7c82ba0f3" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 42321 } }
I20260808 14:49:28.838637 445 leader_election.cc:288] T 00000000000000000000000000000000 P 9d738ebf7e8a4681bca8e4483e31b81e [CANDIDATE]: Term 1 election: Requested vote from peers e5cd18b0c8004973b4c5360c52eca0f0 (127.30.214.189:43729), 4329ed7ca6b343f08bcd43a7c82ba0f3 (127.30.214.188:42321)
I20260808 14:49:28.839032 685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9d738ebf7e8a4681bca8e4483e31b81e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "4329ed7ca6b343f08bcd43a7c82ba0f3"
I20260808 14:49:28.839165 685 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4329ed7ca6b343f08bcd43a7c82ba0f3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:49:28.840111 685 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 4329ed7ca6b343f08bcd43a7c82ba0f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d738ebf7e8a4681bca8e4483e31b81e in term 1.
W20260808 14:49:28.841050 775 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9d738ebf7e8a4681bca8e4483e31b81e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:49:28.841109 775 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:49:28.840366 409 leader_election.cc:302] T 00000000000000000000000000000000 P 9d738ebf7e8a4681bca8e4483e31b81e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4329ed7ca6b343f08bcd43a7c82ba0f3, 9d738ebf7e8a4681bca8e4483e31b81e; no voters:
I20260808 14:49:28.841233 757 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9d738ebf7e8a4681bca8e4483e31b81e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:49:28.841384 757 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9d738ebf7e8a4681bca8e4483e31b81e [term 1 LEADER]: Becoming Leader. State: Replica: 9d738ebf7e8a4681bca8e4483e31b81e, State: Running, Role: LEADER
I20260808 14:49:28.841498 757 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9d738ebf7e8a4681bca8e4483e31b81e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d738ebf7e8a4681bca8e4483e31b81e" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 33139 } } peers { permanent_uuid: "e5cd18b0c8004973b4c5360c52eca0f0" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 43729 } } peers { permanent_uuid: "4329ed7ca6b343f08bcd43a7c82ba0f3" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 42321 } }
I20260808 14:49:28.841902 757 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d738ebf7e8a4681bca8e4483e31b81e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9d738ebf7e8a4681bca8e4483e31b81e. Latest consensus state: current_term: 1 leader_uuid: "9d738ebf7e8a4681bca8e4483e31b81e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d738ebf7e8a4681bca8e4483e31b81e" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 33139 } } peers { permanent_uuid: "e5cd18b0c8004973b4c5360c52eca0f0" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 43729 } } peers { permanent_uuid: "4329ed7ca6b343f08bcd43a7c82ba0f3" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 42321 } } }
I20260808 14:49:28.841989 757 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d738ebf7e8a4681bca8e4483e31b81e [sys.catalog]: This master's current role is: LEADER
I20260808 14:49:28.842657 381 master_runner.cc:186] Error getting master registration for 127.30.214.189:43729: OK, instance_id { permanent_uuid: "e5cd18b0c8004973b4c5360c52eca0f0" instance_seqno: 1786200568622855 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 14:49:28.844976 381 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 14:49:28.845124 785 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:49:28.845351 785 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:49:28.847674 685 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 4329ed7ca6b343f08bcd43a7c82ba0f3 [term 1 FOLLOWER]: Refusing update from remote peer 9d738ebf7e8a4681bca8e4483e31b81e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:49:28.848125 757 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 9d738ebf7e8a4681bca8e4483e31b81e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4329ed7ca6b343f08bcd43a7c82ba0f3" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 42321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:49:28.850504 735 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4329ed7ca6b343f08bcd43a7c82ba0f3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9d738ebf7e8a4681bca8e4483e31b81e. Latest consensus state: current_term: 1 leader_uuid: "9d738ebf7e8a4681bca8e4483e31b81e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d738ebf7e8a4681bca8e4483e31b81e" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 33139 } } peers { permanent_uuid: "e5cd18b0c8004973b4c5360c52eca0f0" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 43729 } } peers { permanent_uuid: "4329ed7ca6b343f08bcd43a7c82ba0f3" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 42321 } } }
I20260808 14:49:28.850605 735 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4329ed7ca6b343f08bcd43a7c82ba0f3 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:49:28.851619 613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:28.840854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53594 (local address 127.30.214.189:43729)
0808 14:49:28.840896 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:28.840898 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:28.841656 (+ 758us) server_negotiation.cc:407] Connection header received
0808 14:49:28.841777 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:28.841778 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:28.841801 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:28.841831 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:28.842821 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:28.843589 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:28.845126 (+ 1537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:28.845509 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:28.845562 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:28.848159 (+ 2597us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:28.848161 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:28.848161 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:28.848182 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:28.849989 (+ 1807us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:28.850568 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:28.850569 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:28.850569 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:28.850642 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:28.850912 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:28.850913 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:28.850914 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:28.851059 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:28.851132 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:28.851439 (+ 307us) server_negotiation.cc:299] Negotiation successful
0808 14:49:28.851529 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 14:49:28.853793 491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:28.840393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41106 (local address 127.30.214.190:33139)
0808 14:49:28.840443 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:28.840446 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:28.841432 (+ 986us) server_negotiation.cc:407] Connection header received
0808 14:49:28.841547 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:28.841548 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:28.841559 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:28.841612 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:28.842512 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:28.843193 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:28.845320 (+ 2127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:28.845670 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:28.845716 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:28.850579 (+ 4863us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:28.850581 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:28.850581 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:28.850589 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:28.852440 (+ 1851us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:28.852884 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:28.852885 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:28.852886 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:28.852946 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:28.853151 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:28.853152 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:28.853153 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:28.853286 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:28.853359 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:28.853630 (+ 271us) server_negotiation.cc:299] Negotiation successful
0808 14:49:28.853711 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 14:49:28.854359 757 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d738ebf7e8a4681bca8e4483e31b81e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9d738ebf7e8a4681bca8e4483e31b81e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d738ebf7e8a4681bca8e4483e31b81e" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 33139 } } peers { permanent_uuid: "e5cd18b0c8004973b4c5360c52eca0f0" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 43729 } } peers { permanent_uuid: "4329ed7ca6b343f08bcd43a7c82ba0f3" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 42321 } } }
I20260808 14:49:28.854454 757 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d738ebf7e8a4681bca8e4483e31b81e [sys.catalog]: This master's current role is: LEADER
I20260808 14:49:28.854846 735 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4329ed7ca6b343f08bcd43a7c82ba0f3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9d738ebf7e8a4681bca8e4483e31b81e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d738ebf7e8a4681bca8e4483e31b81e" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 33139 } } peers { permanent_uuid: "e5cd18b0c8004973b4c5360c52eca0f0" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 43729 } } peers { permanent_uuid: "4329ed7ca6b343f08bcd43a7c82ba0f3" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 42321 } } }
I20260808 14:49:28.854938 735 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4329ed7ca6b343f08bcd43a7c82ba0f3 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:49:28.855187 786 mvcc.cc:205] Tried to move back new op lower bound from 7316277529996591104 to 7316277529975443456. Current Snapshot: MvccSnapshot[applied={T|T < 7316277529996591104}]
I20260808 14:49:28.855521 791 mvcc.cc:205] Tried to move back new op lower bound from 7316277529996591104 to 7316277529975443456. Current Snapshot: MvccSnapshot[applied={T|T < 7316277529996591104}]
I20260808 14:49:28.856467 608 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.214.188" port: 42321 } attempt: 3
I20260808 14:49:28.857151 732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:28.840206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38148 (local address 127.30.214.188:42321)
0808 14:49:28.840448 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:28.840450 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:28.841698 (+ 1248us) server_negotiation.cc:407] Connection header received
0808 14:49:28.844223 (+ 2525us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:28.844225 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:28.844237 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:28.844267 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:28.846050 (+ 1783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:28.846695 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:28.847964 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:28.848221 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:28.849389 (+ 1168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:28.853678 (+ 4289us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:28.853680 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:28.853680 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:28.853688 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:28.855555 (+ 1867us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:28.855945 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:28.855946 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:28.855946 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:28.856005 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:28.856186 (+ 181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:28.856187 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:28.856187 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:28.856309 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:28.856394 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:28.856972 (+ 578us) server_negotiation.cc:299] Negotiation successful
0808 14:49:28.857061 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":222}
Aug 08 14:49:28 dist-test-slave-42z9 krb5kdc[361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200568, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.189@KRBTEST.COM for kudu/127.30.214.188@KRBTEST.COM
I20260808 14:49:28.864348 785 catalog_manager.cc:1347] Generated new cluster ID: f0eb52864b244b8087f0d274ee1b6cfb
I20260808 14:49:28.864408 785 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:49:28.884933 612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:28.856736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.188:42321 (local address 127.0.0.1:38160)
0808 14:49:28.856888 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:28.856900 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:49:28.856946 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:49:28.857756 (+ 810us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:49:28.857758 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:49:28.857936 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:49:28.857990 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:28.857992 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:28.859475 (+ 1483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:28.859476 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:28.860274 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:28.860277 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:28.861054 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:28.861055 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:28.861130 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:28.861593 (+ 463us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:49:28.861598 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:49:28.863836 (+ 2238us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:49:28.883402 (+ 19566us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:28.883404 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:28.883404 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:28.883677 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:28.884062 (+ 385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:28.884063 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:28.884064 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:28.884149 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:28.884605 (+ 456us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:49:28.884606 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:49:28.884660 (+ 54us) client_negotiation.cc:769] Sending connection context
0808 14:49:28.884709 (+ 49us) client_negotiation.cc:240] Negotiation successful
0808 14:49:28.884824 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129}
I20260808 14:49:28.886335 785 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:49:28.887698 798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:28.856769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38160 (local address 127.30.214.188:42321)
0808 14:49:28.857084 (+ 315us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:28.857086 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:28.857093 (+ 7us) server_negotiation.cc:407] Connection header received
0808 14:49:28.857111 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:28.857112 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:28.857155 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:28.858134 (+ 979us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:28.858201 (+ 67us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:28.859316 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:28.860417 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:28.860943 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:28.861317 (+ 374us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:28.863942 (+ 2625us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:28.863944 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:28.863944 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:28.863953 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:28.883114 (+ 19161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:28.883839 (+ 725us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:28.883840 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:28.883841 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:28.883960 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:28.884236 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:28.884237 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:28.884237 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:28.884494 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:28.885674 (+ 1180us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:28.885765 (+ 91us) server_negotiation.cc:299] Negotiation successful
0808 14:49:28.887310 (+ 1545us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":261,"thread_start_us":78,"threads_started":1}
I20260808 14:49:28.889385 785 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:49:28.890465 608 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e5cd18b0c8004973b4c5360c52eca0f0: Bootstrap starting.
I20260808 14:49:28.891249 608 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e5cd18b0c8004973b4c5360c52eca0f0: Neither blocks nor log segments found. Creating new log.
I20260808 14:49:28.891585 608 log.cc:824] T 00000000000000000000000000000000 P e5cd18b0c8004973b4c5360c52eca0f0: Log is configured to *not* fsync() on all Append() calls
I20260808 14:49:28.897396 785 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9d738ebf7e8a4681bca8e4483e31b81e: Generated new TSK 0
I20260808 14:49:28.897836 785 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:49:28.902261 608 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e5cd18b0c8004973b4c5360c52eca0f0: No bootstrap required, opened a new log
I20260808 14:49:28.904539 608 raft_consensus.cc:348] T 00000000000000000000000000000000 P e5cd18b0c8004973b4c5360c52eca0f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d738ebf7e8a4681bca8e4483e31b81e" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 33139 } } peers { permanent_uuid: "e5cd18b0c8004973b4c5360c52eca0f0" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 43729 } } peers { permanent_uuid: "4329ed7ca6b343f08bcd43a7c82ba0f3" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 42321 } }
I20260808 14:49:28.904727 608 raft_consensus.cc:729] T 00000000000000000000000000000000 P e5cd18b0c8004973b4c5360c52eca0f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5cd18b0c8004973b4c5360c52eca0f0, State: Initialized, Role: FOLLOWER
I20260808 14:49:28.904882 608 consensus_queue.cc:260] T 00000000000000000000000000000000 P e5cd18b0c8004973b4c5360c52eca0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d738ebf7e8a4681bca8e4483e31b81e" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 33139 } } peers { permanent_uuid: "e5cd18b0c8004973b4c5360c52eca0f0" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 43729 } } peers { permanent_uuid: "4329ed7ca6b343f08bcd43a7c82ba0f3" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 42321 } }
I20260808 14:49:28.905292 802 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5cd18b0c8004973b4c5360c52eca0f0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d738ebf7e8a4681bca8e4483e31b81e" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 33139 } } peers { permanent_uuid: "e5cd18b0c8004973b4c5360c52eca0f0" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 43729 } } peers { permanent_uuid: "4329ed7ca6b343f08bcd43a7c82ba0f3" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 42321 } } }
I20260808 14:49:28.905403 564 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e5cd18b0c8004973b4c5360c52eca0f0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:49:28.905431 565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9d738ebf7e8a4681bca8e4483e31b81e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "e5cd18b0c8004973b4c5360c52eca0f0"
I20260808 14:49:28.905311 608 sys_catalog.cc:564] T 00000000000000000000000000000000 P e5cd18b0c8004973b4c5360c52eca0f0 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:49:28.906611 564 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e5cd18b0c8004973b4c5360c52eca0f0 [term 1 FOLLOWER]: Refusing update from remote peer 9d738ebf7e8a4681bca8e4483e31b81e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:49:28.907007 796 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 9d738ebf7e8a4681bca8e4483e31b81e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5cd18b0c8004973b4c5360c52eca0f0" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 43729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:49:28.908640 565 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e5cd18b0c8004973b4c5360c52eca0f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d738ebf7e8a4681bca8e4483e31b81e in term 1.
W20260808 14:49:28.910784 823 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e5cd18b0c8004973b4c5360c52eca0f0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:49:28.910846 823 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:49:28.910965 802 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5cd18b0c8004973b4c5360c52eca0f0 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:49:28.911064 802 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5cd18b0c8004973b4c5360c52eca0f0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9d738ebf7e8a4681bca8e4483e31b81e. Latest consensus state: current_term: 1 leader_uuid: "9d738ebf7e8a4681bca8e4483e31b81e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d738ebf7e8a4681bca8e4483e31b81e" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 33139 } } peers { permanent_uuid: "e5cd18b0c8004973b4c5360c52eca0f0" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 43729 } } peers { permanent_uuid: "4329ed7ca6b343f08bcd43a7c82ba0f3" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 42321 } } }
I20260808 14:49:28.911175 802 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5cd18b0c8004973b4c5360c52eca0f0 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:49:28.911242 802 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5cd18b0c8004973b4c5360c52eca0f0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9d738ebf7e8a4681bca8e4483e31b81e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d738ebf7e8a4681bca8e4483e31b81e" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 33139 } } peers { permanent_uuid: "e5cd18b0c8004973b4c5360c52eca0f0" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 43729 } } peers { permanent_uuid: "4329ed7ca6b343f08bcd43a7c82ba0f3" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 42321 } } }
I20260808 14:49:28.911330 802 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5cd18b0c8004973b4c5360c52eca0f0 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:49:28.916359 825 mvcc.cc:205] Tried to move back new op lower bound from 7316277530197712896 to 7316277529975443456. Current Snapshot: MvccSnapshot[applied={T|T < 7316277529996591104}]
W20260808 14:49:28.933380 491 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:49:28.931519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41120 (local address 127.30.214.190:33139)
0808 14:49:28.931569 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:28.931571 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:28.932640 (+ 1069us) server_negotiation.cc:407] Connection header received
0808 14:49:28.932745 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:28.932746 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:28.932759 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:28.932789 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:28.933301 (+ 512us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41120: BlockingRecv error: recv got EOF from 127.0.0.1:41120 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260808 14:49:28.934463 613 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:49:28.931911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53606 (local address 127.30.214.189:43729)
0808 14:49:28.931953 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:28.931967 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:28.933707 (+ 1740us) server_negotiation.cc:407] Connection header received
0808 14:49:28.933989 (+ 282us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:28.933991 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:28.934002 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:28.934032 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:28.934398 (+ 366us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53606: BlockingRecv error: recv got EOF from 127.0.0.1:53606 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260808 14:49:28.935065 798 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:49:28.932371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38174 (local address 127.30.214.188:42321)
0808 14:49:28.932422 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:28.932423 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:28.933892 (+ 1469us) server_negotiation.cc:407] Connection header received
0808 14:49:28.933950 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:28.933952 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:28.933963 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:28.934012 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:28.935000 (+ 988us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38174: BlockingRecv error: recv got EOF from 127.0.0.1:38174 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
W20260808 14:49:28.939972 613 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:49:28.939016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53618 (local address 127.30.214.189:43729)
0808 14:49:28.939058 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:28.939059 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:28.939292 (+ 233us) server_negotiation.cc:407] Connection header received
0808 14:49:28.939429 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:28.939430 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:28.939451 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:28.939481 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:28.939885 (+ 404us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53618: BlockingRecv error: recv got EOF from 127.0.0.1:53618 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260808 14:49:28.943225 613 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:49:28.942380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53620 (local address 127.30.214.189:43729)
0808 14:49:28.942417 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:28.942419 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:28.942682 (+ 263us) server_negotiation.cc:407] Connection header received
0808 14:49:28.942778 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:28.942779 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:28.942792 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:28.942820 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:28.943171 (+ 351us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53620: BlockingRecv error: recv got EOF from 127.0.0.1:53620 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260808 14:49:28.947286 613 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:49:28.946423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53636 (local address 127.30.214.189:43729)
0808 14:49:28.946471 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:28.946473 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:28.946730 (+ 257us) server_negotiation.cc:407] Connection header received
0808 14:49:28.946826 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:28.946827 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:28.946838 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:28.946866 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:28.947232 (+ 366us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53636: BlockingRecv error: recv got EOF from 127.0.0.1:53636 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260808 14:49:28.953558 613 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:49:28.952542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53640 (local address 127.30.214.189:43729)
0808 14:49:28.952586 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:28.952588 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:28.952891 (+ 303us) server_negotiation.cc:407] Connection header received
0808 14:49:28.953002 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:28.953003 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:28.953016 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:28.953044 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:28.953500 (+ 456us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53640: BlockingRecv error: recv got EOF from 127.0.0.1:53640 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260808 14:49:28.963868 613 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:49:28.962921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53648 (local address 127.30.214.189:43729)
0808 14:49:28.962981 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:28.962982 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:28.963266 (+ 284us) server_negotiation.cc:407] Connection header received
0808 14:49:28.963368 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:28.963368 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:28.963381 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:28.963410 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:28.963807 (+ 397us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53648: BlockingRecv error: recv got EOF from 127.0.0.1:53648 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260808 14:49:28.982301 613 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:49:28.981285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53650 (local address 127.30.214.189:43729)
0808 14:49:28.981333 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:28.981335 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:28.981674 (+ 339us) server_negotiation.cc:407] Connection header received
0808 14:49:28.981776 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:28.981777 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:28.981790 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:28.981819 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:28.982238 (+ 419us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53650: BlockingRecv error: recv got EOF from 127.0.0.1:53650 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260808 14:49:29.016875 613 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:49:29.016049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53652 (local address 127.30.214.189:43729)
0808 14:49:29.016102 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:29.016104 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:29.016271 (+ 167us) server_negotiation.cc:407] Connection header received
0808 14:49:29.016334 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:29.016335 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:29.016350 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:29.016417 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:29.016811 (+ 394us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53652: BlockingRecv error: recv got EOF from 127.0.0.1:53652 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260808 14:49:29.082653 613 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:49:29.082011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53660 (local address 127.30.214.189:43729)
0808 14:49:29.082104 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:29.082106 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:29.082152 (+ 46us) server_negotiation.cc:407] Connection header received
0808 14:49:29.082204 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:29.082205 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:29.082217 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:29.082268 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:29.082591 (+ 323us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53660: BlockingRecv error: recv got EOF from 127.0.0.1:53660 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
W20260808 14:49:29.212508 613 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:49:29.211829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53668 (local address 127.30.214.189:43729)
0808 14:49:29.211902 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:29.211905 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:29.211963 (+ 58us) server_negotiation.cc:407] Connection header received
0808 14:49:29.212033 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:29.212034 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:29.212046 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:29.212096 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:29.212444 (+ 348us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53668: BlockingRecv error: recv got EOF from 127.0.0.1:53668 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 14:49:29.446120 919 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d738ebf7e8a4681bca8e4483e31b81e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9d738ebf7e8a4681bca8e4483e31b81e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d738ebf7e8a4681bca8e4483e31b81e" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 33139 } } peers { permanent_uuid: "e5cd18b0c8004973b4c5360c52eca0f0" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 43729 } } peers { permanent_uuid: "4329ed7ca6b343f08bcd43a7c82ba0f3" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 42321 } } }
I20260808 14:49:29.446273 919 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d738ebf7e8a4681bca8e4483e31b81e [sys.catalog]: This master's current role is: LEADER
W20260808 14:49:29.470348 613 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:49:29.469758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53670 (local address 127.30.214.189:43729)
0808 14:49:29.469848 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:29.469850 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:29.469889 (+ 39us) server_negotiation.cc:407] Connection header received
0808 14:49:29.469916 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:29.469917 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:29.469927 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:29.469972 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:29.470290 (+ 318us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53670: BlockingRecv error: recv got EOF from 127.0.0.1:53670 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 14:49:29.809170 754 catalog_manager.cc:1259] Loaded cluster ID: f0eb52864b244b8087f0d274ee1b6cfb
I20260808 14:49:29.809253 754 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 4329ed7ca6b343f08bcd43a7c82ba0f3: loading cluster ID for follower catalog manager: success
I20260808 14:49:29.810104 754 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 4329ed7ca6b343f08bcd43a7c82ba0f3: acquiring CA information for follower catalog manager: success
I20260808 14:49:29.810410 754 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 4329ed7ca6b343f08bcd43a7c82ba0f3: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 14:49:29.911283 823 catalog_manager.cc:1259] Loaded cluster ID: f0eb52864b244b8087f0d274ee1b6cfb
I20260808 14:49:29.911369 823 catalog_manager.cc:1552] T 00000000000000000000000000000000 P e5cd18b0c8004973b4c5360c52eca0f0: loading cluster ID for follower catalog manager: success
I20260808 14:49:29.912189 823 catalog_manager.cc:1574] T 00000000000000000000000000000000 P e5cd18b0c8004973b4c5360c52eca0f0: acquiring CA information for follower catalog manager: success
I20260808 14:49:29.912516 823 catalog_manager.cc:1602] T 00000000000000000000000000000000 P e5cd18b0c8004973b4c5360c52eca0f0: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 14:49:29.985882 938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:29.983465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33502 (local address 127.30.214.189:43729)
0808 14:49:29.983597 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:29.983600 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:29.983614 (+ 14us) server_negotiation.cc:407] Connection header received
0808 14:49:29.983693 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:29.983693 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:29.983748 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:29.983821 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:49:29.983947 (+ 126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:29.984459 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:29.985199 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:29.985385 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:29.985458 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:29.985591 (+ 133us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:49:29.985706 (+ 115us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:49:29.985765 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:29.985781 (+ 16us) server_negotiation.cc:299] Negotiation successful
0808 14:49:29.985799 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107,"thread_start_us":58,"threads_started":1}
I20260808 14:49:29.990223 946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:29.987784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35698 (local address 127.30.214.188:42321)
0808 14:49:29.987954 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:29.987956 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:29.987963 (+ 7us) server_negotiation.cc:407] Connection header received
0808 14:49:29.988000 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:29.988000 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:29.988037 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:29.988110 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:49:29.988233 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:29.988753 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:29.989482 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:29.989680 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:29.989735 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:29.989893 (+ 158us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:49:29.990001 (+ 108us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:49:29.990069 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:29.990114 (+ 45us) server_negotiation.cc:299] Negotiation successful
0808 14:49:29.990136 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":142,"threads_started":1}
I20260808 14:49:29.994644 946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:29.991918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35712 (local address 127.30.214.188:42321)
0808 14:49:29.991954 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:29.991956 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:29.992030 (+ 74us) server_negotiation.cc:407] Connection header received
0808 14:49:29.992173 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:29.992174 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:29.992184 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:29.992234 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:49:29.992381 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:29.992881 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:29.993836 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:29.994120 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:29.994174 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:29.994301 (+ 127us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:49:29.994335 (+ 34us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:49:29.994378 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:29.994446 (+ 68us) server_negotiation.cc:299] Negotiation successful
0808 14:49:29.994466 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 14:49:29.994932 938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:29.992027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33504 (local address 127.30.214.189:43729)
0808 14:49:29.992070 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:29.992072 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:29.992246 (+ 174us) server_negotiation.cc:407] Connection header received
0808 14:49:29.992344 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:29.992346 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:29.992356 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:29.992405 (+ 49us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:49:29.992510 (+ 105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:29.993215 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:29.994053 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:29.994361 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:29.994423 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:29.994597 (+ 174us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:49:29.994632 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:49:29.994681 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:29.994830 (+ 149us) server_negotiation.cc:299] Negotiation successful
0808 14:49:29.994860 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 14:49:29.995076 957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:29.991856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34304 (local address 127.30.214.190:33139)
0808 14:49:29.992016 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:29.992018 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:29.992026 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:49:29.992071 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:29.992072 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:29.992107 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:29.992176 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:49:29.992340 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:29.993114 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:29.994071 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:29.994390 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:29.994441 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:29.994767 (+ 326us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:49:29.994875 (+ 108us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:49:29.994938 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:29.994978 (+ 40us) server_negotiation.cc:299] Negotiation successful
0808 14:49:29.995003 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":54,"threads_started":1}
I20260808 14:49:29.996618 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 381
I20260808 14:49:30.007934 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 499
I20260808 14:49:30.018895 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 621
2026-08-08T14:49:30Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (2929 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200295877777-31578-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:49:30 dist-test-slave-42z9 krb5kdc[963](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:49:30 dist-test-slave-42z9 krb5kdc[963](info): set up 2 sockets
Aug 08 14:49:30 dist-test-slave-42z9 krb5kdc[963](info): commencing operation
krb5kdc: starting...
W20260808 14:49:31.163563 31578 mini_kdc.cc:121] Time spent starting KDC: real 1.122s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200295877777-31578-0/krb5kdc/test-user.keytab.
Aug 08 14:49:31 dist-test-slave-42z9 krb5kdc[963](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200571, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:49:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:49:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.214.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab.
Entry for principal kudu/127.30.214.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab.
I20260808 14:49:31.287505 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200295877777-31578-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200295877777-31578-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200295877777-31578-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:33573
--webserver_interface=127.30.214.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab
--principal=kudu/127.30.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:38295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.214.190:33573,127.30.214.189:34323,127.30.214.188:36781
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:49:31.375141 989 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 14:49:31.375383 989 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:49:31.375401 989 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:49:31.375422 989 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:49:31.376717 989 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:49:31.376776 989 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:49:31.376791 989 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:49:31.376801 989 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:49:31.376816 989 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:49:31.378536 989 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:38295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200295877777-31578-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200295877777-31578-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.214.190:33573,127.30.214.189:34323,127.30.214.188:36781
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.190.keytab
--principal=kudu/127.30.214.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.190:33573
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.989
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200295877777-31578-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:49:31.378808 989 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:49:31.379056 989 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:49:31.384073 997 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:31.384063 996 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:49:31.384325 989 server_base.cc:1034] running on GCE node
W20260808 14:49:31.384066 999 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:49:31.384881 989 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:49:31.385195 989 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:49:31.386368 989 hybrid_clock.cc:648] HybridClock initialized: now 1786200571386344 us; error 39 us; skew 500 ppm
Aug 08 14:49:31 dist-test-slave-42z9 krb5kdc[963](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200571, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:49:31.388871 989 init.cc:377] Logged in from keytab as kudu/127.30.214.190@KRBTEST.COM (short username kudu)
I20260808 14:49:31.389326 989 webserver.cc:460] Webserver started at http://127.30.214.190:38869/ using document root <none> and password file <none>
I20260808 14:49:31.389590 989 fs_manager.cc:359] Metadata directory not provided
I20260808 14:49:31.389639 989 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:49:31.389770 989 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:49:31.390863 989 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200295877777-31578-0/minicluster-data/master-0/data/instance:
uuid: "af58ea3d4986432db73a5c538a4215fd"
format_stamp: "Formatted at 2026-08-08 14:49:31 on dist-test-slave-42z9"
server_key: "798ce477625b383a8067e6b8172ddd46"
server_key_iv: "a2561bba9347a2be3a92df44942a81b4"
server_key_version: "encryptionkey@0"
I20260808 14:49:31.391196 989 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200295877777-31578-0/minicluster-data/master-0/wal/instance:
uuid: "af58ea3d4986432db73a5c538a4215fd"
format_stamp: "Formatted at 2026-08-08 14:49:31 on dist-test-slave-42z9"
server_key: "798ce477625b383a8067e6b8172ddd46"
server_key_iv: "a2561bba9347a2be3a92df44942a81b4"
server_key_version: "encryptionkey@0"
I20260808 14:49:31.392505 989 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 14:49:31.393409 1012 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:49:31.393586 989 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:49:31.393671 989 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200295877777-31578-0/minicluster-data/master-0/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200295877777-31578-0/minicluster-data/master-0/wal
uuid: "af58ea3d4986432db73a5c538a4215fd"
format_stamp: "Formatted at 2026-08-08 14:49:31 on dist-test-slave-42z9"
server_key: "798ce477625b383a8067e6b8172ddd46"
server_key_iv: "a2561bba9347a2be3a92df44942a81b4"
server_key_version: "encryptionkey@0"
I20260808 14:49:31.393749 989 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200295877777-31578-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200295877777-31578-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200295877777-31578-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:49:31.411091 989 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:49:31.412905 989 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:49:31.413038 989 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:49:31.417265 989 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.190:33573
I20260808 14:49:31.417395 1084 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.190:33573 every 8 connection(s)
I20260808 14:49:31.417704 989 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200295877777-31578-0/minicluster-data/master-0/data/info.pb
I20260808 14:49:31.418632 1085 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:49:31.420336 1085 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.214.190" port: 33573 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:49:31.423056 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 989
I20260808 14:49:31.423164 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200295877777-31578-0/minicluster-data/master-0/wal/instance
I20260808 14:49:31.423342 31578 external_mini_cluster.cc:1428] Setting key 53a6ce5d48711210aa4dcc923d07f76c
Aug 08 14:49:31 dist-test-slave-42z9 krb5kdc[963](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200571, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.190@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:49:31.430680 1088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:31.421141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35174 (local address 127.30.214.190:33573)
0808 14:49:31.421734 (+ 593us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:31.421738 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:31.421770 (+ 32us) server_negotiation.cc:407] Connection header received
0808 14:49:31.421970 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:31.421972 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:31.421989 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:31.422075 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:31.422615 (+ 540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:31.423765 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:31.424631 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:31.425090 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:31.425216 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:31.427639 (+ 2423us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:31.427646 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:31.427647 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:31.427654 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:31.429156 (+ 1502us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:31.429532 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:31.429535 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:31.429535 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:31.429618 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:31.429816 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:31.429817 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:31.429818 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:31.430042 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:31.430112 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:31.430300 (+ 188us) server_negotiation.cc:299] Negotiation successful
0808 14:49:31.430425 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":552,"thread_start_us":84,"threads_started":1}
I20260808 14:49:31.430682 1087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:31.421096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:33573 (local address 127.0.0.1:35174)
0808 14:49:31.421260 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:31.421303 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 14:49:31.421837 (+ 534us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:49:31.422088 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:49:31.422090 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:49:31.422343 (+ 253us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:49:31.422520 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:31.422523 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:31.423855 (+ 1332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:31.423856 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:31.424542 (+ 686us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:31.424543 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:31.425191 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:31.425191 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:31.425267 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:31.425812 (+ 545us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:49:31.425822 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:49:31.427553 (+ 1731us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:49:31.429231 (+ 1678us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:31.429238 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:31.429240 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:31.429467 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:31.429674 (+ 207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:31.429674 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:31.429675 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:31.429757 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:31.430101 (+ 344us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:49:31.430106 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:49:31.430170 (+ 64us) client_negotiation.cc:769] Sending connection context
0808 14:49:31.430246 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 14:49:31.430501 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"mutex_wait_us":103,"thread_start_us":74,"threads_started":1}
I20260808 14:49:31.431453 1085 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.214.189" port: 34323 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:49:31.431808 1087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:31.431700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.189:34323 (local address 127.0.0.1:40108)
0808 14:49:31.431740 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:31.431786 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.189:34323: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
W20260808 14:49:31.431973 1015 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.30.214.189:34323: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.30.214.189@KRBTEST.COM; defaulting to no policy
I20260808 14:49:31.432384 1087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:31.432292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.189:34323 (local address 127.0.0.1:40118)
0808 14:49:31.432327 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:31.432351 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.189:34323: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
W20260808 14:49:31.432511 1085 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.214.189:34323: Network error: Client connection negotiation failed: client connection to 127.30.214.189:34323: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.189.keytab.
Entry for principal kudu/127.30.214.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.189.keytab.
I20260808 14:49:31.450670 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200295877777-31578-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200295877777-31578-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200295877777-31578-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200295877777-31578-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.189:34323
--webserver_interface=127.30.214.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.189.keytab
--principal=kudu/127.30.214.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:38295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.214.190:33573,127.30.214.189:34323,127.30.214.188:36781
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:49:31.481739 1085 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.214.189" port: 34323 } attempt: 1
I20260808 14:49:31.482270 1087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:31.482142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.189:34323 (local address 127.0.0.1:40120)
0808 14:49:31.482201 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:31.482236 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.189:34323: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260808 14:49:31.482818 1087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:31.482578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.189:34323 (local address 127.0.0.1:40122)
0808 14:49:31.482695 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:31.482769 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.189:34323: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
W20260808 14:49:31.483048 1085 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.214.189:34323: Network error: Client connection negotiation failed: client connection to 127.30.214.189:34323: connect: Connection refused (error 111)
W20260808 14:49:31.536751 1096 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 14:49:31.536983 1096 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:49:31.537000 1096 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:49:31.537026 1096 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:49:31.538267 1096 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:49:31.538314 1096 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:49:31.538328 1096 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:49:31.538340 1096 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:49:31.538352 1096 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:49:31.539893 1096 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:38295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200295877777-31578-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200295877777-31578-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.30.214.190:33573,127.30.214.189:34323,127.30.214.188:36781
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.189.keytab
--principal=kudu/127.30.214.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.189:34323
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200295877777-31578-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.30.214.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1096
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200295877777-31578-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:49:31.540103 1096 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:49:31.540300 1096 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:49:31.545310 1104 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:31.545308 1109 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:31.545313 1105 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:49:31.545655 1096 server_base.cc:1034] running on GCE node
I20260808 14:49:31.545918 1096 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:49:31.546232 1096 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:49:31.547369 1096 hybrid_clock.cc:648] HybridClock initialized: now 1786200571547357 us; error 31 us; skew 500 ppm
Aug 08 14:49:31 dist-test-slave-42z9 krb5kdc[963](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200571, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:49:31.550253 1096 init.cc:377] Logged in from keytab as kudu/127.30.214.189@KRBTEST.COM (short username kudu)
I20260808 14:49:31.550949 1096 webserver.cc:460] Webserver started at http://127.30.214.189:35253/ using document root <none> and password file <none>
I20260808 14:49:31.551201 1085 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.214.189" port: 34323 } attempt: 2
I20260808 14:49:31.551386 1096 fs_manager.cc:359] Metadata directory not provided
I20260808 14:49:31.551466 1096 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:49:31.551652 1096 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:49:31.551692 1087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:31.551493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.189:34323 (local address 127.0.0.1:40130)
0808 14:49:31.551585 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:31.551646 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.189:34323: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260808 14:49:31.552042 1087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:31.551929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.189:34323 (local address 127.0.0.1:40144)
0808 14:49:31.551985 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:31.552019 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.189:34323: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260808 14:49:31.552158 1085 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.214.189:34323: Network error: Client connection negotiation failed: client connection to 127.30.214.189:34323: connect: Connection refused (error 111)
I20260808 14:49:31.553285 1096 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200295877777-31578-0/minicluster-data/master-1/data/instance:
uuid: "beb338aaff6e49e28431f86521846989"
format_stamp: "Formatted at 2026-08-08 14:49:31 on dist-test-slave-42z9"
server_key: "847ea65e13fb71819bb661ef6dd5c767"
server_key_iv: "173fbc2fe4ad246989480bc04fb9077f"
server_key_version: "encryptionkey@0"
I20260808 14:49:31.553756 1096 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200295877777-31578-0/minicluster-data/master-1/wal/instance:
uuid: "beb338aaff6e49e28431f86521846989"
format_stamp: "Formatted at 2026-08-08 14:49:31 on dist-test-slave-42z9"
server_key: "847ea65e13fb71819bb661ef6dd5c767"
server_key_iv: "173fbc2fe4ad246989480bc04fb9077f"
server_key_version: "encryptionkey@0"
I20260808 14:49:31.555142 1096 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:49:31.555943 1119 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:49:31.556182 1096 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:49:31.556303 1096 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200295877777-31578-0/minicluster-data/master-1/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200295877777-31578-0/minicluster-data/master-1/wal
uuid: "beb338aaff6e49e28431f86521846989"
format_stamp: "Formatted at 2026-08-08 14:49:31 on dist-test-slave-42z9"
server_key: "847ea65e13fb71819bb661ef6dd5c767"
server_key_iv: "173fbc2fe4ad246989480bc04fb9077f"
server_key_version: "encryptionkey@0"
I20260808 14:49:31.556388 1096 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200295877777-31578-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200295877777-31578-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200295877777-31578-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:49:31.574803 1096 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:49:31.576794 1096 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:49:31.576924 1096 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:49:31.580868 1096 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.189:34323
I20260808 14:49:31.580914 1204 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.189:34323 every 8 connection(s)
I20260808 14:49:31.581256 1096 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200295877777-31578-0/minicluster-data/master-1/data/info.pb
I20260808 14:49:31.582207 1205 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:49:31.583798 1205 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.214.190" port: 33573 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:49:31.587917 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 1096
I20260808 14:49:31.588034 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200295877777-31578-0/minicluster-data/master-1/wal/instance
I20260808 14:49:31.588227 31578 external_mini_cluster.cc:1428] Setting key ae548c7439d15babb19c4bc547ffed4d
Aug 08 14:49:31 dist-test-slave-42z9 krb5kdc[963](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200571, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.189@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:49:31.593416 1088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:31.584531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35186 (local address 127.30.214.190:33573)
0808 14:49:31.584610 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:31.584612 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:31.584796 (+ 184us) server_negotiation.cc:407] Connection header received
0808 14:49:31.585269 (+ 473us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:31.585270 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:31.585280 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:31.585340 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:31.586070 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:31.586789 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:31.587852 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:31.588188 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:31.588265 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:31.590550 (+ 2285us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:31.590551 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:31.590552 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:31.590559 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:31.591984 (+ 1425us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:31.592410 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:31.592411 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:31.592412 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:31.592487 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:31.592714 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:31.592715 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:31.592716 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:31.592880 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:31.592954 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:31.593208 (+ 254us) server_negotiation.cc:299] Negotiation successful
0808 14:49:31.593301 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 14:49:31.593549 1207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:31.584495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:33573 (local address 127.0.0.1:35186)
0808 14:49:31.584676 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:31.584719 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 14:49:31.585195 (+ 476us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:49:31.585393 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:49:31.585397 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:49:31.585695 (+ 298us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:49:31.585900 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:31.585904 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:31.586914 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:31.586915 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:31.587766 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:31.587769 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:31.588278 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:31.588279 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:31.588418 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:31.588934 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:49:31.588943 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:49:31.590445 (+ 1502us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:49:31.592088 (+ 1643us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:31.592096 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:31.592098 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:31.592337 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:31.592556 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:31.592556 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:31.592557 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:31.592653 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:31.592946 (+ 293us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:49:31.592952 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:49:31.593081 (+ 129us) client_negotiation.cc:769] Sending connection context
0808 14:49:31.593171 (+ 90us) client_negotiation.cc:240] Negotiation successful
0808 14:49:31.593309 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":94,"threads_started":1}
I20260808 14:49:31.594157 1205 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.214.189" port: 34323 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.30.214.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.214.188@KRBTEST.COM" created.
Aug 08 14:49:31 dist-test-slave-42z9 krb5kdc[963](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200571, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.189@KRBTEST.COM for kudu/127.30.214.189@KRBTEST.COM
I20260808 14:49:31.602636 1207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:31.594401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.189:34323 (local address 127.0.0.1:40148)
0808 14:49:31.594447 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:31.594459 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:49:31.594500 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:49:31.594757 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:49:31.594758 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:49:31.594900 (+ 142us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:49:31.594953 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:31.594954 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:31.595776 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:31.595777 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:31.596282 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:31.596284 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:31.596776 (+ 492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:31.596777 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:31.596838 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:31.597261 (+ 423us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:49:31.597265 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:49:31.600039 (+ 2774us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:49:31.601699 (+ 1660us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:31.601700 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:31.601700 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:31.601905 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:31.602084 (+ 179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:31.602084 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:31.602085 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:31.602149 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:31.602386 (+ 237us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:49:31.602386 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:49:31.602425 (+ 39us) client_negotiation.cc:769] Sending connection context
0808 14:49:31.602479 (+ 54us) client_negotiation.cc:240] Negotiation successful
0808 14:49:31.602565 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25}
I20260808 14:49:31.602746 1209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:31.594461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40148 (local address 127.30.214.189:34323)
0808 14:49:31.594637 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:31.594642 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:31.594658 (+ 16us) server_negotiation.cc:407] Connection header received
0808 14:49:31.594674 (+ 16us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:31.594676 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:31.594687 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:31.594748 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:31.595019 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:31.595704 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:31.596350 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:31.596709 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:31.596770 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:31.600132 (+ 3362us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:31.600142 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:31.600142 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:31.600149 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:31.601623 (+ 1474us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:31.601979 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:31.601981 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:31.601981 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:31.602033 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:31.602203 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:31.602203 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:31.602204 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:31.602334 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:31.602394 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:31.602542 (+ 148us) server_negotiation.cc:299] Negotiation successful
0808 14:49:31.602619 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":100,"threads_started":1}
I20260808 14:49:31.603310 1205 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.214.188" port: 36781 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:49:31.603680 1207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:31.603577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.188:36781 (local address 127.0.0.1:39910)
0808 14:49:31.603612 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:31.603659 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.188:36781: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
W20260808 14:49:31.604027 1121 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.30.214.188:36781: connect: Connection refused (error 111)
I20260808 14:49:31.604629 1207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:31.604547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.188:36781 (local address 127.0.0.1:39920)
0808 14:49:31.604588 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:31.604612 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.188:36781: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260808 14:49:31.604733 1205 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.214.188:36781: Network error: Client connection negotiation failed: client connection to 127.30.214.188:36781: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.214.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.188.keytab.
Entry for principal kudu/127.30.214.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.188.keytab.
I20260808 14:49:31.615857 31578 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskT6IgCE/build/release/bin/kudu
/tmp/dist-test-taskT6IgCE/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200295877777-31578-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200295877777-31578-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200295877777-31578-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200295877777-31578-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.188:36781
--webserver_interface=127.30.214.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.188.keytab
--principal=kudu/127.30.214.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.214.148:38295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.214.190:33573,127.30.214.189:34323,127.30.214.188:36781
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200295877777-31578-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200295877777-31578-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200295877777-31578-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:49:31.643342 1085 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.214.189" port: 34323 } attempt: 3
Aug 08 14:49:31 dist-test-slave-42z9 krb5kdc[963](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200571, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.190@KRBTEST.COM for kudu/127.30.214.189@KRBTEST.COM
I20260808 14:49:31.650362 1087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:31.643787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.189:34323 (local address 127.0.0.1:40164)
0808 14:49:31.643850 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:31.643862 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:49:31.643908 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:49:31.644052 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:49:31.644053 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:49:31.644224 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:49:31.644292 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:31.644294 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:31.644936 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:31.644937 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:31.645491 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:31.645494 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:31.645862 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:31.645863 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:31.645942 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:31.646427 (+ 485us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:49:31.646432 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:49:31.647865 (+ 1433us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:49:31.649329 (+ 1464us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:31.649331 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:31.649331 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:31.649567 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:31.649746 (+ 179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:31.649747 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:31.649747 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:31.649809 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:31.650030 (+ 221us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:49:31.650031 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:49:31.650079 (+ 48us) client_negotiation.cc:769] Sending connection context
0808 14:49:31.650145 (+ 66us) client_negotiation.cc:240] Negotiation successful
0808 14:49:31.650258 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260808 14:49:31.650362 1209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:31.643868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40164 (local address 127.30.214.189:34323)
0808 14:49:31.643941 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:31.643943 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:31.643952 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:49:31.643980 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:31.643981 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:31.643993 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:31.644038 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:31.644365 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:31.644858 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:31.645572 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:31.645800 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:31.645855 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:31.647958 (+ 2103us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:31.647960 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:31.647960 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:31.647967 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:31.649246 (+ 1279us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:31.649639 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:31.649640 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:31.649640 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:31.649694 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:31.649859 (+ 165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:31.649860 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:31.649860 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:31.649972 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:31.650044 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:31.650193 (+ 149us) server_negotiation.cc:299] Negotiation successful
0808 14:49:31.650270 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 14:49:31.650858 1085 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.214.188" port: 36781 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:49:31.651219 1087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:31.651123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.188:36781 (local address 127.0.0.1:39924)
0808 14:49:31.651166 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:31.651195 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.188:36781: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
I20260808 14:49:31.651579 1087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:31.651518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.188:36781 (local address 127.0.0.1:39938)
0808 14:49:31.651540 (+ 22us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:31.651567 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.188:36781: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":14}
W20260808 14:49:31.651656 1085 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.214.188:36781: Network error: Client connection negotiation failed: client connection to 127.30.214.188:36781: connect: Connection refused (error 111)
I20260808 14:49:31.653934 1205 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.214.188" port: 36781 } attempt: 1
I20260808 14:49:31.654312 1207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:31.654205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.188:36781 (local address 127.0.0.1:39948)
0808 14:49:31.654255 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:31.654286 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.188:36781: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260808 14:49:31.654656 1207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:31.654566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.188:36781 (local address 127.0.0.1:39958)
0808 14:49:31.654608 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:31.654633 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.188:36781: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260808 14:49:31.654742 1205 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.214.188:36781: Network error: Client connection negotiation failed: client connection to 127.30.214.188:36781: connect: Connection refused (error 111)
I20260808 14:49:31.682819 1085 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.214.188" port: 36781 } attempt: 1
I20260808 14:49:31.683531 1087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:31.683355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.188:36781 (local address 127.0.0.1:39966)
0808 14:49:31.683433 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:31.683477 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.188:36781: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260808 14:49:31.683948 1087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:31.683865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.188:36781 (local address 127.0.0.1:39982)
0808 14:49:31.683903 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:31.683929 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.188:36781: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
W20260808 14:49:31.684121 1085 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.214.188:36781: Network error: Client connection negotiation failed: client connection to 127.30.214.188:36781: connect: Connection refused (error 111)
W20260808 14:49:31.701819 1212 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 14:49:31.702064 1212 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:49:31.702080 1212 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:49:31.702101 1212 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:49:31.703341 1212 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:49:31.703392 1212 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:49:31.703403 1212 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:49:31.703415 1212 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:49:31.703426 1212 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:49:31.705015 1212 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.214.148:38295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200295877777-31578-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200295877777-31578-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.30.214.190:33573,127.30.214.189:34323,127.30.214.188:36781
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200295877777-31578-0/krb5kdc/kudu_127.30.214.188.keytab
--principal=kudu/127.30.214.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.214.188:36781
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200295877777-31578-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.30.214.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1212
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200295877777-31578-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 13:50:25 UTC on ccycloud.quasar-hyhbpz.root.comops.site
build id 4574923
I20260808 14:49:31.705271 1212 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:49:31.705549 1212 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:49:31.710322 1220 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:31.710306 1222 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:49:31.710309 1219 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:49:31.710561 1212 server_base.cc:1034] running on GCE node
I20260808 14:49:31.710799 1212 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:49:31.711095 1212 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:49:31.712244 1212 hybrid_clock.cc:648] HybridClock initialized: now 1786200571712224 us; error 37 us; skew 500 ppm
Aug 08 14:49:31 dist-test-slave-42z9 krb5kdc[963](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200571, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:49:31.714797 1212 init.cc:377] Logged in from keytab as kudu/127.30.214.188@KRBTEST.COM (short username kudu)
I20260808 14:49:31.715268 1212 webserver.cc:460] Webserver started at http://127.30.214.188:45563/ using document root <none> and password file <none>
I20260808 14:49:31.715490 1212 fs_manager.cc:359] Metadata directory not provided
I20260808 14:49:31.715543 1212 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:49:31.715670 1212 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:49:31.716768 1212 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200295877777-31578-0/minicluster-data/master-2/data/instance:
uuid: "041b2949500b44cfa9574b51d153ebdd"
format_stamp: "Formatted at 2026-08-08 14:49:31 on dist-test-slave-42z9"
server_key: "0fc3c56b03b49c40946ef3aaaf2b7ac3"
server_key_iv: "2502ba2651800f3cc90a9c8445bb1a77"
server_key_version: "encryptionkey@0"
I20260808 14:49:31.717116 1212 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200295877777-31578-0/minicluster-data/master-2/wal/instance:
uuid: "041b2949500b44cfa9574b51d153ebdd"
format_stamp: "Formatted at 2026-08-08 14:49:31 on dist-test-slave-42z9"
server_key: "0fc3c56b03b49c40946ef3aaaf2b7ac3"
server_key_iv: "2502ba2651800f3cc90a9c8445bb1a77"
server_key_version: "encryptionkey@0"
I20260808 14:49:31.718510 1212 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 14:49:31.719204 1237 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:49:31.719374 1212 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 14:49:31.719461 1212 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200295877777-31578-0/minicluster-data/master-2/data,/tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200295877777-31578-0/minicluster-data/master-2/wal
uuid: "041b2949500b44cfa9574b51d153ebdd"
format_stamp: "Formatted at 2026-08-08 14:49:31 on dist-test-slave-42z9"
server_key: "0fc3c56b03b49c40946ef3aaaf2b7ac3"
server_key_iv: "2502ba2651800f3cc90a9c8445bb1a77"
server_key_version: "encryptionkey@0"
I20260808 14:49:31.719523 1212 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200295877777-31578-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200295877777-31578-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200295877777-31578-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:49:31.722875 1205 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.214.188" port: 36781 } attempt: 2
I20260808 14:49:31.723397 1207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:31.723157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.188:36781 (local address 127.0.0.1:39990)
0808 14:49:31.723263 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:31.723342 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.188:36781: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260808 14:49:31.723937 1207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:31.723767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.188:36781 (local address 127.0.0.1:40002)
0808 14:49:31.723857 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:31.723903 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.214.188:36781: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260808 14:49:31.724040 1205 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.214.188:36781: Network error: Client connection negotiation failed: client connection to 127.30.214.188:36781: connect: Connection refused (error 111)
I20260808 14:49:31.728323 1212 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:49:31.730297 1212 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:49:31.730422 1212 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:49:31.734212 1212 rpc_server.cc:307] RPC server started. Bound to: 127.30.214.188:36781
I20260808 14:49:31.734246 1314 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.214.188:36781 every 8 connection(s)
I20260808 14:49:31.734583 1212 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200295877777-31578-0/minicluster-data/master-2/data/info.pb
I20260808 14:49:31.735433 1316 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:49:31.736955 1316 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.214.190" port: 33573 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:49:31.741739 31578 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskT6IgCE/build/release/bin/kudu as pid 1212
I20260808 14:49:31.741839 31578 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskT6IgCE/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786200295877777-31578-0/minicluster-data/master-2/wal/instance
I20260808 14:49:31.742027 31578 external_mini_cluster.cc:1428] Setting key 25e9ef41299eb66abe44d980850150e9
Aug 08 14:49:31 dist-test-slave-42z9 krb5kdc[963](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200571, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.188@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
I20260808 14:49:31.746286 1088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:31.737941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35194 (local address 127.30.214.190:33573)
0808 14:49:31.738013 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:31.738015 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:31.738190 (+ 175us) server_negotiation.cc:407] Connection header received
0808 14:49:31.738688 (+ 498us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:31.738689 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:31.738701 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:31.738745 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:31.739400 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:31.739877 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:31.740820 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:31.741005 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:31.741064 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:31.743609 (+ 2545us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:31.743611 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:31.743611 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:31.743620 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:31.744902 (+ 1282us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:31.745287 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:31.745289 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:31.745289 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:31.745349 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:31.745653 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:31.745653 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:31.745654 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:31.745767 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:31.745815 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:31.746150 (+ 335us) server_negotiation.cc:299] Negotiation successful
0808 14:49:31.746217 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 14:49:31.746541 1320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:31.737876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.190:33573 (local address 127.0.0.1:35194)
0808 14:49:31.738066 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:31.738106 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 14:49:31.738588 (+ 482us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:49:31.738829 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:49:31.738832 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:49:31.739105 (+ 273us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:49:31.739302 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:31.739306 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:31.739960 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:31.739962 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:31.740738 (+ 776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:31.740740 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:31.741076 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:31.741077 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:31.741192 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:31.741773 (+ 581us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:49:31.741783 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:49:31.743524 (+ 1741us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:49:31.744981 (+ 1457us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:31.744989 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:31.744991 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:31.745219 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:31.745418 (+ 199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:31.745419 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:31.745419 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:31.745580 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:31.745826 (+ 246us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:49:31.745833 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:49:31.746016 (+ 183us) client_negotiation.cc:769] Sending connection context
0808 14:49:31.746143 (+ 127us) client_negotiation.cc:240] Negotiation successful
0808 14:49:31.746309 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":85,"threads_started":1}
Aug 08 14:49:31 dist-test-slave-42z9 krb5kdc[963](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200571, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.214.188@KRBTEST.COM
I20260808 14:49:31.747104 1316 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.214.189" port: 34323 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:49:31.750454 1323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:31.742395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40006 (local address 127.30.214.188:36781)
0808 14:49:31.742538 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:31.742543 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:31.742563 (+ 20us) server_negotiation.cc:407] Connection header received
0808 14:49:31.742627 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:31.742628 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:31.742645 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:31.742709 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:31.743396 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:31.744049 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:31.744753 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:31.745055 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:31.745116 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:31.747638 (+ 2522us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:31.747647 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:31.747647 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:31.747654 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:31.749238 (+ 1584us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:31.749650 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:31.749653 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:31.749653 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:31.749706 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:31.749881 (+ 175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:31.749882 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:31.749882 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:31.750041 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:31.750181 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:31.750265 (+ 84us) server_negotiation.cc:299] Negotiation successful
0808 14:49:31.750352 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":79,"threads_started":1}
Aug 08 14:49:31 dist-test-slave-42z9 krb5kdc[963](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200571, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.188@KRBTEST.COM for kudu/127.30.214.189@KRBTEST.COM
I20260808 14:49:31.753927 1320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:31.747338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.189:34323 (local address 127.0.0.1:40178)
0808 14:49:31.747378 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:31.747389 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:49:31.747425 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:49:31.747597 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:49:31.747598 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:49:31.747745 (+ 147us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:49:31.747805 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:31.747807 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:31.748553 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:31.748555 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:31.749299 (+ 744us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:31.749301 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:31.749752 (+ 451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:31.749753 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:31.749826 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:31.750144 (+ 318us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:49:31.750149 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:49:31.751510 (+ 1361us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:49:31.752945 (+ 1435us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:31.752946 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:31.752946 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:31.753104 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:31.753303 (+ 199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:31.753304 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:31.753305 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:31.753373 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:31.753656 (+ 283us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:49:31.753657 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:49:31.753704 (+ 47us) client_negotiation.cc:769] Sending connection context
0808 14:49:31.753771 (+ 67us) client_negotiation.cc:240] Negotiation successful
0808 14:49:31.753860 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23}
I20260808 14:49:31.753993 1209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:31.747426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40178 (local address 127.30.214.189:34323)
0808 14:49:31.747476 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:31.747477 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:31.747486 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:49:31.747520 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:31.747521 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:31.747532 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:31.747594 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:31.747885 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:31.748468 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:31.749365 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:31.749691 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:31.749741 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:31.751572 (+ 1831us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:31.751574 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:31.751574 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:31.751582 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:31.752866 (+ 1284us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:31.753161 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:31.753162 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:31.753162 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:31.753221 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:31.753478 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:31.753479 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:31.753480 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:31.753602 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:31.753651 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:31.753823 (+ 172us) server_negotiation.cc:299] Negotiation successful
0808 14:49:31.753900 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 14:49:31.754326 1316 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.214.188" port: 36781 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 14:49:31 dist-test-slave-42z9 krb5kdc[963](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200571, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.214.190@KRBTEST.COM
Aug 08 14:49:31 dist-test-slave-42z9 krb5kdc[963](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200571, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.188@KRBTEST.COM for kudu/127.30.214.188@KRBTEST.COM
I20260808 14:49:31.758837 1088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:31.751331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35208 (local address 127.30.214.190:33573)
0808 14:49:31.751390 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:31.751392 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:31.751399 (+ 7us) server_negotiation.cc:407] Connection header received
0808 14:49:31.751420 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:31.751421 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:31.751428 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:31.751473 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:31.752019 (+ 546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:31.752574 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:31.753412 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:31.753665 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:31.753732 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:31.756301 (+ 2569us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:31.756303 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:31.756303 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:31.756311 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:31.757705 (+ 1394us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:31.758038 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:31.758039 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:31.758039 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:31.758094 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:31.758317 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:31.758318 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:31.758319 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:31.758457 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:31.758656 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:31.758698 (+ 42us) server_negotiation.cc:299] Negotiation successful
0808 14:49:31.758769 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 14:49:31.759249 1085 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.214.188" port: 36781 } attempt: 2
I20260808 14:49:31.760885 1323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:31.754622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40020 (local address 127.30.214.188:36781)
0808 14:49:31.754654 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:31.754656 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:31.754685 (+ 29us) server_negotiation.cc:407] Connection header received
0808 14:49:31.754737 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:31.754738 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:31.754747 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:31.754788 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:31.755018 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:31.755577 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:31.756317 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:31.756525 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:31.756580 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:31.758074 (+ 1494us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:31.758076 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:31.758076 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:31.758083 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:31.759689 (+ 1606us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:31.760073 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:31.760074 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:31.760074 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:31.760135 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:31.760331 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:31.760332 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:31.760332 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:31.760478 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:31.760537 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:31.760676 (+ 139us) server_negotiation.cc:299] Negotiation successful
0808 14:49:31.760769 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260808 14:49:31.761180 1320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:31.754593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.188:36781 (local address 127.0.0.1:40020)
0808 14:49:31.754651 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:31.754659 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 14:49:31.754698 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:49:31.754798 (+ 100us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:49:31.754799 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:49:31.754930 (+ 131us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:49:31.754959 (+ 29us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:31.754960 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:31.755687 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:31.755688 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:31.756231 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:31.756234 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:31.756585 (+ 351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:31.756586 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:31.756630 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:31.756910 (+ 280us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:49:31.756913 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:49:31.758001 (+ 1088us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:49:31.759781 (+ 1780us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:31.759782 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:31.759782 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:31.760003 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:31.760204 (+ 201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:31.760204 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:31.760205 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:31.760271 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:31.760529 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:49:31.760530 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:49:31.760571 (+ 41us) client_negotiation.cc:769] Sending connection context
0808 14:49:31.760641 (+ 70us) client_negotiation.cc:240] Negotiation successful
0808 14:49:31.760836 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46,"mutex_wait_us":63}
I20260808 14:49:31.763748 1316 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 041b2949500b44cfa9574b51d153ebdd: Bootstrap starting.
Aug 08 14:49:31 dist-test-slave-42z9 krb5kdc[963](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200571, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.190@KRBTEST.COM for kudu/127.30.214.188@KRBTEST.COM
I20260808 14:49:31.764454 1316 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 041b2949500b44cfa9574b51d153ebdd: Neither blocks nor log segments found. Creating new log.
Aug 08 14:49:31 dist-test-slave-42z9 krb5kdc[963](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200571, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.214.189@KRBTEST.COM
I20260808 14:49:31.764794 1316 log.cc:824] T 00000000000000000000000000000000 P 041b2949500b44cfa9574b51d153ebdd: Log is configured to *not* fsync() on all Append() calls
I20260808 14:49:31.766088 1316 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 041b2949500b44cfa9574b51d153ebdd: No bootstrap required, opened a new log
I20260808 14:49:31.767750 1087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:31.759490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.188:36781 (local address 127.0.0.1:40026)
0808 14:49:31.759534 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:31.759542 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 14:49:31.759590 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:49:31.759920 (+ 330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:49:31.759921 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:49:31.760070 (+ 149us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:49:31.760111 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:31.760113 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:31.761072 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:31.761073 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:31.761923 (+ 850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:31.761926 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:31.762755 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:31.762756 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:31.762814 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:31.763139 (+ 325us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:49:31.763143 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:49:31.764450 (+ 1307us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:49:31.766576 (+ 2126us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:31.766577 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:31.766578 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:31.766799 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:31.767035 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:31.767035 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:31.767036 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:31.767105 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:31.767405 (+ 300us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:49:31.767406 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:49:31.767458 (+ 52us) client_negotiation.cc:769] Sending connection context
0808 14:49:31.767539 (+ 81us) client_negotiation.cc:240] Negotiation successful
0808 14:49:31.767648 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260808 14:49:31.767781 1324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:31.759605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40026 (local address 127.30.214.188:36781)
0808 14:49:31.759791 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:31.759793 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:31.759798 (+ 5us) server_negotiation.cc:407] Connection header received
0808 14:49:31.759813 (+ 15us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:31.759814 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:31.759823 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:31.760165 (+ 342us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:31.760255 (+ 90us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:31.761004 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:31.761997 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:31.762654 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:31.762951 (+ 297us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:31.764588 (+ 1637us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:31.764590 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:31.764590 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:31.764599 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:31.766479 (+ 1880us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:31.766891 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:31.766892 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:31.766893 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:31.766969 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:31.767172 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:31.767173 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:31.767173 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:31.767336 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:31.767403 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:31.767576 (+ 173us) server_negotiation.cc:299] Negotiation successful
0808 14:49:31.767665 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":115,"threads_started":1}
I20260808 14:49:31.767868 1209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:31.759593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40186 (local address 127.30.214.189:34323)
0808 14:49:31.759663 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:31.759665 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:31.759804 (+ 139us) server_negotiation.cc:407] Connection header received
0808 14:49:31.759866 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:31.759867 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:31.759877 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:31.759921 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:31.760473 (+ 552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:31.761137 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:31.762095 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:31.762348 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:31.762396 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:31.765090 (+ 2694us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:31.765091 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:31.765092 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:31.765099 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:31.766654 (+ 1555us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:31.766995 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:31.766996 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:31.766997 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:31.767049 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:31.767233 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:31.767234 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:31.767234 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:31.767349 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:31.767503 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:31.767716 (+ 213us) server_negotiation.cc:299] Negotiation successful
0808 14:49:31.767789 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 14:49:31.768010 1316 raft_consensus.cc:348] T 00000000000000000000000000000000 P 041b2949500b44cfa9574b51d153ebdd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af58ea3d4986432db73a5c538a4215fd" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 33573 } } peers { permanent_uuid: "beb338aaff6e49e28431f86521846989" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 34323 } } peers { permanent_uuid: "041b2949500b44cfa9574b51d153ebdd" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 36781 } }
I20260808 14:49:31.768196 1316 raft_consensus.cc:729] T 00000000000000000000000000000000 P 041b2949500b44cfa9574b51d153ebdd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 041b2949500b44cfa9574b51d153ebdd, State: Initialized, Role: FOLLOWER
I20260808 14:49:31.768280 1316 consensus_queue.cc:260] T 00000000000000000000000000000000 P 041b2949500b44cfa9574b51d153ebdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af58ea3d4986432db73a5c538a4215fd" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 33573 } } peers { permanent_uuid: "beb338aaff6e49e28431f86521846989" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 34323 } } peers { permanent_uuid: "041b2949500b44cfa9574b51d153ebdd" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 36781 } }
I20260808 14:49:31.768602 1316 sys_catalog.cc:564] T 00000000000000000000000000000000 P 041b2949500b44cfa9574b51d153ebdd [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:49:31.769868 1085 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af58ea3d4986432db73a5c538a4215fd: Bootstrap starting.
I20260808 14:49:31.770666 1085 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P af58ea3d4986432db73a5c538a4215fd: Neither blocks nor log segments found. Creating new log.
I20260808 14:49:31.770749 31578 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:49:31.770964 1085 log.cc:824] T 00000000000000000000000000000000 P af58ea3d4986432db73a5c538a4215fd: Log is configured to *not* fsync() on all Append() calls
W20260808 14:49:31.770387 1344 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 041b2949500b44cfa9574b51d153ebdd: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260808 14:49:31.771517 1329 sys_catalog.cc:455] T 00000000000000000000000000000000 P 041b2949500b44cfa9574b51d153ebdd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af58ea3d4986432db73a5c538a4215fd" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 33573 } } peers { permanent_uuid: "beb338aaff6e49e28431f86521846989" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 34323 } } peers { permanent_uuid: "041b2949500b44cfa9574b51d153ebdd" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 36781 } } }
I20260808 14:49:31.771638 1329 sys_catalog.cc:458] T 00000000000000000000000000000000 P 041b2949500b44cfa9574b51d153ebdd [sys.catalog]: This master's current role is: FOLLOWER
W20260808 14:49:31.771595 1344 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:49:31.772382 1085 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af58ea3d4986432db73a5c538a4215fd: No bootstrap required, opened a new log
I20260808 14:49:31.771696 1049 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "af58ea3d4986432db73a5c538a4215fd"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35208
I20260808 14:49:31.771840 1212 master_runner.cc:186] Error getting master registration for 127.30.214.190:33573: OK, instance_id { permanent_uuid: "af58ea3d4986432db73a5c538a4215fd" instance_seqno: 1786200571416031 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 14:49:31.773679 1212 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 14:49:31.773711 1085 raft_consensus.cc:348] T 00000000000000000000000000000000 P af58ea3d4986432db73a5c538a4215fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af58ea3d4986432db73a5c538a4215fd" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 33573 } } peers { permanent_uuid: "beb338aaff6e49e28431f86521846989" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 34323 } } peers { permanent_uuid: "041b2949500b44cfa9574b51d153ebdd" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 36781 } }
I20260808 14:49:31.773844 1085 raft_consensus.cc:729] T 00000000000000000000000000000000 P af58ea3d4986432db73a5c538a4215fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af58ea3d4986432db73a5c538a4215fd, State: Initialized, Role: FOLLOWER
I20260808 14:49:31.773921 1085 consensus_queue.cc:260] T 00000000000000000000000000000000 P af58ea3d4986432db73a5c538a4215fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af58ea3d4986432db73a5c538a4215fd" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 33573 } } peers { permanent_uuid: "beb338aaff6e49e28431f86521846989" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 34323 } } peers { permanent_uuid: "041b2949500b44cfa9574b51d153ebdd" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 36781 } }
I20260808 14:49:31.774175 1349 sys_catalog.cc:455] T 00000000000000000000000000000000 P af58ea3d4986432db73a5c538a4215fd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af58ea3d4986432db73a5c538a4215fd" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 33573 } } peers { permanent_uuid: "beb338aaff6e49e28431f86521846989" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 34323 } } peers { permanent_uuid: "041b2949500b44cfa9574b51d153ebdd" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 36781 } } }
I20260808 14:49:31.774245 1085 sys_catalog.cc:564] T 00000000000000000000000000000000 P af58ea3d4986432db73a5c538a4215fd [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:49:31.774257 1349 sys_catalog.cc:458] T 00000000000000000000000000000000 P af58ea3d4986432db73a5c538a4215fd [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:49:31.774377 1049 raft_consensus.cc:482] T 00000000000000000000000000000000 P af58ea3d4986432db73a5c538a4215fd [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260808 14:49:31.774448 1049 raft_consensus.cc:3037] T 00000000000000000000000000000000 P af58ea3d4986432db73a5c538a4215fd [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:49:31.775285 1049 raft_consensus.cc:504] T 00000000000000000000000000000000 P af58ea3d4986432db73a5c538a4215fd [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af58ea3d4986432db73a5c538a4215fd" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 33573 } } peers { permanent_uuid: "beb338aaff6e49e28431f86521846989" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 34323 } } peers { permanent_uuid: "041b2949500b44cfa9574b51d153ebdd" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 36781 } }
W20260808 14:49:31.776018 1370 catalog_manager.cc:1558] T 00000000000000000000000000000000 P af58ea3d4986432db73a5c538a4215fd: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:49:31.776069 1370 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:49:31.776001 1278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "af58ea3d4986432db73a5c538a4215fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "041b2949500b44cfa9574b51d153ebdd"
I20260808 14:49:31.776110 1278 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 041b2949500b44cfa9574b51d153ebdd [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:49:31.777751 1278 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 041b2949500b44cfa9574b51d153ebdd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af58ea3d4986432db73a5c538a4215fd in term 1.
I20260808 14:49:31.777995 1014 leader_election.cc:302] T 00000000000000000000000000000000 P af58ea3d4986432db73a5c538a4215fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 041b2949500b44cfa9574b51d153ebdd, af58ea3d4986432db73a5c538a4215fd; no voters:
I20260808 14:49:31.775568 1049 leader_election.cc:288] T 00000000000000000000000000000000 P af58ea3d4986432db73a5c538a4215fd [CANDIDATE]: Term 1 election: Requested vote from peers beb338aaff6e49e28431f86521846989 (127.30.214.189:34323), 041b2949500b44cfa9574b51d153ebdd (127.30.214.188:36781)
I20260808 14:49:31.777300 989 master_runner.cc:186] Error getting master registration for 127.30.214.189:34323: OK, instance_id { permanent_uuid: "beb338aaff6e49e28431f86521846989" instance_seqno: 1786200571579751 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 14:49:31.779604 989 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 14:49:31.779672 1349 raft_consensus.cc:2781] T 00000000000000000000000000000000 P af58ea3d4986432db73a5c538a4215fd [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:49:31.779881 1349 raft_consensus.cc:686] T 00000000000000000000000000000000 P af58ea3d4986432db73a5c538a4215fd [term 1 LEADER]: Becoming Leader. State: Replica: af58ea3d4986432db73a5c538a4215fd, State: Running, Role: LEADER
I20260808 14:49:31.779982 1349 consensus_queue.cc:237] T 00000000000000000000000000000000 P af58ea3d4986432db73a5c538a4215fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af58ea3d4986432db73a5c538a4215fd" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 33573 } } peers { permanent_uuid: "beb338aaff6e49e28431f86521846989" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 34323 } } peers { permanent_uuid: "041b2949500b44cfa9574b51d153ebdd" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 36781 } }
I20260808 14:49:31.781688 1374 sys_catalog.cc:455] T 00000000000000000000000000000000 P af58ea3d4986432db73a5c538a4215fd [sys.catalog]: SysCatalogTable state changed. Reason: New leader af58ea3d4986432db73a5c538a4215fd. Latest consensus state: current_term: 1 leader_uuid: "af58ea3d4986432db73a5c538a4215fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af58ea3d4986432db73a5c538a4215fd" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 33573 } } peers { permanent_uuid: "beb338aaff6e49e28431f86521846989" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 34323 } } peers { permanent_uuid: "041b2949500b44cfa9574b51d153ebdd" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 36781 } } }
I20260808 14:49:31.781880 1374 sys_catalog.cc:458] T 00000000000000000000000000000000 P af58ea3d4986432db73a5c538a4215fd [sys.catalog]: This master's current role is: LEADER
I20260808 14:49:31.782182 1387 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:49:31.782621 1387 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:49:31.794679 1088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:31.782253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35220 (local address 127.30.214.190:33573)
0808 14:49:31.782289 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:31.782291 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:31.782925 (+ 634us) server_negotiation.cc:407] Connection header received
0808 14:49:31.783074 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:31.783075 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:31.783085 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:31.783114 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:31.784036 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:31.784823 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:31.786452 (+ 1629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:31.786772 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:31.786812 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:31.790751 (+ 3939us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:31.790753 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:31.790754 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:31.790763 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:31.792719 (+ 1956us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:31.793510 (+ 791us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:31.793511 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:31.793512 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:31.793598 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:31.793897 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:31.793898 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:31.793899 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:31.794055 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:31.794152 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:31.794474 (+ 322us) server_negotiation.cc:299] Negotiation successful
0808 14:49:31.794579 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 14:49:31.796522 1324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:31.781592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40028 (local address 127.30.214.188:36781)
0808 14:49:31.781637 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:31.781640 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:31.782818 (+ 1178us) server_negotiation.cc:407] Connection header received
0808 14:49:31.783184 (+ 366us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:31.783186 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:31.783197 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:31.783228 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:31.784685 (+ 1457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:31.785486 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:31.787545 (+ 2059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:31.787896 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:31.787940 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:31.791083 (+ 3143us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:31.791085 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:31.791085 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:31.791094 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:31.792895 (+ 1801us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:31.793780 (+ 885us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:31.793781 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:31.793782 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:31.793845 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:31.794063 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:31.794064 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:31.794064 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:31.794199 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:31.794281 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:31.796319 (+ 2038us) server_negotiation.cc:299] Negotiation successful
0808 14:49:31.796421 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 14:49:31.797760 1209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:31.782558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40192 (local address 127.30.214.189:34323)
0808 14:49:31.782601 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:31.782603 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:31.786613 (+ 4010us) server_negotiation.cc:407] Connection header received
0808 14:49:31.786712 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:31.786713 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:31.786726 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:31.786754 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:31.788283 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:31.789023 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:31.790060 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:31.790378 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:31.790421 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:31.794352 (+ 3931us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:31.794353 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:31.794354 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:31.794362 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:31.796032 (+ 1670us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:31.796836 (+ 804us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:31.796837 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:31.796838 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:31.796910 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:31.797101 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:31.797102 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:31.797102 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:31.797228 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:31.797305 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:31.797569 (+ 264us) server_negotiation.cc:299] Negotiation successful
0808 14:49:31.797663 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 14:49:31.802148 1278 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 041b2949500b44cfa9574b51d153ebdd [term 1 FOLLOWER]: Refusing update from remote peer af58ea3d4986432db73a5c538a4215fd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:49:31.802583 1374 consensus_queue.cc:1035] T 00000000000000000000000000000000 P af58ea3d4986432db73a5c538a4215fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "041b2949500b44cfa9574b51d153ebdd" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 36781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:49:31.804324 1329 sys_catalog.cc:455] T 00000000000000000000000000000000 P 041b2949500b44cfa9574b51d153ebdd [sys.catalog]: SysCatalogTable state changed. Reason: New leader af58ea3d4986432db73a5c538a4215fd. Latest consensus state: current_term: 1 leader_uuid: "af58ea3d4986432db73a5c538a4215fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af58ea3d4986432db73a5c538a4215fd" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 33573 } } peers { permanent_uuid: "beb338aaff6e49e28431f86521846989" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 34323 } } peers { permanent_uuid: "041b2949500b44cfa9574b51d153ebdd" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 36781 } } }
I20260808 14:49:31.804430 1329 sys_catalog.cc:458] T 00000000000000000000000000000000 P 041b2949500b44cfa9574b51d153ebdd [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:49:31.815088 1349 sys_catalog.cc:455] T 00000000000000000000000000000000 P af58ea3d4986432db73a5c538a4215fd [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "af58ea3d4986432db73a5c538a4215fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af58ea3d4986432db73a5c538a4215fd" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 33573 } } peers { permanent_uuid: "beb338aaff6e49e28431f86521846989" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 34323 } } peers { permanent_uuid: "041b2949500b44cfa9574b51d153ebdd" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 36781 } } }
I20260808 14:49:31.815219 1349 sys_catalog.cc:458] T 00000000000000000000000000000000 P af58ea3d4986432db73a5c538a4215fd [sys.catalog]: This master's current role is: LEADER
I20260808 14:49:31.815171 1205 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.214.188" port: 36781 } attempt: 3
I20260808 14:49:31.815682 1329 sys_catalog.cc:455] T 00000000000000000000000000000000 P 041b2949500b44cfa9574b51d153ebdd [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "af58ea3d4986432db73a5c538a4215fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af58ea3d4986432db73a5c538a4215fd" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 33573 } } peers { permanent_uuid: "beb338aaff6e49e28431f86521846989" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 34323 } } peers { permanent_uuid: "041b2949500b44cfa9574b51d153ebdd" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 36781 } } }
I20260808 14:49:31.815779 1329 sys_catalog.cc:458] T 00000000000000000000000000000000 P 041b2949500b44cfa9574b51d153ebdd [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:49:31.815899 1394 mvcc.cc:205] Tried to move back new op lower bound from 7316277542067650560 to 7316277542011502592. Current Snapshot: MvccSnapshot[applied={T|T < 7316277542067650560}]
I20260808 14:49:31.816139 1393 mvcc.cc:205] Tried to move back new op lower bound from 7316277542067650560 to 7316277542011502592. Current Snapshot: MvccSnapshot[applied={T|T < 7316277542067650560}]
I20260808 14:49:31.818940 1387 catalog_manager.cc:1347] Generated new cluster ID: a409b3c5ddae4d6ba92ab5f43cb4ded0
I20260808 14:49:31.819108 1387 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 14:49:31 dist-test-slave-42z9 krb5kdc[963](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786200571, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.214.189@KRBTEST.COM for kudu/127.30.214.188@KRBTEST.COM
I20260808 14:49:31.825202 1207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:31.815488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.214.188:36781 (local address 127.0.0.1:40042)
0808 14:49:31.815549 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0808 14:49:31.815563 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 14:49:31.815615 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:49:31.815856 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:49:31.815857 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:49:31.816051 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:49:31.816102 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:31.816104 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:31.817195 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:31.817197 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:31.818044 (+ 847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:49:31.818048 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:49:31.818623 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:49:31.818624 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:49:31.818685 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:31.819205 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:49:31.819210 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:49:31.820846 (+ 1636us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:49:31.824113 (+ 3267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:31.824114 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:31.824115 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:31.824339 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:31.824552 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:49:31.824553 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:49:31.824553 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:49:31.824614 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:49:31.824886 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:49:31.824887 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:49:31.824933 (+ 46us) client_negotiation.cc:769] Sending connection context
0808 14:49:31.824990 (+ 57us) client_negotiation.cc:240] Negotiation successful
0808 14:49:31.825099 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260808 14:49:31.825868 1324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:31.815600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40042 (local address 127.30.214.188:36781)
0808 14:49:31.815721 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:31.815722 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:31.815730 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:49:31.815751 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:31.815752 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:31.815761 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:31.815807 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:31.816338 (+ 531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:31.817096 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:31.818163 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:31.818491 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:31.818562 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:31.820951 (+ 2389us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:49:31.820952 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:49:31.820953 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:49:31.820961 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:49:31.824009 (+ 3048us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:31.824416 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:31.824417 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:31.824418 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:31.824476 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:49:31.824675 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:49:31.824676 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:49:31.824676 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:49:31.824810 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:49:31.824863 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:31.825600 (+ 737us) server_negotiation.cc:299] Negotiation successful
0808 14:49:31.825774 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
I20260808 14:49:31.827503 1205 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P beb338aaff6e49e28431f86521846989: Bootstrap starting.
I20260808 14:49:31.828298 1205 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P beb338aaff6e49e28431f86521846989: Neither blocks nor log segments found. Creating new log.
I20260808 14:49:31.828596 1205 log.cc:824] T 00000000000000000000000000000000 P beb338aaff6e49e28431f86521846989: Log is configured to *not* fsync() on all Append() calls
I20260808 14:49:31.829697 1205 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P beb338aaff6e49e28431f86521846989: No bootstrap required, opened a new log
I20260808 14:49:31.831785 1205 raft_consensus.cc:348] T 00000000000000000000000000000000 P beb338aaff6e49e28431f86521846989 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af58ea3d4986432db73a5c538a4215fd" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 33573 } } peers { permanent_uuid: "beb338aaff6e49e28431f86521846989" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 34323 } } peers { permanent_uuid: "041b2949500b44cfa9574b51d153ebdd" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 36781 } }
I20260808 14:49:31.831934 1205 raft_consensus.cc:729] T 00000000000000000000000000000000 P beb338aaff6e49e28431f86521846989 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: beb338aaff6e49e28431f86521846989, State: Initialized, Role: FOLLOWER
I20260808 14:49:31.832007 1205 consensus_queue.cc:260] T 00000000000000000000000000000000 P beb338aaff6e49e28431f86521846989 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af58ea3d4986432db73a5c538a4215fd" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 33573 } } peers { permanent_uuid: "beb338aaff6e49e28431f86521846989" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 34323 } } peers { permanent_uuid: "041b2949500b44cfa9574b51d153ebdd" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 36781 } }
I20260808 14:49:31.832352 1205 sys_catalog.cc:564] T 00000000000000000000000000000000 P beb338aaff6e49e28431f86521846989 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:49:31.832412 1160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "af58ea3d4986432db73a5c538a4215fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "beb338aaff6e49e28431f86521846989"
I20260808 14:49:31.832545 1160 raft_consensus.cc:3037] T 00000000000000000000000000000000 P beb338aaff6e49e28431f86521846989 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:49:31.833432 1160 raft_consensus.cc:2454] T 00000000000000000000000000000000 P beb338aaff6e49e28431f86521846989 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af58ea3d4986432db73a5c538a4215fd in term 1.
I20260808 14:49:31.833618 1156 raft_consensus.cc:1261] T 00000000000000000000000000000000 P beb338aaff6e49e28431f86521846989 [term 1 FOLLOWER]: Refusing update from remote peer af58ea3d4986432db73a5c538a4215fd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:49:31.834455 1349 consensus_queue.cc:1035] T 00000000000000000000000000000000 P af58ea3d4986432db73a5c538a4215fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "beb338aaff6e49e28431f86521846989" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 34323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 14:49:31.839843 1424 catalog_manager.cc:1558] T 00000000000000000000000000000000 P beb338aaff6e49e28431f86521846989: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:49:31.839980 1424 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:49:31.840492 1415 mvcc.cc:205] Tried to move back new op lower bound from 7316277542067650560 to 7316277542011502592. Current Snapshot: MvccSnapshot[applied={T|T < 7316277542067650560}]
I20260808 14:49:31.840788 1414 sys_catalog.cc:455] T 00000000000000000000000000000000 P beb338aaff6e49e28431f86521846989 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "af58ea3d4986432db73a5c538a4215fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af58ea3d4986432db73a5c538a4215fd" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 33573 } } peers { permanent_uuid: "beb338aaff6e49e28431f86521846989" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 34323 } } peers { permanent_uuid: "041b2949500b44cfa9574b51d153ebdd" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 36781 } } }
I20260808 14:49:31.840934 1414 sys_catalog.cc:458] T 00000000000000000000000000000000 P beb338aaff6e49e28431f86521846989 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:49:31.841029 1414 sys_catalog.cc:455] T 00000000000000000000000000000000 P beb338aaff6e49e28431f86521846989 [sys.catalog]: SysCatalogTable state changed. Reason: New leader af58ea3d4986432db73a5c538a4215fd. Latest consensus state: current_term: 1 leader_uuid: "af58ea3d4986432db73a5c538a4215fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af58ea3d4986432db73a5c538a4215fd" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 33573 } } peers { permanent_uuid: "beb338aaff6e49e28431f86521846989" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 34323 } } peers { permanent_uuid: "041b2949500b44cfa9574b51d153ebdd" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 36781 } } }
I20260808 14:49:31.841128 1414 sys_catalog.cc:458] T 00000000000000000000000000000000 P beb338aaff6e49e28431f86521846989 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:49:31.841194 1414 sys_catalog.cc:455] T 00000000000000000000000000000000 P beb338aaff6e49e28431f86521846989 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "af58ea3d4986432db73a5c538a4215fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af58ea3d4986432db73a5c538a4215fd" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 33573 } } peers { permanent_uuid: "beb338aaff6e49e28431f86521846989" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 34323 } } peers { permanent_uuid: "041b2949500b44cfa9574b51d153ebdd" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 36781 } } }
I20260808 14:49:31.841282 1414 sys_catalog.cc:458] T 00000000000000000000000000000000 P beb338aaff6e49e28431f86521846989 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:49:31.849274 1349 sys_catalog.cc:455] T 00000000000000000000000000000000 P af58ea3d4986432db73a5c538a4215fd [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "af58ea3d4986432db73a5c538a4215fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af58ea3d4986432db73a5c538a4215fd" member_type: VOTER last_known_addr { host: "127.30.214.190" port: 33573 } } peers { permanent_uuid: "beb338aaff6e49e28431f86521846989" member_type: VOTER last_known_addr { host: "127.30.214.189" port: 34323 } } peers { permanent_uuid: "041b2949500b44cfa9574b51d153ebdd" member_type: VOTER last_known_addr { host: "127.30.214.188" port: 36781 } } }
I20260808 14:49:31.849414 1349 sys_catalog.cc:458] T 00000000000000000000000000000000 P af58ea3d4986432db73a5c538a4215fd [sys.catalog]: This master's current role is: LEADER
I20260808 14:49:31.850626 1387 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:49:31.851511 1387 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:49:31.864775 1387 catalog_manager.cc:5868] T 00000000000000000000000000000000 P af58ea3d4986432db73a5c538a4215fd: Generated new TSK 0
I20260808 14:49:31.864982 1387 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 14:49:31.892235 1088 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:49:31.890411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35222 (local address 127.30.214.190:33573)
0808 14:49:31.890460 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:31.890463 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:31.891485 (+ 1022us) server_negotiation.cc:407] Connection header received
0808 14:49:31.891591 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:31.891592 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:31.891604 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:31.891635 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:31.892154 (+ 519us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35222: BlockingRecv error: recv got EOF from 127.0.0.1:35222 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
W20260808 14:49:31.893061 1209 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:49:31.890827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40200 (local address 127.30.214.189:34323)
0808 14:49:31.890872 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:31.890873 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:31.892529 (+ 1656us) server_negotiation.cc:407] Connection header received
0808 14:49:31.892626 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:31.892627 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:31.892638 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:31.892665 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:31.892986 (+ 321us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40200: BlockingRecv error: recv got EOF from 127.0.0.1:40200 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
W20260808 14:49:31.893889 1324 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:49:31.891200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40044 (local address 127.30.214.188:36781)
0808 14:49:31.891240 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:31.891242 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:31.893276 (+ 2034us) server_negotiation.cc:407] Connection header received
0808 14:49:31.893373 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:31.893374 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:31.893385 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:31.893415 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:31.893829 (+ 414us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40044: BlockingRecv error: recv got EOF from 127.0.0.1:40044 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260808 14:49:31.896613 1209 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:49:31.895664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40204 (local address 127.30.214.189:34323)
0808 14:49:31.895701 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:31.895703 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:31.895974 (+ 271us) server_negotiation.cc:407] Connection header received
0808 14:49:31.896103 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:31.896104 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:31.896124 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:31.896153 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:31.896565 (+ 412us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40204: BlockingRecv error: recv got EOF from 127.0.0.1:40204 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260808 14:49:31.899788 1209 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:49:31.898935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40218 (local address 127.30.214.189:34323)
0808 14:49:31.898970 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:31.898972 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:31.899243 (+ 271us) server_negotiation.cc:407] Connection header received
0808 14:49:31.899339 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:31.899340 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:31.899373 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:31.899405 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:31.899739 (+ 334us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40218: BlockingRecv error: recv got EOF from 127.0.0.1:40218 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260808 14:49:31.903751 1209 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:49:31.902895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40222 (local address 127.30.214.189:34323)
0808 14:49:31.902933 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:31.902934 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:31.903214 (+ 280us) server_negotiation.cc:407] Connection header received
0808 14:49:31.903307 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:31.903308 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:31.903320 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:31.903349 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:31.903700 (+ 351us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40222: BlockingRecv error: recv got EOF from 127.0.0.1:40222 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260808 14:49:31.909941 1209 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:49:31.908988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40228 (local address 127.30.214.189:34323)
0808 14:49:31.909051 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:31.909053 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:31.909343 (+ 290us) server_negotiation.cc:407] Connection header received
0808 14:49:31.909467 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:31.909469 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:31.909481 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:31.909513 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:31.909881 (+ 368us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40228: BlockingRecv error: recv got EOF from 127.0.0.1:40228 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
W20260808 14:49:31.920264 1209 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:49:31.919264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40244 (local address 127.30.214.189:34323)
0808 14:49:31.919310 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:31.919312 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:31.919637 (+ 325us) server_negotiation.cc:407] Connection header received
0808 14:49:31.919741 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:31.919742 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:31.919753 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:31.919782 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:31.920199 (+ 417us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40244: BlockingRecv error: recv got EOF from 127.0.0.1:40244 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260808 14:49:31.939229 1209 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:49:31.938014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40252 (local address 127.30.214.189:34323)
0808 14:49:31.938076 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:31.938078 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:31.938448 (+ 370us) server_negotiation.cc:407] Connection header received
0808 14:49:31.938559 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:31.938561 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:31.938576 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:31.938607 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:31.939127 (+ 520us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40252: BlockingRecv error: recv got EOF from 127.0.0.1:40252 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
W20260808 14:49:31.973373 1209 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:49:31.972647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40256 (local address 127.30.214.189:34323)
0808 14:49:31.972704 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:31.972707 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:31.972820 (+ 113us) server_negotiation.cc:407] Connection header received
0808 14:49:31.972902 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:31.972904 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:31.972916 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:31.972959 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:31.973311 (+ 352us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40256: BlockingRecv error: recv got EOF from 127.0.0.1:40256 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
W20260808 14:49:32.039253 1209 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:49:32.038586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40258 (local address 127.30.214.189:34323)
0808 14:49:32.038683 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:32.038685 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:32.038722 (+ 37us) server_negotiation.cc:407] Connection header received
0808 14:49:32.038797 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:32.038798 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:32.038809 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:32.038851 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:32.039189 (+ 338us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40258: BlockingRecv error: recv got EOF from 127.0.0.1:40258 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
W20260808 14:49:32.169293 1209 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:49:32.168531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40272 (local address 127.30.214.189:34323)
0808 14:49:32.168599 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:32.168601 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:32.168691 (+ 90us) server_negotiation.cc:407] Connection header received
0808 14:49:32.168742 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:32.168744 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:32.168755 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:32.168801 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:32.169237 (+ 436us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40272: BlockingRecv error: recv got EOF from 127.0.0.1:40272 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
W20260808 14:49:32.427183 1209 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:49:32.426581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40278 (local address 127.30.214.189:34323)
0808 14:49:32.426661 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:32.426663 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:32.426677 (+ 14us) server_negotiation.cc:407] Connection header received
0808 14:49:32.426705 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:32.426706 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:32.426717 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:32.426783 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:49:32.427133 (+ 350us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40278: BlockingRecv error: recv got EOF from 127.0.0.1:40278 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 14:49:32.772218 1344 catalog_manager.cc:1259] Loaded cluster ID: a409b3c5ddae4d6ba92ab5f43cb4ded0
I20260808 14:49:32.772302 1344 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 041b2949500b44cfa9574b51d153ebdd: loading cluster ID for follower catalog manager: success
I20260808 14:49:32.773106 1344 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 041b2949500b44cfa9574b51d153ebdd: acquiring CA information for follower catalog manager: success
I20260808 14:49:32.773401 1344 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 041b2949500b44cfa9574b51d153ebdd: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 14:49:32.840498 1424 catalog_manager.cc:1259] Loaded cluster ID: a409b3c5ddae4d6ba92ab5f43cb4ded0
I20260808 14:49:32.840581 1424 catalog_manager.cc:1552] T 00000000000000000000000000000000 P beb338aaff6e49e28431f86521846989: loading cluster ID for follower catalog manager: success
I20260808 14:49:32.841404 1424 catalog_manager.cc:1574] T 00000000000000000000000000000000 P beb338aaff6e49e28431f86521846989: acquiring CA information for follower catalog manager: success
I20260808 14:49:32.841738 1424 catalog_manager.cc:1602] T 00000000000000000000000000000000 P beb338aaff6e49e28431f86521846989: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 14:49:32.942682 1521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:32.940320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40284 (local address 127.30.214.189:34323)
0808 14:49:32.940465 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:32.940467 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:32.940478 (+ 11us) server_negotiation.cc:407] Connection header received
0808 14:49:32.940525 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:32.940526 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:32.940577 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:32.940646 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:49:32.940756 (+ 110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:32.941248 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:32.942029 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:32.942222 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:32.942270 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:32.942395 (+ 125us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:49:32.942508 (+ 113us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:49:32.942563 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:32.942578 (+ 15us) server_negotiation.cc:299] Negotiation successful
0808 14:49:32.942595 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109,"thread_start_us":76,"threads_started":1}
I20260808 14:49:32.946756 1533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:32.944493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40058 (local address 127.30.214.188:36781)
0808 14:49:32.944590 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:32.944592 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:32.944600 (+ 8us) server_negotiation.cc:407] Connection header received
0808 14:49:32.944641 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:32.944641 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:32.944675 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:32.944741 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:49:32.944836 (+ 95us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:32.945311 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:32.946100 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:32.946306 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:32.946367 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:32.946487 (+ 120us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:49:32.946589 (+ 102us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:49:32.946642 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:32.946658 (+ 16us) server_negotiation.cc:299] Negotiation successful
0808 14:49:32.946675 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80,"thread_start_us":50,"threads_started":1}
I20260808 14:49:32.951129 1544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:32.948324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35234 (local address 127.30.214.190:33573)
0808 14:49:32.948560 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:32.948561 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:32.948568 (+ 7us) server_negotiation.cc:407] Connection header received
0808 14:49:32.948609 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:32.948610 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:32.948644 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:32.948715 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:49:32.948822 (+ 107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:32.949428 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:32.950252 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:32.950565 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:32.950636 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:32.950796 (+ 160us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:49:32.950900 (+ 104us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:49:32.950956 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:32.951012 (+ 56us) server_negotiation.cc:299] Negotiation successful
0808 14:49:32.951035 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":213,"thread_start_us":49,"threads_started":1}
I20260808 14:49:32.951371 1533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:32.948469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40070 (local address 127.30.214.188:36781)
0808 14:49:32.948506 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:32.948507 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:32.948823 (+ 316us) server_negotiation.cc:407] Connection header received
0808 14:49:32.948863 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:32.948864 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:32.948875 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:32.948924 (+ 49us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:49:32.949120 (+ 196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:32.949879 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:32.950679 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:32.950897 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:32.950925 (+ 28us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:32.951137 (+ 212us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:49:32.951168 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:49:32.951194 (+ 26us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:32.951291 (+ 97us) server_negotiation.cc:299] Negotiation successful
0808 14:49:32.951310 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 14:49:32.951649 1521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:49:32.948461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40286 (local address 127.30.214.189:34323)
0808 14:49:32.948507 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 14:49:32.948509 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 14:49:32.948949 (+ 440us) server_negotiation.cc:407] Connection header received
0808 14:49:32.948980 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:49:32.948981 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:49:32.948992 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:49:32.949039 (+ 47us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:49:32.949186 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:32.949930 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:32.950875 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:49:32.951147 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:49:32.951189 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:49:32.951383 (+ 194us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:49:32.951414 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:49:32.951440 (+ 26us) server_negotiation.cc:1035] Waiting for connection context
0808 14:49:32.951540 (+ 100us) server_negotiation.cc:299] Negotiation successful
0808 14:49:32.951566 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 14:49:32.952853 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 989
I20260808 14:49:32.963871 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 1096
I20260808 14:49:32.976215 31578 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskT6IgCE/build/release/bin/kudu with pid 1212
2026-08-08T14:49:32Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (2960 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (5890 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (277098 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST